This is a Red Hat optimized FP8 quantized variant of Meta's Llama 3.1 8B Instruct model. It supports chat, tool calling, and code interpretation while using less memory. Targeted at enterprise and open-source developers seeking performant, locally runnable LLMs.
Meta Llama 3.1 8B Instruct is a Text generation project. It focuses on running Llama 3.1 efficiently with reduced precision while preserving instruction-following quality. Meta Llama 3.1 8B Instruct is an open-source project aimed at developers. Meta Llama 3.1 8B Instruct is open source under the Apache-2.0 license. It runs on the web, the command line, and API.
Behind Meta Llama 3.1 8B Instruct is Red Hat, and it first shipped in 2019. The project is developed in the open on GitHub with 3.6k stars and 166 commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 19 similar projects. Key capabilities include Instruction Following, Quantized Model, and Tool Use. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do