Meta-Llama-3.1-8B-Instruct-GGUF provides GGUF quantized files for Meta's Llama 3.1 8B Instruct model. It supports multiple quantization levels (Q2_K through Q8_0) for efficient local execution. The model is used by developers who want to run a capable instruction-tuned LLM on consumer-grade hardware without relying on cloud APIs.
In the Foundation models & chat space, Meta Llama 3.1 8B Instruct takes a focused approach. It focuses on running Meta's Llama 3.1 8B model locally with reduced memory footprint via quantization. Meta Llama 3.1 8B Instruct is an open-source project aimed at developers. The project is open source (MIT). Meta Llama 3.1 8B Instruct is available on the web, the command line, and API.
Behind Meta Llama 3.1 8B Instruct is MaziyarPanahi, and the product first shipped in 2023. The project is developed in the open on GitHub with 121k stars and 1.2k commits in the last 90 days. Among its 4 catalogued features are instruction tuned, Quantized GGUF, and multiple quantization levels.
Latest indexed changes and source events
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF verified by the PulseGate indexer
