Meta-Llama-3.1-8B-Instruct-GGUF provides GGUF quantized files for Meta's Llama 3.1 8B Instruct model. It supports multiple quantization levels (Q2_K through Q8_0) for efficient local execution. The model is used by developers who want to run a capable instruction-tuned LLM on consumer-grade hardware without relying on cloud APIs.
Meta Llama 3.1 8B Instruct sits in PulseGate's Text generation category. It focuses on running Meta's Llama 3.1 8B model locally with reduced memory footprint via quantization. It is built as an open-source project for developers. Meta Llama 3.1 8B Instruct is open source under the MIT license. It ships for the web, the command line, and API.
MaziyarPanahi builds and maintains Meta Llama 3.1 8B Instruct, and it first shipped in 2023. The project is developed in the open on GitHub with 121k stars and 1.2k commits in the last 90 days. Key capabilities include instruction tuned, Quantized GGUF, and multiple quantization levels.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do