Llama 3.2 1B Instruct Q8 0
Llama 3.2 1B Instruct Q8 0 is a quantized GGUF version of the Llama 3.2 1B Instruct model hosted on Hugging Face by the Hugging Quants organization. It belongs to the class of foundation models and supports text generation and conversational tasks across eight languages. The model card indicates it uses the Llama architecture from Meta and includes a specific chat template with tokens such as bos_token, eos_token, and structured role-based formatting for assistant responses.
The repository provides the file llama-3.2-1b-instruct-q8_0.gguf along with associated metadata confirming it is quantized. Total file size is listed as 1,321,079,200 bytes. It carries tags for GGUF, PyTorch, llama.cpp, and facebook/meta/llama families, positioning it for use in compatible inference runtimes that handle this format.
Hugging Quants maintains the repository, which has accumulated around 50 likes and hosts four discussions. The page forms part of the broader Hugging Face ecosystem for models, datasets, and related resources focused on open-source AI.
Overview
3 featuresLlama 3.2 1B Instruct Q8 0 sits in PulseGate's Text generation category. It focuses on running the Llama 3.2 1B model efficiently on CPUs and lower-end hardware. It is built as an open-source project for developers. Llama 3.2 1B Instruct Q8 0 is open source under the MIT license. It runs on the web, the command line, and API.
Hugging Quants builds and maintains Llama 3.2 1B Instruct Q8 0, and it first shipped in 2023. The project is developed in the open on GitHub with 121.2k stars and 1.2k commits in the last 90 days. The category is crowded — PulseGate's index counts 25 comparable projects. Key capabilities include GGUF Quantization, Local Inference, and Instruct Model.
Summary written by a language model from the project’s public pages.
- GGUF Quantization
- Local Inference
- Instruct Model
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- multiple
- bLangChain in the HTML
- local_oss
- bollama in the HTML · bllama in the HTML · bvllm in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 16:33 UTChugging-quants/Llama-3.2-1B-Instruct-Q8_0-GGUF verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Llama 3.2 1B Instruct Q8 0
- What does Llama 3.2 1B Instruct Q8 0 do?
- Llama 3.2 1B Instruct Q8 0 focuses on running the Llama 3.2 1B model efficiently on CPUs and lower-end hardware. It is catalogued under Text generation on PulseGate.
- Who should use Llama 3.2 1B Instruct Q8 0?
- Llama 3.2 1B Instruct Q8 0 is an open-source project built for developers.
- Is Llama 3.2 1B Instruct Q8 0 free?
- Yes — Llama 3.2 1B Instruct Q8 0 is open source under the MIT license and free to use.
- What platforms does Llama 3.2 1B Instruct Q8 0 run on?
- Llama 3.2 1B Instruct Q8 0 runs on the web, the command line, and API.
- Is Llama 3.2 1B Instruct Q8 0 still active?
- The GitHub repository shows 1.2k commits in the last 90 days.
- What projects are similar to Llama 3.2 1B Instruct Q8 0?
- Similar projects tracked by PulseGate include Llama 3.2 1B Instruct Q4 K M, Llama 3.2 1B Instruct, and Llama 3.2 3B Instruct.Llama 3.2 1B Instruct Q4 K MLlama 3.2 1B InstructLlama 3.2 3B Instruct
- Who makes Llama 3.2 1B Instruct Q8 0?
- Llama 3.2 1B Instruct Q8 0 is developed by Hugging Quants.
- When did Llama 3.2 1B Instruct Q8 0 launch?
- Llama 3.2 1B Instruct Q8 0 first shipped in 2023.
Similar projects
Closest matches by what these projects do