Llama 3.2 1B Instruct Q4 K M
The Llama 3.2 1B Instruct Q4_K_M is a quantized GGUF version of a text generation model hosted on Hugging Face. It belongs to the class of foundation models and carries tags for conversational use, Llama architecture, and llama.cpp compatibility.
The repository is maintained under the hugging-quants organization and includes the file llama-3.2-1b-instruct-q4_k_m.gguf. It is marked as quantized, with a total file size of 807690656 bytes. The model card lists support for eight languages and references the original Meta Llama 3.2 1B Instruct base along with PyTorch and GGUF formats.
A chat template is defined in the repository data using special tokens such as bos_token, eos_token, and structured role headers for assistant and user messages. This enables direct use in compatible inference engines without additional conversion. The page indicates four discussions, two of which are closed.
No pricing, licensing terms, or specific target audience beyond the model tags are stated in the repository metadata.
Overview
3 featuresIn the Foundation models & chat space, Llama 3.2 1B Instruct Q4 K M takes a focused approach. It focuses on running lightweight instruction-tuned LLMs locally with minimal hardware requirements using GGUF format. Llama 3.2 1B Instruct Q4 K M is an open-source project aimed at developers running local AI. Llama 3.2 1B Instruct Q4 K M is open source under the MIT license. Llama 3.2 1B Instruct Q4 K M is available on the web, the command line, and API.
It is developed by Hugging Quants, and it first shipped in 2023. The project is developed in the open on GitHub with 121.2k stars and 1.2k commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 19 similar projects. Key capabilities include Quantized Model, Local Inference, and Instruction Following.
Summary written by a language model from the project’s public pages.
- Quantized Model
- Local Inference
- Instruction Following
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bollama in the HTML · bllama in the HTML · bvllm in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 13:04 UTChugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Llama 3.2 1B Instruct Q4 K M
- What is Llama 3.2 1B Instruct Q4 K M?
- Llama 3.2 1B Instruct Q4 K M focuses on running lightweight instruction-tuned LLMs locally with minimal hardware requirements using GGUF format. It is catalogued under Foundation models & chat on PulseGate.
- Who should use Llama 3.2 1B Instruct Q4 K M?
- Llama 3.2 1B Instruct Q4 K M is an open-source project built for developers running local AI.
- Does Llama 3.2 1B Instruct Q4 K M have a free plan?
- Yes — Llama 3.2 1B Instruct Q4 K M is open source under the MIT license and free to use.
- What platforms does Llama 3.2 1B Instruct Q4 K M run on?
- Llama 3.2 1B Instruct Q4 K M runs on the web, the command line, and API.
- Is Llama 3.2 1B Instruct Q4 K M still maintained?
- The GitHub repository shows 1.2k commits in the last 90 days.
- What projects are similar to Llama 3.2 1B Instruct Q4 K M?
- Similar projects tracked by PulseGate include Llama 3.2 1B Instruct Q8 0, Llama 3.2 1B Instruct, and Llama 3.2 1B Instruct.Llama 3.2 1B Instruct Q8 0Llama 3.2 1B InstructLlama 3.2 1B Instruct
- Who makes Llama 3.2 1B Instruct Q4 K M?
- Llama 3.2 1B Instruct Q4 K M is developed by Hugging Quants.
- When did Llama 3.2 1B Instruct Q4 K M launch?
- Llama 3.2 1B Instruct Q4 K M first shipped in 2023.
Similar projects
Closest matches by what these projects do