This is an optimized 4-bit quantized version of the Llama 3.2 1B Instruct model created by Unsloth. It is designed for efficient local inference while maintaining strong instruction-following capabilities. The model is available on Hugging Face and works with popular LLM runtimes and fine-tuning tools.
In the Foundation models & chat space, Llama 3.2 1B Instruct Unsloth Bnb takes a focused approach. It focuses on running a capable instruction-tuned language model efficiently on consumer hardware. Llama 3.2 1B Instruct Unsloth Bnb is an open-source project aimed at developers. The project is open source (Apache-2.0). Llama 3.2 1B Instruct Unsloth Bnb is available on the web, the command line, and API.
unsloth builds and maintains Llama 3.2 1B Instruct Unsloth Bnb, and the product first shipped in 2023. The project is developed in the open on GitHub with 68.7k stars and 1.2k commits in the last 90 days. PulseGate's similarity index places it among 15 comparable tools. Among its 3 catalogued features are Instruction Tuning, Quantized LLM, and Local Inference.
Latest indexed changes and source events
unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit verified by the PulseGate indexer
