This is an optimized 4-bit quantized version of the Llama 3.2 1B Instruct model created by Unsloth. It is designed for efficient local inference while maintaining strong instruction-following capabilities. The model is available on Hugging Face and works with popular LLM runtimes and fine-tuning tools.
Llama 3.2 1B Instruct Unsloth Bnb sits in PulseGate's Text generation category. It focuses on running a capable instruction-tuned language model efficiently on consumer hardware. It is built as an open-source project for developers. Llama 3.2 1B Instruct Unsloth Bnb is open source under the Apache-2.0 license. It ships for the web, the command line, and API.
Behind Llama 3.2 1B Instruct Unsloth Bnb is unsloth, and it first shipped in 2023. Development happens publicly on GitHub with 68.7k stars and 1.2k commits in the last 90 days. PulseGate's similarity index places it among 15 comparable projects. Among its 3 catalogued features are Instruction Tuning, Quantized LLM, and Local Inference.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do