This is a 4-bit quantized version of the Qwen2.5-3B-Instruct model created by Unsloth. It enables efficient local inference of a capable instruction-tuned LLM. The model is suitable for developers seeking to deploy language models with reduced memory requirements while maintaining strong performance.
Qwen2.5 3B Instruct Bnb is a Foundation models & chat product. It focuses on running large language models efficiently on consumer hardware with minimal performance loss. Qwen2.5 3B Instruct Bnb is an open-source project aimed at developers. The project is open source (Apache-2.0). It runs on the web, the command line, and API.
Behind Qwen2.5 3B Instruct Bnb is unsloth, and the product first shipped in 2023. The project is developed in the open on GitHub with 68.7k stars and 1.2k commits in the last 90 days. It competes in a saturated segment with 25 similar apps in PulseGate's index. Among its 3 catalogued features are Quantized Model, Instruction Tuning, and Efficient Inference.
Latest indexed changes and source events
unsloth/Qwen2.5-3B-Instruct-bnb-4bit verified by the PulseGate indexer
Other apps tracked under the same category.
