mistral-7b-v0.3-bnb-4bit is a quantized 4-bit version of the Mistral-7B-v0.3 model created by Unsloth. It enables fast text generation on GPUs with limited memory while maintaining good performance. The model is distributed on Hugging Face and is popular for local LLM experimentation and deployment.
In the Foundation models & chat space, Mistral 7b V0.3 Bnb takes a focused approach. It focuses on running the Mistral 7B model with drastically reduced memory requirements on consumer hardware. Mistral 7b V0.3 Bnb is an open-source project aimed at developers. The project is open source (Apache-2.0). The product ships for the web, the command line, and API.
It is developed by Unsloth, and the product first shipped in 2023. The project is developed in the open on GitHub with 68.4k stars and 1.2k commits in the last 90 days. Among its 3 catalogued features are Quantized LLM, Text Generation, and Efficient Inference.
Latest indexed changes and source events
unsloth/mistral-7b-v0.3-bnb-4bit verified by the PulseGate indexer
Other apps tracked under the same category.
