This Hugging Face repository hosts GGUF quantized versions of Mistral-7B-Instruct-v0.3. It enables efficient local execution of the 7-billion parameter instruction-tuned language model using tools like llama.cpp or Ollama. Multiple quantization levels are provided to balance performance and resource usage on CPUs and GPUs.
In the Foundation models & chat space, Mistral 7B Instruct takes a focused approach. It focuses on running the Mistral 7B Instruct model efficiently on consumer hardware without cloud dependency. Mistral 7B Instruct is an open-source project aimed at developers. The project is open source (MIT). Mistral 7B Instruct is available on the web and the command line.
Maziyar Panahi builds and maintains Mistral 7B Instruct, and the product first shipped in 2023. The project is developed in the open on GitHub with 121.1k stars and 1.2k commits in the last 90 days. PulseGate's similarity index places it among 9 comparable tools. Among its 4 catalogued features are GGUF quantization, instruction-tuned, and multiple precision levels.
Latest indexed changes and source events
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF verified by the PulseGate indexer
Other apps tracked under the same category.
