This Hugging Face repository hosts GGUF quantized versions of Mistral-7B-Instruct-v0.3. It enables efficient local execution of the 7-billion parameter instruction-tuned language model using tools like llama.cpp or Ollama. Multiple quantization levels are provided to balance performance and resource usage on CPUs and GPUs.
Mistral 7B Instruct sits in PulseGate's Text generation category. It focuses on running the Mistral 7B Instruct model efficiently on consumer hardware without cloud dependency. Mistral 7B Instruct is an open-source project aimed at developers. Mistral 7B Instruct is open source under the MIT license. It ships for the web and the command line.
Behind Mistral 7B Instruct is Maziyar Panahi, and it first shipped in 2023. The project is developed in the open on GitHub with 121.1k stars and 1.2k commits in the last 90 days. PulseGate's similarity index places it among 9 comparable projects. Key capabilities include GGUF quantization, instruction-tuned, and multiple precision levels.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do