This repository provides GGUF quantized versions of the Mistral-Nemo-Instruct-2407 model. It enables efficient local inference using tools such as llama.cpp. Multiple quantization levels are offered to balance performance and model size for different hardware configurations.
Mistral Nemo Instruct 2407 sits in PulseGate's Foundation models & chat category. It focuses on running the Mistral Nemo Instruct model efficiently on consumer hardware using quantized GGUF format. It is built as an open-source project for developers. Mistral Nemo Instruct 2407 is open source under the MIT license. It runs on the web and the command line, and it can be self-hosted.
Behind Mistral Nemo Instruct 2407 is Maziyar Panahi, and the product first shipped in 2023. Development happens publicly on GitHub with 121.2k stars and 1.2k commits in the last 90 days. Key capabilities include Quantized GGUF, Local LLM, and Instruction Model. It exposes integrations via a public API.
Latest indexed changes and source events
MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF verified by the PulseGate indexer
Other apps tracked under the same category.
