This repository provides GGUF quantized versions of the Mistral-Nemo-Instruct-2407 model. It enables efficient local inference using tools such as llama.cpp. Multiple quantization levels are offered to balance performance and model size for different hardware configurations.
Mistral Nemo Instruct 2407 sits in PulseGate's Foundation models & chat category. It focuses on running the Mistral Nemo Instruct model efficiently on consumer hardware using quantized GGUF format. Mistral Nemo Instruct 2407 is an open-source project aimed at developers. Mistral Nemo Instruct 2407 is open source under the MIT license. Mistral Nemo Instruct 2407 is available on the web and the command line, and it can be self-hosted.
Behind Mistral Nemo Instruct 2407 is Maziyar Panahi, and it first shipped in 2023. Development happens publicly on GitHub with 121.2k stars and 1.2k commits in the last 90 days. Among its 3 catalogued features are Quantized GGUF, Local LLM, and Instruction Model. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do