An AWQ-quantized version of the Ministral-8B-Instruct-2410 model published on Hugging Face. It includes a chat template for conversational use and is designed for efficient local inference. The model is suitable for developers seeking a smaller, quantized instruction-following LLM that balances performance and resource requirements.
Ministral 8B Instruct 2410 is a Text generation project. It focuses on running a capable 8B instruction-tuned model efficiently on consumer hardware with reduced memory usage via AWQ quantization. Ministral 8B Instruct 2410 is an open-source project aimed at machine learning developers. The project is open source (Open Source). It ships for the web and API.
It is developed by PyrTools, and it first shipped in 2024. Among its 3 catalogued features are Instruction Tuning, Quantized Model, and Chat Template.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do