An AWQ-quantized version of the Ministral-8B-Instruct-2410 model published on Hugging Face. It includes a chat template for conversational use and is designed for efficient local inference. The model is suitable for developers seeking a smaller, quantized instruction-following LLM that balances performance and resource requirements.
Ministral 8B Instruct 2410 sits in PulseGate's Foundation models & chat category. It focuses on running a capable 8B instruction-tuned model efficiently on consumer hardware with reduced memory usage via AWQ quantization. Ministral 8B Instruct 2410 is an open-source project aimed at machine learning developers. The project is open source (Open Source). It runs on the web and API.
It is developed by PyrTools, and the product first shipped in 2024. Among its 3 catalogued features are Instruction Tuning, Quantized Model, and Chat Template.
Latest indexed changes and source events
PyrTools/Ministral-8B-Instruct-2410-AWQ verified by the PulseGate indexer
Other apps tracked under the same category.
