Mistral Small 24B Instruct 2501
This repository hosts GGUF quantized files for the Mistral-Small-24B-Instruct-2501 model. It offers various quantization formats (Q2_K to Q8_0 and FP16) enabling efficient local inference of this 24-billion-parameter instruction-tuned model. Targeted at developers and AI practitioners who prefer running capable open models on their own hardware or in self-hosted setups without relying on paid cloud APIs.
Open SourceMITWebCLISelf-hosted
122.1kstars
21.1kforks
11alternatives
4features
2023since
Overview
4 featuresIn the Foundation models & chat space, Mistral Small 24B Instruct 2501 takes a focused approach. It focuses on running the 24B-parameter Mistral Small Instruct model locally with manageable hardware requirements. It is built as an open-source project for developers. The project is open source (MIT). It runs on the web and the command line, and it can be self-hosted.
It is developed by MaziyarPanahi, and it first shipped in 2023. Development happens publicly on GitHub with 122.1k stars and 1.2k commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 11 similar projects. Key capabilities include GGUF Quantization, Instruct Model, and Multiple Quant Levels.
Summary written by a language model from the project’s public pages.
- GGUF Quantization
- Instruct Model
- Multiple Quant Levels
- Local Execution
Tags
gguf-modelmistral-smallquantized-llmlocal-inference24b-model
AI capabilities
Text
Inference: LocalWeights: Open
Built with & integrations
Hosting
AWS
AI providers
local_ossmultiple
Runs on
BrowserCLISelf-hosted
Detected from
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- multiple
- bLangChain in the HTML
- local_oss
- bollama in the HTML · bllama in the HTML · bvllm in the HTML
Trust & compliance
License
MIT
Verified signals
Indexing history
1What PulseGate has recorded for this listing
- Indexed30 Jul · 08:46 UTCMaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Mistral Small 24B Instruct 2501
- What does Mistral Small 24B Instruct 2501 do?
- Mistral Small 24B Instruct 2501 focuses on running the 24B-parameter Mistral Small Instruct model locally with manageable hardware requirements. It is catalogued under Foundation models & chat on PulseGate.
- Who is Mistral Small 24B Instruct 2501 for?
- Mistral Small 24B Instruct 2501 is an open-source project built for developers.
- Is Mistral Small 24B Instruct 2501 free?
- Yes — Mistral Small 24B Instruct 2501 is open source under the MIT license and free to use.
- What platforms does Mistral Small 24B Instruct 2501 run on?
- Mistral Small 24B Instruct 2501 runs on the web and the command line. It can also be self-hosted.
- Is Mistral Small 24B Instruct 2501 still active?
- The GitHub repository shows 1.2k commits in the last 90 days.
- What are alternatives to Mistral Small 24B Instruct 2501?
- Similar projects tracked by PulseGate include Mistral Small Instruct 2409, Mistral Small 3.1 24b Instruct 2503 Hf, and Mistral Large Instruct 2411.Mistral Small Instruct 2409Mistral Small 3.1 24b Instruct 2503 HfMistral Large Instruct 2411
- Who develops Mistral Small 24B Instruct 2501?
- Mistral Small 24B Instruct 2501 is developed by MaziyarPanahi.
- When did Mistral Small 24B Instruct 2501 launch?
- Mistral Small 24B Instruct 2501 first shipped in 2023.
Similar apps
Closest matches by what these projects do