Mistral 7B Instruct
This is a quantized version of Mistral-7B-Instruct-v0.2 using the AWQ method to 4-bit precision. It enables efficient local inference of the instruction-tuned Mistral model on consumer hardware with reduced VRAM usage while maintaining high performance. The model is hosted on Hugging Face and can be used with the Transformers library or compatible inference engines.
Overview
3 featuresMistral 7B Instruct is a Text generation project. It focuses on running large language models with reduced memory and compute requirements on local hardware. Mistral 7B Instruct is an open-source project aimed at developers. Mistral 7B Instruct is open source under the AGPL-3.0 license. It runs on the web, the command line, and API.
It is developed by TheBloke, and it first shipped in 2022. The project is developed in the open on GitHub with 47.5k stars and 140 commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 6 similar projects. Among its 3 catalogued features are 4-bit Quantization, Instruction Tuned, and Mistral Architecture.
Summary written by a language model from the project’s public pages.
- 4-bit Quantization
- Instruction Tuned
- Mistral Architecture
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · text-generation- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 17:09 UTCTheBloke/Mistral-7B-Instruct-v0.2-AWQ verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Mistral 7B Instruct
- What does Mistral 7B Instruct do?
- Mistral 7B Instruct focuses on running large language models with reduced memory and compute requirements on local hardware. It is catalogued under Text generation on PulseGate.
- Who is Mistral 7B Instruct for?
- Mistral 7B Instruct is an open-source project built for developers.
- Does Mistral 7B Instruct have a free plan?
- Yes — Mistral 7B Instruct is open source under the AGPL-3.0 license and free to use.
- What platforms does Mistral 7B Instruct run on?
- Mistral 7B Instruct runs on the web, the command line, and API.
- Is Mistral 7B Instruct still maintained?
- The GitHub repository shows 140 commits in the last 90 days.
- What projects are similar to Mistral 7B Instruct?
- Similar projects tracked by PulseGate include Mistral 7B Instruct, Mistral Small 24B Instruct 2501, and Mistral 7B Instruct.Mistral 7B InstructMistral Small 24B Instruct 2501Mistral 7B Instruct
- Who develops Mistral 7B Instruct?
- Mistral 7B Instruct is developed by TheBloke.
- When did Mistral 7B Instruct launch?
- Mistral 7B Instruct first shipped in 2022.
Similar projects
Closest matches by what these projects do