This Hugging Face repository hosts GGUF quantized versions of the Qwen2.5-7B-Instruct model created by Alibaba Cloud. The files are optimized for efficient local inference using tools such as llama.cpp, LM Studio, or Ollama. It includes chat templates and function calling support. The model is suitable for developers who want to run a strong open-source instruction-tuned LLM on consumer hardware without relying on cloud APIs.
In the Foundation models & chat space, Qwen2.5 7B Instruct takes a focused approach. It focuses on running a capable 7B parameter language model locally with reduced memory and hardware requirements. Qwen2.5 7B Instruct is an open-source project aimed at developers and AI enthusiasts. The project is open source (MIT). The product ships for the command line.
It is developed by MaziyarPanahi, and the product first shipped in 2023. The project is developed in the open on GitHub with 121.2k stars and 1.2k commits in the last 90 days. It competes in a saturated segment with 25 similar apps in PulseGate's index. Among its 3 catalogued features are Quantized Weights, Instruct Model, and GGUF Format.
Latest indexed changes and source events
MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF verified by the PulseGate indexer
Other apps tracked under the same category.
