A GGUF-quantized version of Alibaba's Qwen2.5-7B-Instruct model. It is optimized for local inference using tools such as llama.cpp or LM Studio. The model supports instruction following and general chat capabilities while running efficiently on consumer hardware.
Qwen2.5 7B Instruct is a Foundation models & chat product. It focuses on running a capable 7B instruct model locally with GGUF quantization for reduced resource usage. It is built as an open-source project for developers. Qwen2.5 7B Instruct is open source under the MIT license. Qwen2.5 7B Instruct is available on the web, the command line, and API.
It is developed by bartowski, and the product first shipped in 2023. Development happens publicly on GitHub with 121.2k stars and 1.2k commits in the last 90 days. The category is crowded — PulseGate's index counts 25 comparable apps. Key capabilities include Large Language Model, GGUF Quantization, and Instruction Tuned.
Latest indexed changes and source events
bartowski/Qwen2.5-7B-Instruct-GGUF verified by the PulseGate indexer
Other apps tracked under the same category.
