This repository hosts GGUF quantized files for the DeepSeek-R1-Distill-Qwen-7B model. The 7-billion-parameter model is a distilled version focused on reasoning and tool-calling capabilities. Multiple quantization formats are provided so users can run it efficiently on consumer GPUs or CPUs using llama.cpp, Ollama, or similar local inference engines. It is popular among developers seeking a capable open reasoning model that fits on modest hardware.
In the Foundation models & chat space, DeepSeek R1 Distill Qwen 7B takes a focused approach. It focuses on running a distilled reasoning-capable 7B model locally with low resource requirements. It is built as an open-source project for developers. DeepSeek R1 Distill Qwen 7B is open source under the MIT license. DeepSeek R1 Distill Qwen 7B is available on the web and the command line, and it can be self-hosted.
It is developed by bartowski, and the product first shipped in 2023. Development happens publicly on GitHub with 121.3k stars and 1.2k commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 15 similar tools. Key capabilities include Quantized GGUF, reasoning model, and tool calling.
Latest indexed changes and source events
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF verified by the PulseGate indexer
Other apps tracked under the same category.
