DeepSeek R1 Distill Qwen 7B Alternatives

A GGUF-quantized version of a distilled 70B Llama model based on DeepSeek-R1. Optimized for local inference with support for tool calling and reasoning. It is designed for efficient execution using llama.cpp or similar runtimes on CPUs or GPUs.

This is a distilled and AWQ-quantized 32B parameter model derived from DeepSeek R1 and Qwen architectures. It is optimized for lower memory usage while retaining strong reasoning and instruction-following capabilities.

DeepSeek-R1-Distill-Qwen-14B is a 14-billion parameter language model created by distilling reasoning capabilities from the DeepSeek-R1 series into the Qwen architecture. It is provided as open weights on Hugging Face for local or hosted inference using standard Transformers pipelines. The model supports chat-based interactions and is intended for developers building reasoning, coding, or agentic applications.

This GGUF-quantized model is a community conversion of DeepSeek-R1-0528 based on the Qwen3 8B architecture. It is optimized for local inference using tools such as LM Studio or llama.cpp. The model supports advanced features including structured tool calling and chain-of-thought reasoning while running efficiently on modest hardware.

This model is an 8-bit quantized version of DeepSeek-R1-0528 based on the Qwen3 8B architecture, optimized for the MLX framework used on Apple Silicon. It includes a custom chat template and is distributed by the lmstudio-community on Hugging Face for local inference.

This is a distilled 8B parameter model from the DeepSeek-R1 series, based on the Llama architecture. It retains strong reasoning and problem-solving abilities from the larger teacher model while being significantly more efficient. The model is suitable for local inference, coding assistance, and complex reasoning tasks.

This is a quantized and distilled version of the DeepSeek-R1 reasoning model based on Llama architecture. It is hosted on Hugging Face for download and local inference using libraries such as transformers or llama.cpp. The model supports advanced features including tool calling and is optimized for on-device or local deployment with significantly reduced memory footprint while retaining strong reasoning capabilities.

DeepSeek-R1-0528-Qwen3-8B is a large open-source language model designed for advanced text generation and understanding. It is suitable for developers and researchers seeking a robust model for NLP applications, with support for local deployment and Docker integration.

bartowski's DeepSeek-V4-Flash-GGUF is a quantized GGUF distribution of the DeepSeek-V4-Flash model optimized for local use with tools like llama.cpp. It supports advanced reasoning, tool calling, and thinking modes. The model is hosted on Hugging Face for easy download and local deployment.

QuantTrio/DeepSeek-V3.2-AWQ is a quantized (AWQ) version of DeepSeek's V3.2 large language model. It includes a custom chat template and tokenizer optimized for efficient inference. The model is suitable for local deployment where full-precision weights would be too large.

This is a GGUF-quantized version of a Qwen3.5-9B model merged with DeepSeek capabilities, optimized for local inference. It includes support for tool calling and function execution. The model is designed for developers building local AI agents or applications that require structured output and external tool integration.

DeepSeek-V4-Flash-GGUF provides GGUF quantized files for the DeepSeek-V4 model optimized for fast inference. It includes advanced reasoning capabilities with explicit thinking tokens and tool-calling support. The model is distributed by Unsloth and is intended for local or self-hosted use with GGUF-compatible inference engines.