A GGUF-quantized version of a distilled 70B Llama model based on DeepSeek-R1. Optimized for local inference with support for tool calling and reasoning. It is designed for efficient execution using llama.cpp or similar runtimes on CPUs or GPUs.
In the Foundation models & chat space, DeepSeek R1 Distill Llama 70B takes a focused approach. It focuses on running a high-performance distilled reasoning model efficiently on consumer hardware. DeepSeek R1 Distill Llama 70B is an open-source project aimed at developers. The project is open source (MIT). The product ships for the command line.
It is developed by bartowski, and the product first shipped in 2023. The project is developed in the open on GitHub with 121k stars and 1.2k commits in the last 90 days. PulseGate's similarity index places it among 10 comparable tools. Among its 3 catalogued features are GGUF Format, Quantized Weights, and Tool Calling. It exposes integrations via a public API.
Latest indexed changes and source events
bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF verified by the PulseGate indexer
Other apps tracked under the same category.
