This repository contains GGUF quantized files for DeepSeek-V3 (March 2024 release), a powerful open-source large language model. The various quantization levels allow the model to run efficiently on consumer hardware using tools such as llama.cpp. It supports advanced features including tool calling and is suitable for local chat, coding, and reasoning applications.
In the Foundation models & chat space, DeepSeek V3 0324 takes a focused approach. It focuses on running the powerful DeepSeek-V3 model locally with reduced hardware requirements through quantization. DeepSeek V3 0324 is an open-source project aimed at AI developers and researchers. DeepSeek V3 0324 is open source under the MIT license. DeepSeek V3 0324 is available on the web, the command line, and API.
Behind DeepSeek V3 0324 is Maziyar Panahi, and it first shipped in 2023. Development happens publicly on GitHub with 122.5k stars and 1.2k commits in the last 90 days. Key capabilities include Large Language Model, Quantized GGUF, and Tool Calling.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do