VibeThinker-3B-Q4_K_M-GGUF is a quantized version of the VibeThinker 3B language model distributed in GGUF format. It includes support for tool calling and is suitable for local inference on consumer hardware. The model follows a standard chat template and can be used with popular GGUF runtimes for on-device or server-based AI applications.
VibeThinker 3B Q4 K M is a Foundation models & chat project. It focuses on running compact 3B parameter language models locally with efficient quantization. VibeThinker 3B Q4 K M is an open-source project aimed at developers and local AI enthusiasts. The project is open source (MIT). It ships for the web, the command line, and API.
It is developed by semparuthiveeran, and it first shipped in 2023. Development happens publicly on GitHub with 121k stars and 1.2k commits in the last 90 days.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do