This repo hosts GGUF quantized files for the Gemma-3-12b-it model. It includes various quantization formats to balance quality and size. The model supports instruction following and can be run with popular local inference engines.
In the Foundation models & chat space, Gemma 3 12b It takes a focused approach. It focuses on deploying the Gemma 3 12B model locally with reduced memory requirements through quantization. It is built as an open-source project for developers. The project is open source (MIT). It ships for the web, the command line, and API.
It is developed by MaziyarPanahi, and it first shipped in 2023. The project is developed in the open on GitHub with 122.3k stars and 1.2k commits in the last 90 days. It competes in a saturated segment with 23 similar apps in PulseGate's index. Among its 3 catalogued features are Quantized Models, Multimodal Support, and GGUF Format.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do