This GGUF version of Gemma-4-12B-Instruct has been optimized using Quantization-Aware Training (QAT). It is designed for high-quality local inference with reduced memory requirements while maintaining strong instruction-following performance. Popular in the LM Studio community for offline chatbot and assistant use cases.
In the Quantised & converted weights space, Gemma 4 12B It QAT takes a focused approach. Efficiently running the Gemma 4 instruct model on consumer hardware using quantized weights. Gemma 4 12B It QAT is an open-source project aimed at local LLM users and developers. The project is open source (MIT). It ships for the web, the command line, and API.
LM Studio Community builds and maintains Gemma 4 12B It QAT, and it first shipped in 2023. Development happens publicly on GitHub with 121.2k stars and 1.2k commits in the last 90 days. It competes in a saturated segment with 25 similar projects in PulseGate's index. Key capabilities include Instruction Tuned, Quantized Inference, and Chat Format. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do