This is a GGUF-quantized version of the Gemma-4 12B instruction-tuned (it) model, created by Unsloth using Quantization-Aware Training. It enables efficient local execution of a powerful 12B parameter model using tools such as llama.cpp. The model is intended for developers seeking high-performance open models that can run on standard hardware.
Gemma 4 12B It Qat is a Foundation models & chat project. It focuses on running efficient, quantized versions of large instruction-tuned models on consumer hardware. It is built as an open-source project for developers. The project is open source (Apache-2.0). It runs on the web, the command line, and API.
It is developed by Unsloth, and it first shipped in 2023. Development happens publicly on GitHub with 68.7k stars and 1.2k commits in the last 90 days. The category is crowded — PulseGate's index counts 25 comparable projects. Key capabilities include Quantized GGUF format, instruction tuning, and Local LLM inference.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do