Gemma 2 9b It
This repository hosts an AWQ (Activation-aware Weight Quantization) INT4 quantized variant of Google's Gemma-2-9B-IT model. It enables efficient local inference of a capable 9-billion-parameter instruction-tuned LLM on hardware with limited VRAM. The model is distributed via Hugging Face and is compatible with transformers and vLLM inference backends.
Overview
3 featuresIn the Foundation models & chat space, Gemma 2 9b It takes a focused approach. It focuses on running large language models efficiently on consumer or edge hardware with reduced memory usage. Gemma 2 9b It is an open-source project aimed at AI developers. The project is open source (MIT). It runs on the command line and API.
hugging-quants builds and maintains Gemma 2 9b It, and it first shipped in 2023. The GitHub repository has been archived. It operates in a well-populated space: PulseGate tracks 14 similar projects. Among its 3 catalogued features are Instruction Tuned, AWQ Quantized, and INT4 Precision.
Summary written by a language model from the project’s public pages.
- Instruction Tuned
- AWQ Quantized
- INT4 Precision
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- openai
- bopenai/openai-node in the HTML
- local_oss
- bvllm in the HTML · text-generation- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 13:08 UTChugging-quants/gemma-2-9b-it-AWQ-INT4 verified via Hugging Face EnumeratorSource: Hugging Face Enumerator · Open
Frequently asked questions about Gemma 2 9b It
- What is Gemma 2 9b It?
- Gemma 2 9b It focuses on running large language models efficiently on consumer or edge hardware with reduced memory usage. It is catalogued under Foundation models & chat on PulseGate.
- Who is Gemma 2 9b It for?
- Gemma 2 9b It is an open-source project built for AI developers.
- Is Gemma 2 9b It free?
- Yes — Gemma 2 9b It is open source under the MIT license and free to use.
- What platforms does Gemma 2 9b It run on?
- Gemma 2 9b It runs on the command line and API.
- Is Gemma 2 9b It still maintained?
- Unverified. Gemma 2 9b It has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What are alternatives to Gemma 2 9b It?
- Similar projects tracked by PulseGate include Distilbert Base Uncased, Qwen3 VL 2B Instruct, and Unlimited OCR.Distilbert Base UncasedQwen3 VL 2B InstructUnlimited OCR
- Who develops Gemma 2 9b It?
- Gemma 2 9b It is developed by hugging-quants.
- When did Gemma 2 9b It launch?
- Gemma 2 9b It first shipped in 2023.
Also in Foundation models & chat
Same category — not a similarity match