Llama 3.2 1B Instruct Q4f16 1 MLC
A 1B parameter version of Meta's Llama 3.2 Instruct model, quantized to 4-bit and packaged for the MLC-LLM runtime. It enables high-performance local inference across GPUs, CPUs, and mobile devices. The model is distributed via Hugging Face and supports standard chat templates for conversational use.
Overview
3 featuresIn the Other AI space, Llama 3.2 1B Instruct Q4f16 1 MLC takes a focused approach. It focuses on running efficient quantized large language models on local devices and various hardware backends. It is built as an open-source project for developers. Llama 3.2 1B Instruct Q4f16 1 MLC is open source under the Apache-2.0 license. It runs on the web, the command line, and API, and it can be self-hosted.
MLC AI builds and maintains Llama 3.2 1B Instruct Q4f16 1 MLC, and it first shipped in 2023. Development happens publicly on GitHub with 23k stars and 6 commits in the last 90 days. PulseGate's similarity index places it among 6 comparable projects. Among its 3 catalogued features are Quantized Weights, MLC Runtime, and Instruct Tuned.
Summary written by a language model from the project’s public pages.
- Quantized Weights
- MLC Runtime
- Instruct Tuned
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 19:44 UTCmlc-ai/Llama-3.2-1B-Instruct-q4f16_1-MLC verified via Hugging Face EnumeratorSource: Hugging Face Enumerator · Open
Frequently asked questions about Llama 3.2 1B Instruct Q4f16 1 MLC
- What does Llama 3.2 1B Instruct Q4f16 1 MLC do?
- Llama 3.2 1B Instruct Q4f16 1 MLC focuses on running efficient quantized large language models on local devices and various hardware backends. It is catalogued under Other AI on PulseGate.
- Who is Llama 3.2 1B Instruct Q4f16 1 MLC for?
- Llama 3.2 1B Instruct Q4f16 1 MLC is an open-source project built for developers.
- Is Llama 3.2 1B Instruct Q4f16 1 MLC free?
- Yes — Llama 3.2 1B Instruct Q4f16 1 MLC is open source under the Apache-2.0 license and free to use.
- What platforms does Llama 3.2 1B Instruct Q4f16 1 MLC run on?
- Llama 3.2 1B Instruct Q4f16 1 MLC runs on the web, the command line, and API. It can also be self-hosted.
- Is Llama 3.2 1B Instruct Q4f16 1 MLC still active?
- The GitHub repository shows 6 commits in the last 90 days.
- What projects are similar to Llama 3.2 1B Instruct Q4f16 1 MLC?
- Similar projects tracked by PulseGate include Llama 3.2 1B Instruct Q4 K M, Llama 3.2 1B Instruct, and Llama 3.1 8B Instruct.Llama 3.2 1B Instruct Q4 K MLlama 3.2 1B InstructLlama 3.1 8B Instruct
- Who develops Llama 3.2 1B Instruct Q4f16 1 MLC?
- Llama 3.2 1B Instruct Q4f16 1 MLC is developed by MLC AI.
- How long has Llama 3.2 1B Instruct Q4f16 1 MLC been around?
- Llama 3.2 1B Instruct Q4f16 1 MLC first shipped in 2023.
Similar projects
Closest matches by what these projects do