Llama 3 8b Instruct
This is an AWQ (Activation-aware Weight Quantization) 4-bit quantized version of Meta's Llama 3 8B Instruct model, hosted on Hugging Face. It enables efficient local or server-based inference with significantly lower memory usage while preserving most of the original model's performance. The model includes a chat template and is compatible with popular inference engines like vLLM and Hugging Face Transformers. It is intended for developers building local AI applications or optimizing LLM deployment.
Open SourceWebCLIAPI
7alternatives
3features
2024since
Overview
3 featuresLlama 3 8b Instruct is a Foundation models & chat project. It focuses on running large language models efficiently on consumer or edge hardware with reduced memory and compute requirements. Llama 3 8b Instruct is an open-source project aimed at developers. Llama 3 8b Instruct is open source under the Open Source license. It ships for the web, the command line, and API.
Behind Llama 3 8b Instruct is casperhansen, and it first shipped in 2024. PulseGate's similarity index places it among 7 comparable projects. Key capabilities include quantized weights, chat template, and speculative decoding.
Summary written by a language model from the project’s public pages.
- Quantized weights
- Chat template
- Speculative decoding
Tags
awq-quantizedllama-3instruct-model4bit-quantizationvllm-compatible
AI capabilities
Text
Inference: LocalWeights: Open
Built with & integrations
Hosting
AWS
AI providers
local_ossmeta_llama
Runs on
BrowserCLIAPI-only
Detected from
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · text-generation- in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
License
Open Source
Verified signals
Indexing history
1What PulseGate has recorded for this listing
- Indexed1 Aug · 13:21 UTCcasperhansen/llama-3-8b-instruct-awq verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Llama 3 8b Instruct
- What does Llama 3 8b Instruct do?
- Llama 3 8b Instruct focuses on running large language models efficiently on consumer or edge hardware with reduced memory and compute requirements. It is catalogued under Foundation models & chat on PulseGate.
- Who should use Llama 3 8b Instruct?
- Llama 3 8b Instruct is an open-source project built for developers.
- Is Llama 3 8b Instruct free?
- Yes — Llama 3 8b Instruct is open source under the Open Source license and free to use.
- What platforms does Llama 3 8b Instruct run on?
- Llama 3 8b Instruct runs on the web, the command line, and API.
- Is Llama 3 8b Instruct still maintained?
- Unverified. Llama 3 8b Instruct has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What are alternatives to Llama 3 8b Instruct?
- Similar projects tracked by PulseGate include Llama 3.3 70b Instruct, Llama 3 70b Instruct, and Meta Llama 3.1 70B Instruct.Llama 3.3 70b InstructLlama 3 70b InstructMeta Llama 3.1 70B Instruct
- Who develops Llama 3 8b Instruct?
- Llama 3 8b Instruct is developed by casperhansen.
- How long has Llama 3 8b Instruct been around?
- Llama 3 8b Instruct first shipped in 2024.
Similar apps
Closest matches by what these projects do