Meta Llama 3.1 8B Instruct Quantized.w4a16
This repository contains an INT4 (w4a16) quantized version of Meta's Llama-3.1-8B-Instruct model. It enables efficient inference on hardware with limited resources while preserving most of the original model's instruction-following capabilities. The model is distributed for use with Transformers and compatible inference engines.
Overview
2 featuresMeta Llama 3.1 8B Instruct Quantized.w4a16 is a Text generation project. It focuses on deploying the Llama 3.1 8B Instruct model with significantly reduced memory footprint for local or on-premise use. Meta Llama 3.1 8B Instruct Quantized.w4a16 is an open-source project aimed at developers and enterprises. The project is open source (MIT). It runs on the web, the command line, and API.
Behind Meta Llama 3.1 8B Instruct Quantized.w4a16 is RedHatAI, and it first shipped in 2023. The GitHub repository has been archived. PulseGate's similarity index places it among 10 comparable projects.
Summary written by a language model from the project’s public pages.
- Quantized Model
- Instruction Tuned
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · text-generation- in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 13:38 UTCRedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Meta Llama 3.1 8B Instruct Quantized.w4a16
- What does Meta Llama 3.1 8B Instruct Quantized.w4a16 do?
- Meta Llama 3.1 8B Instruct Quantized.w4a16 focuses on deploying the Llama 3.1 8B Instruct model with significantly reduced memory footprint for local or on-premise use. It is catalogued under Text generation on PulseGate.
- Who should use Meta Llama 3.1 8B Instruct Quantized.w4a16?
- Meta Llama 3.1 8B Instruct Quantized.w4a16 is an open-source project built for developers and enterprises.
- Is Meta Llama 3.1 8B Instruct Quantized.w4a16 free?
- Yes — Meta Llama 3.1 8B Instruct Quantized.w4a16 is open source under the MIT license and free to use.
- What platforms does Meta Llama 3.1 8B Instruct Quantized.w4a16 run on?
- Meta Llama 3.1 8B Instruct Quantized.w4a16 runs on the web, the command line, and API.
- Is Meta Llama 3.1 8B Instruct Quantized.w4a16 still active?
- Unverified. Meta Llama 3.1 8B Instruct Quantized.w4a16 has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What projects are similar to Meta Llama 3.1 8B Instruct Quantized.w4a16?
- Similar projects tracked by PulseGate include Meta Llama 3.1 70B Instruct Quantized.w4a16, Meta Llama 3.1 70B Instruct, and Meta Llama 3.3 70B Instruct.Meta Llama 3.1 70B Instruct Quantized.w4a16Meta Llama 3.1 70B InstructMeta Llama 3.3 70B Instruct
- Who develops Meta Llama 3.1 8B Instruct Quantized.w4a16?
- Meta Llama 3.1 8B Instruct Quantized.w4a16 is developed by RedHatAI.
- How long has Meta Llama 3.1 8B Instruct Quantized.w4a16 been around?
- Meta Llama 3.1 8B Instruct Quantized.w4a16 first shipped in 2023.
Similar projects
Closest matches by what these projects do