Meta Llama 3.1 8B Instruct FP8 Dynamic
An FP8 dynamically quantized version of Meta's Llama 3.1 8B Instruct model created by RedHatAI. It maintains high performance while significantly reducing memory footprint for local or self-hosted inference. The model supports standard chat templates and is optimized for efficient deployment.
Overview
3 featuresMeta Llama 3.1 8B Instruct FP8 Dynamic is a Text generation project. It focuses on running the Llama 3.1 8B Instruct model with reduced memory and compute requirements via quantization. It is built as an open-source project for developers. The project is open source (Apache-2.0). Meta Llama 3.1 8B Instruct FP8 Dynamic is available on the web and the command line, and it can be self-hosted.
It is developed by RedHatAI, and it first shipped in 2019. The project is developed in the open on GitHub with 3.6k stars and 167 commits in the last 90 days. Among its 3 catalogued features are Quantized Model, Instruction Tuned, and Dynamic FP8. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
- Quantized Model
- Instruction Tuned
- Dynamic FP8
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · text-generation- in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed19 Jul · 20:53 UTCRedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Meta Llama 3.1 8B Instruct FP8 Dynamic
- What is Meta Llama 3.1 8B Instruct FP8 Dynamic?
- Meta Llama 3.1 8B Instruct FP8 Dynamic focuses on running the Llama 3.1 8B Instruct model with reduced memory and compute requirements via quantization. It is catalogued under Text generation on PulseGate.
- Who should use Meta Llama 3.1 8B Instruct FP8 Dynamic?
- Meta Llama 3.1 8B Instruct FP8 Dynamic is an open-source project built for developers.
- Does Meta Llama 3.1 8B Instruct FP8 Dynamic have a free plan?
- Yes — Meta Llama 3.1 8B Instruct FP8 Dynamic is open source under the Apache-2.0 license and free to use.
- What platforms does Meta Llama 3.1 8B Instruct FP8 Dynamic run on?
- Meta Llama 3.1 8B Instruct FP8 Dynamic runs on the web and the command line. It can also be self-hosted.
- Is Meta Llama 3.1 8B Instruct FP8 Dynamic still active?
- The GitHub repository shows 167 commits in the last 90 days.
- What projects are similar to Meta Llama 3.1 8B Instruct FP8 Dynamic?
- Similar projects tracked by PulseGate include Meta Llama 3.1 8B Instruct, Meta Llama 3.1 70B Instruct, and Llama 3.3 70B Instruct FP8 Dynamic.Meta Llama 3.1 8B InstructMeta Llama 3.1 70B InstructLlama 3.3 70B Instruct FP8 Dynamic
- Who makes Meta Llama 3.1 8B Instruct FP8 Dynamic?
- Meta Llama 3.1 8B Instruct FP8 Dynamic is developed by RedHatAI.
- When did Meta Llama 3.1 8B Instruct FP8 Dynamic launch?
- Meta Llama 3.1 8B Instruct FP8 Dynamic first shipped in 2019.
Similar projects
Closest matches by what these projects do