Llama 3.1 8B Instruct
Llama-3.1-8B-Instruct-FP8 is an FP8 quantized version of Meta's Llama 3.1 8B instruct model, optimized by NVIDIA for high-performance inference. It maintains strong instruction-following capabilities while benefiting from reduced memory bandwidth and faster execution on compatible NVIDIA GPUs. The model is hosted on Hugging Face and is intended for developers building efficient LLM-powered applications.
Overview
3 featuresIn the Foundation models & chat space, Llama 3.1 8B Instruct takes a focused approach. It focuses on running Llama 3.1 efficiently using reduced-precision FP8 format on NVIDIA hardware. Llama 3.1 8B Instruct is an open-source project aimed at developers. The project is open source (Apache-2.0). It runs on the web, the command line, and API.
NVIDIA builds and maintains Llama 3.1 8B Instruct, and it first shipped in 2024. Development happens publicly on GitHub with 3.3k stars and 355 commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 8 similar projects. Key capabilities include FP8 precision, optimized inference, and instruction tuning.
Summary written by a language model from the project’s public pages.
- FP8 precision
- Optimized inference
- Instruction tuning
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · text-generation- in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 10:52 UTCnvidia/Llama-3.1-8B-Instruct-FP8 verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Llama 3.1 8B Instruct
- What is Llama 3.1 8B Instruct?
- Llama 3.1 8B Instruct focuses on running Llama 3.1 efficiently using reduced-precision FP8 format on NVIDIA hardware. It is catalogued under Foundation models & chat on PulseGate.
- Who should use Llama 3.1 8B Instruct?
- Llama 3.1 8B Instruct is an open-source project built for developers.
- Is Llama 3.1 8B Instruct free?
- Yes — Llama 3.1 8B Instruct is open source under the Apache-2.0 license and free to use.
- What platforms does Llama 3.1 8B Instruct run on?
- Llama 3.1 8B Instruct runs on the web, the command line, and API.
- Is Llama 3.1 8B Instruct still maintained?
- The GitHub repository shows 355 commits in the last 90 days.
- What projects are similar to Llama 3.1 8B Instruct?
- Similar projects tracked by PulseGate include Llama 3.3 70B Instruct, Llama 3.1 8B Instruct, and Llama 3.1 70B Instruct.Llama 3.3 70B InstructLlama 3.1 8B InstructLlama 3.1 70B Instruct
- Who develops Llama 3.1 8B Instruct?
- Llama 3.1 8B Instruct is developed by NVIDIA, based in the United States.
- How long has Llama 3.1 8B Instruct been around?
- Llama 3.1 8B Instruct first shipped in 2024.
Similar projects
Closest matches by what these projects do