Meta Llama 3.1 70B Instruct
This is an FP8-quantized version of Meta's Llama 3.1 70B Instruct model, published by RedHatAI. It maintains strong instruction-following capabilities while using a more memory-efficient format suitable for self-hosted deployment. The model includes a detailed chat template and is designed for production inference environments.
Overview
3 featuresIn the Text generation space, Meta Llama 3.1 70B Instruct takes a focused approach. It focuses on running a high-performance 70B parameter language model with reduced memory requirements through quantization. Meta Llama 3.1 70B Instruct is an open-source project aimed at developers and enterprises deploying LLMs. The project is open source (Apache-2.0). It ships for the web, the command line, and API, and it can be self-hosted.
It is developed by RedHatAI, and it first shipped in 2019. Development happens publicly on GitHub with 3.6k stars and 165 commits in the last 90 days. PulseGate's similarity index places it among 17 comparable projects. Among its 3 catalogued features are instruction tuning, Quantized FP8, and chat template.
Summary written by a language model from the project’s public pages.
- Instruction tuning
- Quantized FP8
- Chat template
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · huggingface in the HTML · text-generation- in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 13:08 UTCRedHatAI/Meta-Llama-3.1-70B-Instruct-FP8 verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Meta Llama 3.1 70B Instruct
- What is Meta Llama 3.1 70B Instruct?
- Meta Llama 3.1 70B Instruct focuses on running a high-performance 70B parameter language model with reduced memory requirements through quantization. It is catalogued under Text generation on PulseGate.
- Who is Meta Llama 3.1 70B Instruct for?
- Meta Llama 3.1 70B Instruct is an open-source project built for developers and enterprises deploying LLMs.
- Is Meta Llama 3.1 70B Instruct free?
- Yes — Meta Llama 3.1 70B Instruct is open source under the Apache-2.0 license and free to use.
- What platforms does Meta Llama 3.1 70B Instruct run on?
- Meta Llama 3.1 70B Instruct runs on the web, the command line, and API. It can also be self-hosted.
- Is Meta Llama 3.1 70B Instruct still maintained?
- The GitHub repository shows 165 commits in the last 90 days.
- What are alternatives to Meta Llama 3.1 70B Instruct?
- Similar projects tracked by PulseGate include Meta Llama 3.1 8B Instruct, Meta Llama 3.1 8B Instruct FP8 Dynamic, and Meta Llama 3.1 70B Instruct Quantized.w4a16.Meta Llama 3.1 8B InstructMeta Llama 3.1 8B Instruct FP8 DynamicMeta Llama 3.1 70B Instruct Quantized.w4a16
- Who develops Meta Llama 3.1 70B Instruct?
- Meta Llama 3.1 70B Instruct is developed by RedHatAI.
- When did Meta Llama 3.1 70B Instruct launch?
- Meta Llama 3.1 70B Instruct first shipped in 2019.
Similar projects
Closest matches by what these projects do