Llama 3.1 70B Instruct
Llama 3.1 70B Instruct FP8 is an open-weight large language model checkpoint optimized for instruction-following text generation. Developers can download and run it locally or deploy it with Python and Docker-based inference tooling.
Overview
6 featuresLlama 3.1 70B Instruct sits in PulseGate's Foundation models & chat category. It focuses on running an instruction-following large language model locally or in self-hosted inference environments. It is built as an open-source project for AI developers and ML engineers. The project is open source (Apache-2.0). Llama 3.1 70B Instruct is available on the web, the command line, and API, and it can be self-hosted.
It is developed by NVIDIA, and it first shipped in 2024. Development happens publicly on GitHub with 3.4k stars and 349 commits in the last 90 days. PulseGate's similarity index places it among 16 comparable projects. Among its 6 catalogued features are instruction tuning, chat template, and tool calling.
Summary written by a language model from the project’s public pages.
- Instruction tuning
- Chat template
- Tool calling
- FP8 quantization
- Docker support
- Python support
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · text-generation- in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed17 Aug · 13:10 UTCnvidia/Llama-3.1-70B-Instruct-FP8 verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Llama 3.1 70B Instruct
- What is Llama 3.1 70B Instruct?
- Llama 3.1 70B Instruct focuses on running an instruction-following large language model locally or in self-hosted inference environments. It is catalogued under Foundation models & chat on PulseGate.
- Who is Llama 3.1 70B Instruct for?
- Llama 3.1 70B Instruct is an open-source project built for AI developers and ML engineers.
- Is Llama 3.1 70B Instruct free?
- Yes — Llama 3.1 70B Instruct is open source under the Apache-2.0 license and free to use.
- What platforms does Llama 3.1 70B Instruct run on?
- Llama 3.1 70B Instruct runs on the web, the command line, and API. It can also be self-hosted.
- Is Llama 3.1 70B Instruct still maintained?
- The GitHub repository shows 349 commits in the last 90 days.
- What projects are similar to Llama 3.1 70B Instruct?
- Similar projects tracked by PulseGate include Llama 3.3 70B Instruct, Llama 3.3 70B Instruct, and Llama 3.1 8B Instruct.Llama 3.3 70B InstructLlama 3.3 70B InstructLlama 3.1 8B Instruct
- Who makes Llama 3.1 70B Instruct?
- Llama 3.1 70B Instruct is developed by NVIDIA.
- When did Llama 3.1 70B Instruct launch?
- Llama 3.1 70B Instruct first shipped in 2024.
Similar projects
Closest matches by what these projects do