Meta Llama 3.1 70B Instruct
This is an AWQ (INT4) quantized version of Meta's Llama 3.1 70B Instruct model, optimized for reduced memory usage while maintaining performance. It includes a detailed chat template and is suitable for local inference. The model is provided by the hugging-quants organization on Hugging Face.
Overview
3 featuresMeta Llama 3.1 70B Instruct sits in PulseGate's Text generation category. It focuses on running large 70B language models efficiently on consumer or enterprise hardware with reduced memory requirements. It is built as an open-source project for AI developers and researchers. The project is open source (MIT). It runs on the command line and API.
It is developed by hugging-quants, and it first shipped in 2023. The GitHub repository has been archived. It operates in a well-populated space: PulseGate tracks 13 similar projects. Among its 3 catalogued features are Quantized Weights, Instruction Tuned, and Chat Template.
Summary written by a language model from the project’s public pages.
- Quantized Weights
- Instruction Tuned
- Chat Template
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- openai
- bopenai/openai-node in the HTML
- local_oss
- bvllm in the HTML · text-generation- in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 17:05 UTChugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4 verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Meta Llama 3.1 70B Instruct
- What is Meta Llama 3.1 70B Instruct?
- Meta Llama 3.1 70B Instruct focuses on running large 70B language models efficiently on consumer or enterprise hardware with reduced memory requirements. It is catalogued under Text generation on PulseGate.
- Who should use Meta Llama 3.1 70B Instruct?
- Meta Llama 3.1 70B Instruct is an open-source project built for AI developers and researchers.
- Is Meta Llama 3.1 70B Instruct free?
- Yes — Meta Llama 3.1 70B Instruct is open source under the MIT license and free to use.
- What platforms does Meta Llama 3.1 70B Instruct run on?
- Meta Llama 3.1 70B Instruct runs on the command line and API.
- Is Meta Llama 3.1 70B Instruct still maintained?
- Unverified. Meta Llama 3.1 70B Instruct has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What projects are similar to Meta Llama 3.1 70B Instruct?
- Similar projects tracked by PulseGate include Meta Llama 3.3 70B Instruct, Meta Llama 3.1 70B Instruct Quantized.w4a16, and Meta Llama 3.1 8B Instruct Quantized.w4a16.Meta Llama 3.3 70B InstructMeta Llama 3.1 70B Instruct Quantized.w4a16Meta Llama 3.1 8B Instruct Quantized.w4a16
- Who makes Meta Llama 3.1 70B Instruct?
- Meta Llama 3.1 70B Instruct is developed by hugging-quants.
- When did Meta Llama 3.1 70B Instruct launch?
- Meta Llama 3.1 70B Instruct first shipped in 2023.
Similar projects
Closest matches by what these projects do