Llama 3 70b Instruct
This repository hosts an AWQ-quantized version of Meta's Llama 3 70B Instruct model, created by casperhansen. It enables efficient inference of this powerful instruction-tuned model on consumer or enterprise hardware with lower VRAM requirements. The model supports chat templates and is compatible with standard Hugging Face transformers and inference tools.
Overview
Llama 3 70b Instruct is a Text generation project. It focuses on running large 70B parameter language models with reduced memory usage through quantization. Llama 3 70b Instruct is an open-source project aimed at AI developers and researchers. The project is open source (Open Source). It runs on the web, the command line, and API.
casperhansen builds and maintains Llama 3 70b Instruct. PulseGate's similarity index places it among 8 comparable projects.
Summary written by a language model from the project’s public pages.
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · text-generation- in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 17:15 UTCcasperhansen/llama-3-70b-instruct-awq verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Llama 3 70b Instruct
- What does Llama 3 70b Instruct do?
- Llama 3 70b Instruct focuses on running large 70B parameter language models with reduced memory usage through quantization. It is catalogued under Text generation on PulseGate.
- Who should use Llama 3 70b Instruct?
- Llama 3 70b Instruct is an open-source project built for AI developers and researchers.
- Is Llama 3 70b Instruct free?
- Yes — Llama 3 70b Instruct is open source under the Open Source license and free to use.
- What platforms does Llama 3 70b Instruct run on?
- Llama 3 70b Instruct runs on the web, the command line, and API.
- Is Llama 3 70b Instruct still active?
- Unverified. Llama 3 70b Instruct has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What are alternatives to Llama 3 70b Instruct?
- Similar projects tracked by PulseGate include Llama 3.3 70b Instruct, Llama 3 8b Instruct, and Meta Llama 3.1 70B Instruct.Llama 3.3 70b InstructLlama 3 8b InstructMeta Llama 3.1 70B Instruct
- Who makes Llama 3 70b Instruct?
- Llama 3 70b Instruct is developed by casperhansen.
- Is Llama 3 70b Instruct open source?
- Yes — Llama 3 70b Instruct is open source under the Open Source license.
Similar projects
Closest matches by what these projects do