Llama 3.3 70b Instruct
llama-3.3-70b-instruct-awq is a quantized version of Meta's Llama 3.3 70B Instruct model using the AWQ quantization method. This allows the large model to run with reduced memory requirements while maintaining performance. It includes a chat template optimized for instruction following and is compatible with Transformers and other inference frameworks.
Overview
3 featuresLlama 3.3 70b Instruct sits in PulseGate's Foundation models & chat category. It focuses on running the large 70B Llama 3.3 model efficiently on consumer or enterprise hardware through quantization. It is built as an open-source project for developers and researchers running large language models locally. The project is open source (MIT). It ships for the web, the command line, and API.
Behind Llama 3.3 70b Instruct is casperhansen, and it first shipped in 2023. The GitHub repository has been archived. PulseGate's similarity index places it among 6 comparable projects. Among its 3 catalogued features are quantized weights, 70B parameters, and instruction tuned.
Summary written by a language model from the project’s public pages.
- Quantized weights
- 70B parameters
- Instruction tuned
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML · text-generation- in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 17:09 UTCcasperhansen/llama-3.3-70b-instruct-awq verified via Hugging Face EnumeratorSource: Hugging Face Enumerator · Open
Frequently asked questions about Llama 3.3 70b Instruct
- What does Llama 3.3 70b Instruct do?
- Llama 3.3 70b Instruct focuses on running the large 70B Llama 3.3 model efficiently on consumer or enterprise hardware through quantization. It is catalogued under Foundation models & chat on PulseGate.
- Who is Llama 3.3 70b Instruct for?
- Llama 3.3 70b Instruct is an open-source project built for developers and researchers running large language models locally.
- Does Llama 3.3 70b Instruct have a free plan?
- Yes — Llama 3.3 70b Instruct is open source under the MIT license and free to use.
- What platforms does Llama 3.3 70b Instruct run on?
- Llama 3.3 70b Instruct runs on the web, the command line, and API.
- Is Llama 3.3 70b Instruct still maintained?
- Unverified. Llama 3.3 70b Instruct has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What projects are similar to Llama 3.3 70b Instruct?
- Similar projects tracked by PulseGate include Llama 3 70b Instruct, Llama 3 8b Instruct, and Llama 3.2 1B Instruct Q8 0.Llama 3 70b InstructLlama 3 8b InstructLlama 3.2 1B Instruct Q8 0
- Who develops Llama 3.3 70b Instruct?
- Llama 3.3 70b Instruct is developed by casperhansen.
- How long has Llama 3.3 70b Instruct been around?
- Llama 3.3 70b Instruct first shipped in 2023.
Similar projects
Closest matches by what these projects do