Llama 3.3 70B Instruct FP8 Dynamic
This is an FP8 dynamically quantized version of Meta's Llama-3.3-70B-Instruct model. It maintains strong reasoning and instruction-following capabilities while significantly reducing memory requirements compared to the original 16-bit model. The model is suitable for local or self-hosted inference using compatible quantization and serving frameworks.
Overview
3 featuresIn the Text generation space, Llama 3.3 70B Instruct FP8 Dynamic takes a focused approach. It focuses on running a high-performance 70B instruction model with reduced memory footprint. Llama 3.3 70B Instruct FP8 Dynamic is an open-source project aimed at developers. The project is open source (MIT). It runs on the web and API.
cortecs builds and maintains Llama 3.3 70B Instruct FP8 Dynamic, and it first shipped in 2020. The project is developed in the open on GitHub with 13.3k stars and 53 commits in the last 90 days. Among its 3 catalogued features are FP8 quantization, instruction tuning, and dynamic quantization.
Summary written by a language model from the project’s public pages.
- FP8 quantization
- Instruction tuning
- Dynamic quantization
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed19 Jul · 20:19 UTCcortecs/Llama-3.3-70B-Instruct-FP8-Dynamic verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Llama 3.3 70B Instruct FP8 Dynamic
- What does Llama 3.3 70B Instruct FP8 Dynamic do?
- Llama 3.3 70B Instruct FP8 Dynamic focuses on running a high-performance 70B instruction model with reduced memory footprint. It is catalogued under Text generation on PulseGate.
- Who is Llama 3.3 70B Instruct FP8 Dynamic for?
- Llama 3.3 70B Instruct FP8 Dynamic is an open-source project built for developers.
- Is Llama 3.3 70B Instruct FP8 Dynamic free?
- Yes — Llama 3.3 70B Instruct FP8 Dynamic is open source under the MIT license and free to use.
- What platforms does Llama 3.3 70B Instruct FP8 Dynamic run on?
- Llama 3.3 70B Instruct FP8 Dynamic runs on the web and API.
- Is Llama 3.3 70B Instruct FP8 Dynamic still active?
- The GitHub repository shows 53 commits in the last 90 days.
- What projects are similar to Llama 3.3 70B Instruct FP8 Dynamic?
- Similar projects tracked by PulseGate include Llama 3.3 70B Instruct FP8 Dynamic, Llama 3.3 70B Instruct, and Meta Llama 3.1 8B Instruct FP8 Dynamic.Llama 3.3 70B Instruct FP8 DynamicLlama 3.3 70B InstructMeta Llama 3.1 8B Instruct FP8 Dynamic
- Who develops Llama 3.3 70B Instruct FP8 Dynamic?
- Llama 3.3 70B Instruct FP8 Dynamic is developed by cortecs.
- How long has Llama 3.3 70B Instruct FP8 Dynamic been around?
- Llama 3.3 70B Instruct FP8 Dynamic first shipped in 2020.
Similar projects
Closest matches by what these projects do