Llama 3.1 8B Instruct FP8 KV
This is a quantized version of Meta's Llama 3.1 8B Instruct model using FP8 precision for the KV cache, optimized for AMD hardware. It is hosted on Hugging Face and can be used with the Transformers library for text generation and chat applications. The model is intended for developers seeking efficient local inference with reduced memory requirements.
Overview
5 featuresLlama 3.1 8B Instruct FP8 KV sits in PulseGate's Text generation category. It focuses on running efficient quantized large language models locally on AMD hardware. It is built as an open-source project for developers. The project is open source (Open Source). It ships for the web, the command line, and API.
Behind Llama 3.1 8B Instruct FP8 KV is AMD, and it first shipped in 2024. Among its 5 catalogued features are Image Classification, transformers, and pyTorch.
Summary written by a language model from the project’s public pages.
- Image Classification
- Transformers
- PyTorch
- TensorFlow
- JAX
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bvllm in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed19 Jul · 20:19 UTCamd/Llama-3.1-8B-Instruct-FP8-KV verified via Hugging Face EnumeratorSource: Hugging Face Enumerator · Open
Frequently asked questions about Llama 3.1 8B Instruct FP8 KV
- What is Llama 3.1 8B Instruct FP8 KV?
- Llama 3.1 8B Instruct FP8 KV focuses on running efficient quantized large language models locally on AMD hardware. It is catalogued under Text generation on PulseGate.
- Who should use Llama 3.1 8B Instruct FP8 KV?
- Llama 3.1 8B Instruct FP8 KV is an open-source project built for developers.
- Is Llama 3.1 8B Instruct FP8 KV free?
- Yes — Llama 3.1 8B Instruct FP8 KV is open source under the Open Source license and free to use.
- What platforms does Llama 3.1 8B Instruct FP8 KV run on?
- Llama 3.1 8B Instruct FP8 KV runs on the web, the command line, and API.
- Is Llama 3.1 8B Instruct FP8 KV still active?
- Unverified. Llama 3.1 8B Instruct FP8 KV has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What projects are similar to Llama 3.1 8B Instruct FP8 KV?
- Similar projects tracked by PulseGate include Llama 3.1 8B Instruct, Llama 3.1 8B Instruct, and Llama 3.3 70B Instruct.Llama 3.1 8B InstructLlama 3.1 8B InstructLlama 3.3 70B Instruct
- Who makes Llama 3.1 8B Instruct FP8 KV?
- Llama 3.1 8B Instruct FP8 KV is developed by AMD.
- How long has Llama 3.1 8B Instruct FP8 KV been around?
- Llama 3.1 8B Instruct FP8 KV first shipped in 2024.
Similar projects
Closest matches by what these projects do