Llama 3 8B Instruct 32k
This is a GGUF-quantized variant of the Llama-3-8B-Instruct model with 32k context length, published on Hugging Face. It provides multiple quantization levels (Q2_K through IQ4_XS) that allow users to run the model locally with reduced memory requirements while maintaining instruction-following capabilities. Primarily used by developers and researchers who want to deploy or experiment with long-context LLMs on personal machines or self-hosted environments.
Open SourceMITWebCLISelf-hosted
122.1kstars
21.1kforks
12alternatives
4features
2023since
Overview
4 featuresLlama 3 8B Instruct 32k sits in PulseGate's Foundation models & chat category. It focuses on running a long-context Llama 3 8B model efficiently on consumer hardware without cloud dependency. Llama 3 8B Instruct 32k is an open-source project aimed at developers. Llama 3 8B Instruct 32k is open source under the MIT license. Llama 3 8B Instruct 32k is available on the web and the command line, and it can be self-hosted.
Behind Llama 3 8B Instruct 32k is MaziyarPanahi, and it first shipped in 2023. Development happens publicly on GitHub with 122.1k stars and 1.2k commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 12 similar projects. Among its 4 catalogued features are GGUF Quantization, Extended Context, and Instruct Tuned.
Summary written by a language model from the project’s public pages.
- GGUF Quantization
- Extended Context
- Instruct Tuned
- Local Inference
Tags
gguf-modelllama-3quantized-llmlocal-inference32k-context
AI capabilities
Text
Inference: LocalWeights: Open
Built with & integrations
Hosting
AWS
AI providers
local_ossmeta_llamamultiple
Runs on
BrowserCLISelf-hosted
Detected from
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- multiple
- bLangChain in the HTML
- local_oss
- bollama in the HTML · bllama in the HTML · bvllm in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
License
MIT
Verified signals
Indexing history
1What PulseGate has recorded for this listing
- Indexed30 Jul · 08:46 UTCMaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Llama 3 8B Instruct 32k
- What does Llama 3 8B Instruct 32k do?
- Llama 3 8B Instruct 32k focuses on running a long-context Llama 3 8B model efficiently on consumer hardware without cloud dependency. It is catalogued under Foundation models & chat on PulseGate.
- Who is Llama 3 8B Instruct 32k for?
- Llama 3 8B Instruct 32k is an open-source project built for developers.
- Does Llama 3 8B Instruct 32k have a free plan?
- Yes — Llama 3 8B Instruct 32k is open source under the MIT license and free to use.
- What platforms does Llama 3 8B Instruct 32k run on?
- Llama 3 8B Instruct 32k runs on the web and the command line. It can also be self-hosted.
- Is Llama 3 8B Instruct 32k still maintained?
- The GitHub repository shows 1.2k commits in the last 90 days.
- What are alternatives to Llama 3 8B Instruct 32k?
- Similar projects tracked by PulseGate include Llama 3 8B Instruct 64k, Llama 3.2 1B Instruct, and Llama 3.3 70B Instruct.Llama 3 8B Instruct 64kLlama 3.2 1B InstructLlama 3.3 70B Instruct
- Who develops Llama 3 8B Instruct 32k?
- Llama 3 8B Instruct 32k is developed by MaziyarPanahi.
- When did Llama 3 8B Instruct 32k launch?
- Llama 3 8B Instruct 32k first shipped in 2023.
Similar apps
Closest matches by what these projects do