Meta Llama 3.1 8B Instruct Bnb
This is a bitsandbytes 4-bit quantized version of Meta's Llama 3.1 8B Instruct model, optimized by Unsloth for faster training and inference. It includes a custom chat template supporting tools and is designed for efficient local deployment using popular inference libraries.
Overview
3 featuresMeta Llama 3.1 8B Instruct Bnb sits in PulseGate's Text generation category. It focuses on running high-quality instruction-tuned LLMs locally with significantly reduced memory footprint using 4-bit quantization. It is built as an open-source project for developers. The project is open source (Apache-2.0). Meta Llama 3.1 8B Instruct Bnb is available on the web, the command line, and API.
Unsloth builds and maintains Meta Llama 3.1 8B Instruct Bnb, and it first shipped in 2023. The project is developed in the open on GitHub with 68.6k stars and 1.2k commits in the last 90 days. PulseGate's similarity index places it among 12 comparable projects. Key capabilities include Quantized Model, Instruction Tuning, and Tool Integration.
Summary written by a language model from the project’s public pages.
- Quantized Model
- Instruction Tuning
- Tool Integration
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bollama in the HTML · bllama in the HTML · bvllm in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 13:04 UTCunsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit verified against its public sourceSource: PulseGate · Open
Frequently asked questions about Meta Llama 3.1 8B Instruct Bnb
- What is Meta Llama 3.1 8B Instruct Bnb?
- Meta Llama 3.1 8B Instruct Bnb focuses on running high-quality instruction-tuned LLMs locally with significantly reduced memory footprint using 4-bit quantization. It is catalogued under Text generation on PulseGate.
- Who is Meta Llama 3.1 8B Instruct Bnb for?
- Meta Llama 3.1 8B Instruct Bnb is an open-source project built for developers.
- Is Meta Llama 3.1 8B Instruct Bnb free?
- Yes — Meta Llama 3.1 8B Instruct Bnb is open source under the Apache-2.0 license and free to use.
- What platforms does Meta Llama 3.1 8B Instruct Bnb run on?
- Meta Llama 3.1 8B Instruct Bnb runs on the web, the command line, and API.
- Is Meta Llama 3.1 8B Instruct Bnb still active?
- The GitHub repository shows 1.2k commits in the last 90 days.
- What projects are similar to Meta Llama 3.1 8B Instruct Bnb?
- Similar projects tracked by PulseGate include Llama 3.2 3B Instruct Bnb, Meta Llama 3.1 8B Instruct, and Llama 3.2 1B Instruct Unsloth Bnb.Llama 3.2 3B Instruct BnbMeta Llama 3.1 8B InstructLlama 3.2 1B Instruct Unsloth Bnb
- Who develops Meta Llama 3.1 8B Instruct Bnb?
- Meta Llama 3.1 8B Instruct Bnb is developed by Unsloth, based in the United States.
- How long has Meta Llama 3.1 8B Instruct Bnb been around?
- Meta Llama 3.1 8B Instruct Bnb first shipped in 2023.
Similar projects
Closest matches by what these projects do