This is a bitsandbytes 4-bit quantized version of Meta's Llama 3.1 8B Instruct model, optimized by Unsloth for faster training and inference. It includes a custom chat template supporting tools and is designed for efficient local deployment using popular inference libraries.
In the Foundation models & chat space, Meta Llama 3.1 8B Instruct Bnb takes a focused approach. It focuses on running high-quality instruction-tuned LLMs locally with significantly reduced memory footprint using 4-bit quantization. It is built as an open-source project for developers. Meta Llama 3.1 8B Instruct Bnb is open source under the Apache-2.0 license. Meta Llama 3.1 8B Instruct Bnb is available on the web, the command line, and API.
Unsloth builds and maintains Meta Llama 3.1 8B Instruct Bnb, and the product first shipped in 2023. Development happens publicly on GitHub with 68.6k stars and 1.2k commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 12 similar tools. Key capabilities include Quantized Model, Instruction Tuning, and Tool Integration.
Latest indexed changes and source events
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit verified by the PulseGate indexer
Other apps tracked under the same category.
