This repository hosts GGUF quantized files for Meta's Llama 3.1 405B Instruct model. The largest openly available model in the Llama 3.1 family, it has been converted into multiple quantization formats to enable running on high-end local hardware or servers. It excels at complex reasoning, coding, and instruction-following tasks while maintaining the openness of the original Meta release.
In the Foundation models & chat space, Meta Llama 3.1 405B Instruct takes a focused approach. It focuses on running Meta's largest and most capable Llama model locally or on-premise with reduced memory footprint. Meta Llama 3.1 405B Instruct is an open-source project aimed at AI researchers and enterprises. Meta Llama 3.1 405B Instruct is open source under the MIT license. Meta Llama 3.1 405B Instruct is available on the web, the command line, and API.
It is developed by Maziyar Panahi (United States), and it first shipped in 2023. The project is developed in the open on GitHub with 122.5k stars and 1.2k commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 14 similar projects. Key capabilities include 405B Parameters, Instruction Tuned, and Quantized GGUF.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do