This repository contains GGUF format quantized weights for Meta's Llama 3.2 3B Instruct model, created by bartowski. These files are optimized for use with llama.cpp, LM Studio, and other local LLM inference tools.
Llama 3.2 3B Instruct sits in PulseGate's Foundation models & chat category. It focuses on running the Llama 3.2 3B model efficiently on consumer hardware using GGUF format and tools like llama.cpp. It is built as an open-source project for developers. Llama 3.2 3B Instruct is open source under the MIT license. Llama 3.2 3B Instruct is available on the web, the command line, and API.
bartowski builds and maintains Llama 3.2 3B Instruct, and the product first shipped in 2023. Development happens publicly on GitHub with 121.2k stars and 1.2k commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 16 similar tools.
Latest indexed changes and source events
bartowski/Llama-3.2-3B-Instruct-GGUF verified by the PulseGate indexer