This is a 4-bit quantized version of the gpt-oss-20b model prepared using Unsloth and BitsAndBytes. It is designed for efficient local inference while maintaining high performance. The model includes comprehensive schema handling and is optimized for reduced memory footprint.
In the Foundation models & chat space, Gpt Oss 20b Unsloth Bnb takes a focused approach. It focuses on providing an efficient, quantized version of a 20B parameter model for local inference. It is built as an open-source project for developers. Gpt Oss 20b Unsloth Bnb is open source under the Apache-2.0 license. It runs on the web, the command line, and API.
It is developed by unsloth, and the product first shipped in 2023. Development happens publicly on GitHub with 68.7k stars and 1.2k commits in the last 90 days. Key capabilities include 4-bit Quantization, Unsloth Optimized, and bitsAndBytes.
Latest indexed changes and source events
unsloth/gpt-oss-20b-unsloth-bnb-4bit verified by the PulseGate indexer
Other apps tracked under the same category.