Gpt Oss 20b Unsloth Bnb
This is a 4-bit quantized version of the gpt-oss-20b model prepared using Unsloth and BitsAndBytes. It is designed for efficient local inference while maintaining high performance. The model includes comprehensive schema handling and is optimized for reduced memory footprint.
Overview
4 featuresGpt Oss 20b Unsloth Bnb is a Quantised & converted weights project. It focuses on providing an efficient, quantized version of a 20B parameter model for local inference. It is built as an open-source project for developers. The project is open source (Apache-2.0). Gpt Oss 20b Unsloth Bnb is available on the web, the command line, and API.
unsloth builds and maintains Gpt Oss 20b Unsloth Bnb, and it first shipped in 2023. The project is developed in the open on GitHub with 68.7k stars and 1.2k commits in the last 90 days. Key capabilities include 4-bit Quantization, Unsloth Optimized, and bitsAndBytes.
Summary written by a language model from the project’s public pages.
- 4-bit Quantization
- Unsloth Optimized
- BitsAndBytes
- Large Context
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
- local_oss
- bollama in the HTML · bllama in the HTML · bvllm in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed21 Jul · 19:44 UTCunsloth/gpt-oss-20b-unsloth-bnb-4bit verified via Hugging Face EnumeratorSource: Hugging Face Enumerator · Open
Frequently asked questions about Gpt Oss 20b Unsloth Bnb
- What does Gpt Oss 20b Unsloth Bnb do?
- Gpt Oss 20b Unsloth Bnb focuses on providing an efficient, quantized version of a 20B parameter model for local inference. It is catalogued under Quantised & converted weights on PulseGate.
- Who is Gpt Oss 20b Unsloth Bnb for?
- Gpt Oss 20b Unsloth Bnb is an open-source project built for developers.
- Is Gpt Oss 20b Unsloth Bnb free?
- Yes — Gpt Oss 20b Unsloth Bnb is open source under the Apache-2.0 license and free to use.
- What platforms does Gpt Oss 20b Unsloth Bnb run on?
- Gpt Oss 20b Unsloth Bnb runs on the web, the command line, and API.
- Is Gpt Oss 20b Unsloth Bnb still maintained?
- The GitHub repository shows 1.2k commits in the last 90 days.
- What are alternatives to Gpt Oss 20b Unsloth Bnb?
- Similar projects tracked by PulseGate include Gpt Oss 20b, Gpt Oss 20b, and Gpt Oss 20b.Gpt Oss 20bGpt Oss 20bGpt Oss 20b
- Who develops Gpt Oss 20b Unsloth Bnb?
- Gpt Oss 20b Unsloth Bnb is developed by unsloth.
- How long has Gpt Oss 20b Unsloth Bnb been around?
- Gpt Oss 20b Unsloth Bnb first shipped in 2023.
Similar projects
Closest matches by what these projects do