This is an FP8 dynamically quantized version of the Ornith 1.0 9B language model. It is designed for efficient local inference while preserving model quality. The model includes a chat template and can be used with standard Transformers-based inference frameworks and tools that support quantized models.
Ornith 1.0 9B FP8 DYNAMIC is a Foundation models & chat product. It focuses on running powerful 9B language models with reduced memory footprint on consumer hardware. It is built as an open-source project for developers. Ornith 1.0 9B FP8 DYNAMIC is open source under the Apache-2.0 license. The product ships for the web, the command line, and API.
barryke builds and maintains Ornith 1.0 9B FP8 DYNAMIC, and the product first shipped in 2019. Development happens publicly on GitHub with 3.6k stars and 165 commits in the last 90 days. Key capabilities include Quantized LLM, dynamic quantization, and chat template.
Latest indexed changes and source events
barryke/Ornith-1.0-9B-FP8-DYNAMIC verified by the PulseGate indexer
Other apps tracked under the same category.
