This repository hosts an FP8 dynamically quantized version of the Qwen3.5-9B model, published by RedHatAI. The reduced precision format allows for faster inference while preserving model quality. It is suitable for deployment in production or research environments using modern inference frameworks.
In the Foundation models & chat space, Qwen3.5 9B FP8 Dynamic takes a focused approach. It focuses on deploying a high-performance 9B parameter model with reduced precision for faster inference and lower memory usage. Qwen3.5 9B FP8 Dynamic is an open-source project aimed at developers. Qwen3.5 9B FP8 Dynamic is open source under the Apache-2.0 license. It ships for the web, the command line, and API.
It is developed by RedHatAI, and it first shipped in 2019. Development happens publicly on GitHub with 3.6k stars and 168 commits in the last 90 days. PulseGate's similarity index places it among 12 comparable projects. Key capabilities include FP8 precision, dynamic quantization, and high performance.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do