Qwythos-9B-v2-MLX-6bit is a 9B parameter language model distributed in MLX 6-bit quantized format. It is designed for developers seeking efficient, local LLM inference with reduced memory requirements.
Qwythos 9B is a Foundation models & chat product. It enables efficient local inference of a large language model using 6-bit quantization and MLX format. It is built as an open-source project for AI developers and researchers. Qwythos 9B is open source under the MIT license. Qwythos 9B is available on the command line, and it can be self-hosted.
It is developed by ahmedandaloes, and the product first shipped in 2023. Development happens publicly on GitHub with 27.5k stars and 171 commits in the last 90 days. PulseGate's similarity index finds few close equivalents — Qwythos 9B occupies a relatively distinct niche. Key capabilities include MLX format, 6-bit quantization, and local inference.
Latest indexed changes and source events
ahmedandaloes/Qwythos-9B-v2-MLX-6bit discovered by the PulseGate indexer
