Qwythos-9B-v2-MLX-8bit is a quantized checkpoint of a 9B parameter language model, distributed for efficient local inference and text generation. It is suitable for developers and researchers integrating LLMs into custom pipelines or automation tasks.
Qwythos 9B sits in PulseGate's Foundation models & chat category. It focuses on running efficient, quantized language model inference for local NLP tasks and automation. It is built as an open-source project for AI developers and researchers. Qwythos 9B is open source under the MIT license. It runs on the command line, and it can be self-hosted.
It is developed by ahmedandaloes, and the product first shipped in 2023. Development happens publicly on GitHub with 27.5k stars and 171 commits in the last 90 days. PulseGate's similarity index finds few close equivalents — Qwythos 9B occupies a relatively distinct niche. Key capabilities include quantized weights, local inference, and text generation.
Latest indexed changes and source events
ahmedandaloes/Qwythos-9B-v2-MLX-8bit discovered by the PulseGate indexer
