Qwythos-9B-v2-AutoRound-W4A16-RTN is an open-source, quantized large language model designed for local inference and conversational AI. It is suitable for developers and researchers seeking efficient, offline AI capabilities.
Qwythos 9B V2 AutoRound W4A16 RTN sits in PulseGate's Foundation models & chat category. It focuses on providing a quantized, locally runnable large language model for AI development and research. Qwythos 9B V2 AutoRound W4A16 RTN is an open-source project aimed at AI developers and researchers. The project is open source (Apache-2.0). It runs on the command line, and it can be self-hosted.
LeaderboardModel1 builds and maintains Qwythos 9B V2 AutoRound W4A16 RTN, and the product first shipped in 2024. The project is developed in the open on GitHub with 1.5k stars and 178 commits in the last 90 days. Across PulseGate's embedding index, Qwythos 9B V2 AutoRound W4A16 RTN has few near neighbours, marking it as relatively distinct. Among its 4 catalogued features are quantized model, local inference, and open source.
Latest indexed changes and source events
LeaderboardModel1/Qwythos-9B-v2-AutoRound-W4A16-RTN discovered by the PulseGate indexer
Other apps tracked under the same category.
