Ternary-Bonsai-8B-mlx-2bit is an open-source, quantized 8B parameter language model for efficient local inference and research. It is installable via pip and npm, targeting AI researchers and developers who want to run large LLMs on their own hardware.
In the Foundation models & chat space, Ternary Bonsai 8B takes a focused approach. It focuses on providing a larger, open-source quantized language model for local inference and research. Ternary Bonsai 8B is an open-source project aimed at AI researchers and developers. The project is open source (Apache-2.0). Ternary Bonsai 8B is available on the command line.
It is developed by thoddnn, and the product first shipped in 2026. The project is developed in the open on GitHub with 1.2k stars and 27 commits in the last 90 days. Among its 5 catalogued features are language modeling, local inference, and low-bit quantization.
Latest indexed changes and source events
thoddnn/Ternary-Bonsai-8B-mlx-2bit verified by the PulseGate indexer
