A significantly downsized version of the Mixtral model created by TitanML. It is designed for testing, debugging, and experimentation with Mixture-of-Experts architectures and text-generation pipelines. The model is not intended for production use but serves as a lightweight proxy for the full Mixtral model.
Tiny Mixtral is a Foundation models & chat project. It focuses on providing a minimal Mixtral-like model for rapid testing of inference and training pipelines. It is built as an open-source project for developers. The project is open source (Open Source). It runs on the web, the command line, and API.
Behind Tiny Mixtral is TitanML.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do