This is a very small randomly initialized MistralForCausalLM model created by the TRL (Transformers Reinforcement Learning) team for internal testing. It is used to validate training scripts, inference pipelines, and integration tests without the overhead of loading full-scale models. Not intended for actual language generation.
Tiny MistralForCausalLM is a Foundation models & chat project. It focuses on providing minimal test models for validating Mistral architecture integration and training pipelines. Tiny MistralForCausalLM is an open-source project aimed at developers. Tiny MistralForCausalLM is open source under the Apache-2.0 license. Tiny MistralForCausalLM is available on the web, the command line, and API.
trl-internal-testing builds and maintains Tiny MistralForCausalLM, and it first shipped in 2020. The project is developed in the open on GitHub with 18.9k stars and 521 commits in the last 90 days. Key capabilities include causal language model, test model, and random weights.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do