This is a very small test instance of a Phi-3-based causal language model created for internal TRL (Transformers Reinforcement Learning) testing. It includes a chat template and tokenizer configuration suitable for rapid iteration during development of fine-tuning or evaluation code. Not intended for production use.
In the Foundation models & chat space, Tiny Phi3ForCausalLM takes a focused approach. It focuses on providing a minimal model for testing and validating training, inference, and alignment pipelines. Tiny Phi3ForCausalLM is an open-source project aimed at developers. The project is open source (Apache-2.0). The product ships for the web, the command line, and API.
It is developed by TRL Internal Testing, and the product first shipped in 2020. The project is developed in the open on GitHub with 18.9k stars and 521 commits in the last 90 days. PulseGate's similarity index places it among 6 comparable tools. Among its 3 catalogued features are Causal LM, Test Model, and Chat Template.
Latest indexed changes and source events
trl-internal-testing/tiny-Phi3ForCausalLM-3.5 verified by the PulseGate indexer