This is a very small "tiny" version of a Phi-3 causal language model created by the Hugging Face TRL team for internal testing purposes. It implements the core architecture and tokenizer of Phi-3 but at a drastically reduced scale. It is intended for developers debugging training loops, inference code, or integration with the TRL library rather than for production use.
In the Foundation models & chat space, Tiny Phi3ForCausalLM 3 takes a focused approach. It focuses on providing a minimal reproducible model for testing and validating training and inference pipelines for Phi-3 style models. It is built as an open-source project for developers. Tiny Phi3ForCausalLM 3 is open source under the Apache-2.0 license. Tiny Phi3ForCausalLM 3 is available on the web, the command line, and API.
Behind Tiny Phi3ForCausalLM 3 is Hugging Face TRL, based in the United States, and it first shipped in 2020. Development happens publicly on GitHub with 18.9k stars and 521 commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 5 similar projects. Among its 3 catalogued features are Causal Language Modeling, Test Model, and Transformers Compatible. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do