This is a very small test model used internally by the Hugging Face TRL (Transformer Reinforcement Learning) team. It implements a minimal LlamaForCausalLM architecture and is intended for unit testing and CI pipelines rather than actual language generation.
In the Foundation models & chat space, Tiny LlamaForCausalLM takes a focused approach. It focuses on providing a minimal reproducible model for testing Transformer Reinforcement Learning (TRL) library components. It is built as an open-source project for developers. Tiny LlamaForCausalLM is open source under the Apache-2.0 license. It ships for the web, the command line, and API.
It is developed by TRL Internal Testing, and it first shipped in 2020. Development happens publicly on GitHub with 18.9k stars and 496 commits in the last 90 days. PulseGate's similarity index places it among 6 comparable projects.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do