tiny-GemmaForCausalLM is a very small test model based on the Gemma architecture, published by the TRL team for internal validation of reinforcement learning and fine-tuning workflows. It is not intended for real-world usage but serves as a lightweight reference for developers working with the Gemma model family. Available for download on Hugging Face.
Tiny GemmaForCausalLM sits in PulseGate's Foundation models & chat category. It focuses on providing a tiny reference implementation for testing Gemma-based training and inference code. Tiny GemmaForCausalLM is an open-source project aimed at developers. The project is open source (Apache-2.0). Tiny GemmaForCausalLM is available on the web, the command line, and API.
Behind Tiny GemmaForCausalLM is trl-internal-testing, and the product first shipped in 2020. The project is developed in the open on GitHub with 18.9k stars and 531 commits in the last 90 days. Among its 3 catalogued features are Causal Language Modeling, Chat Templates, and Test Model.
Latest indexed changes and source events
trl-internal-testing/tiny-GemmaForCausalLM verified by the PulseGate indexer
