tiny-Qwen3_5MoeForConditionalGeneration-3.6 is a very small synthetic model created for internal testing of the TRL (Transformers Reinforcement Learning) library. It mimics the architecture of Qwen3 Mixture-of-Experts models for conditional text generation. This model is not intended for real-world use but serves as a test fixture for library developers.
Tiny Qwen3 5MoeForConditionalGeneration sits in PulseGate's Foundation models & chat category. It focuses on providing a minimal reproducible model for testing and validating training and inference code for Qwen3 MoE architectures. Tiny Qwen3 5MoeForConditionalGeneration is an open-source project aimed at developers. Tiny Qwen3 5MoeForConditionalGeneration is open source under the Apache-2.0 license. It runs on the web, the command line, and API.
trl-internal-testing builds and maintains Tiny Qwen3 5MoeForConditionalGeneration, and it first shipped in 2020. Development happens publicly on GitHub with 18.9k stars and 496 commits in the last 90 days. Among its 3 catalogued features are mixture-of-Experts, tiny test model, and conditional generation.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do