EleutherAI/pythia-1b belongs to the Pythia suite of models. It was trained on the Pile dataset with public checkpoints released throughout training. The model supports causal language modeling and can be used for research into scaling laws and model behavior.
In the Foundation models & chat space, Pythia 1b takes a focused approach. It focuses on providing a fully transparent, open 1B parameter model for language modeling research and downstream applications. Pythia 1b is an open-source project aimed at developers. The project is open source (Apache-2.0). Pythia 1b is available on the web, the command line, and API.
It is developed by EleutherAI, and the product first shipped in 2021. The project is developed in the open on GitHub with 2.9k stars. Among its 3 catalogued features are Text Generation, Decoder-only Architecture, and Training Transparency.
Latest indexed changes and source events
EleutherAI/pythia-1b verified by the PulseGate indexer
Other apps tracked under the same category.
