TrainCheck is an open-source CLI tool that helps machine learning engineers detect silent bugs in AI model training. It collects traces from reference and target runs, infers invariants, and checks for violations, supporting robust model evaluation and debugging.
TrainCheck is a LLM eval & observability product. It focuses on detecting silent bugs and anomalies in AI model training runs by comparing traces and invariants. TrainCheck is an open-source project aimed at machine learning engineers. The project is open source (Open Source). It runs on the web and the command line.
OrderLab builds and maintains TrainCheck, and the product first shipped in 2024. The project is developed in the open on GitHub with 71 stars and 6 commits in the last 90 days. Across PulseGate's embedding index, TrainCheck has few near neighbours, marking it as relatively distinct. Among its 5 catalogued features are invariant checking, trace collection, and pyTorch integration.
Latest indexed changes and source events
orderlab.io discovered by the PulseGate indexer
Other apps tracked under the same category.