onejudge-cli is an open-source command-line tool that allows users to drive a harness through simulated conversations and score the resulting transcripts. It is designed for developers and AI researchers who need to evaluate conversational agents efficiently. The tool supports automated evaluation workflows and is distributed under the MIT license.
onejudge-cli sits in PulseGate's CLI tools & terminal category. It focuses on automating the evaluation and scoring of simulated conversation transcripts via the command line. It is built as an open-source project for developers and AI researchers evaluating conversational agents. onejudge-cli is open source under the MIT license. onejudge-cli is available on the command line.
Nick DeRobertis builds and maintains onejudge-cli, and the product first shipped in 2026. Development happens publicly on GitHub with 29 commits in the last 90 days. Key capabilities include simulated conversations, transcript scoring, and command-line interface.
Latest indexed changes and source events
Other apps tracked under the same category.
