rubric-eval
rubric-eval is an open-source CLI tool for testing and evaluating the behavior of agents in LLM applications. It auto-captures agent runs, integrates with evaluation tools, and helps developers catch regressions in CI pipelines. The tool is designed for developers working with AI agents and LLMs.
Overview
5 featuresIn the Agent evaluation & testing space, rubric-eval takes a focused approach. It focuses on testing and evaluating agent behavior in LLM-powered applications. It is built as an open-source project for developers building and testing LLM agent apps. The project is open source (MIT). rubric-eval is available on the command line.
It is developed by Kareem-Rashed, and it first shipped in 2026. The project is developed in the open on GitHub with 13 stars and 5 commits in the last 90 days. Key capabilities include agent run capture, eval tool integration, and regression testing. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
- Agent run capture
- Eval tool integration
- Regression testing
- CI integration
- Trace analysis
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about rubric-eval
- What is rubric-eval?
- Rubric-eval focuses on testing and evaluating agent behavior in LLM-powered applications. It is catalogued under Agent evaluation & testing on PulseGate.
- Who should use rubric-eval?
- rubric-eval is an open-source project built for developers building and testing LLM agent apps.
- Does rubric-eval have a free plan?
- Yes — rubric-eval is open source under the MIT license and free to use.
- What platforms does rubric-eval run on?
- rubric-eval runs on the command line.
- Is rubric-eval still active?
- The GitHub repository shows 5 commits in the last 90 days.
- What are alternatives to rubric-eval?
- Similar projects tracked by PulseGate include Rubricon, rubric-studio, and rubric_llm.Rubriconrubric-studiorubric_llm
- Who makes rubric-eval?
- rubric-eval is developed by Kareem-Rashed.
- How long has rubric-eval been around?
- rubric-eval first shipped in 2026.
Similar projects
Closest matches by what these projects do