regress-ai
regress-ai is an open-source Python package that automatically converts failures encountered by LLM agents in production into a growing regression test suite. It integrates with OpenTelemetry for observability and helps developers ensure their agents become more reliable over time without manual test writing. Primarily used by AI engineers and agent developers building production LLM systems.
Open SourceApache-2.0CLIAPI
1star
4features
2026since
Overview
4 featuresIn the LLM eval & observability space, regress-ai takes a focused approach. Manually maintaining regression tests for LLM agent behavior in production. It is built as an open-source project for developers. regress-ai is open source under the Apache-2.0 license. It ships for the command line and API.
Arshad Vani builds and maintains regress-ai, and it first shipped in 2026. The project is developed in the open on GitHub with 81 commits in the last 90 days. Among its 4 catalogued features are Automatic Regression Suite, Production Failure Capture, and OpenTelemetry Integration. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
- Automatic Regression Suite
- Production Failure Capture
- OpenTelemetry Integration
- LLM Agent Evals
Tags
llm-regression-testingagent-evalsproduction-observabilityauto-test-generation
AI capabilities
Text
Built with & integrations
Framework
FastAPI
AI providers
anthropicopenai
Connectors
API
Runs on
CLIAPI-only
Trust & compliance
License
Apache-2.0
Verified signals
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about regress-ai
- What does regress-ai do?
- Manually maintaining regression tests for LLM agent behavior in production. It is catalogued under LLM eval & observability on PulseGate.
- Who should use regress-ai?
- regress-ai is an open-source project built for developers.
- Does regress-ai have a free plan?
- Yes — regress-ai is open source under the Apache-2.0 license and free to use.
- What platforms does regress-ai run on?
- regress-ai runs on the command line and API.
- Is regress-ai still active?
- The GitHub repository shows 81 commits in the last 90 days.
- What projects are similar to regress-ai?
- Similar projects tracked by PulseGate include agent-regress-cli, redline-ai, and regrada.agent-regress-cliredline-airegrada
- Who makes regress-ai?
- regress-ai is developed by Arshad Vani.
- When did regress-ai launch?
- regress-ai first shipped in 2026.
Similar apps
Closest matches by what these projects do