reqfence is an open-source CLI tool that acts as a regression firewall for AI agents. It replays saved agent traces and flags regressions by verifying requirements, not just text differences. Designed for developers and teams evaluating LLM agents in CI pipelines, it outputs PASS, FAIL, or UNCERTAIN for each test.
reqfence is a LLM eval & observability product. It focuses on detecting regressions in AI agent behavior by replaying traces and checking against requirements instead of text diffs. It is built as an open-source project for developers. reqfence is open source under the MIT license. The product ships for the command line, and it can be self-hosted.
It is developed by Ayush Singh, and the product first shipped in 2026. PulseGate's similarity index finds few close equivalents — reqfence occupies a relatively distinct niche. Key capabilities include regression testing, agent trace replay, and requirement-based checks.
Latest indexed changes and source events
Other apps tracked under the same category.