proofrag
proofrag is an open-source command-line tool for evaluating RAG applications and agents against documentation. It generates golden test sets and produces LLM-as-judge and retrieval scorecards for developers.
Overview
6 featuresproofrag is an Agent evaluation & testing project. It focuses on evaluating RAG retrieval quality and agent answers without manually creating test sets or scorecards. It is built as an open-source project for AI and RAG developers. The project is open source (MIT). It runs on the command line, and it can be self-hosted.
unshDee builds and maintains proofrag, and it first shipped in 2026. The project is developed in the open on GitHub with 32 commits in the last 90 days. Key capabilities include golden test sets, LLM-as-judge, and retrieval scoring.
Summary written by a language model from the project’s public pages.
- Golden test sets
- LLM-as-judge
- Retrieval scoring
- RAG evaluation
- Agent evaluation
- Scorecards
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about proofrag
- What does proofrag do?
- Proofrag focuses on evaluating RAG retrieval quality and agent answers without manually creating test sets or scorecards. It is catalogued under Agent evaluation & testing on PulseGate.
- Who is proofrag for?
- proofrag is an open-source project built for AI and RAG developers.
- Does proofrag have a free plan?
- Yes — proofrag is open source under the MIT license and free to use.
- What platforms does proofrag run on?
- proofrag runs on the command line. It can also be self-hosted.
- Is proofrag still active?
- The GitHub repository shows 32 commits in the last 90 days.
- What are alternatives to proofrag?
- Similar projects tracked by PulseGate include ragscore, ragops, and ragi-toolkit.ragscoreragopsragi-toolkit
- Who makes proofrag?
- proofrag is developed by unshDee.
- How long has proofrag been around?
- proofrag first shipped in 2026.
Similar projects
Closest matches by what these projects do