hydrag-benchmark
hydrag-benchmark is an open-source CLI tool for locally benchmarking retrieval-augmented generation (RAG) systems. It provides metrics such as recall, MRR, chunk overlap, latency, and BEIR IR, helping AI researchers evaluate and compare RAG pipelines.
Open SourceApache-2.0CLI
Overview
5 featureshydrag-benchmark sits in PulseGate's LLM eval & observability category. It focuses on measuring and benchmarking retrieval-augmented generation (RAG) systems locally for developers and researchers. It is built as an open-source project for AI researchers. The project is open source (Apache-2.0). It ships for the command line.
hydrag-benchmark first shipped in 2026. Development happens publicly on GitHub with 6 commits in the last 90 days. Key capabilities include RAG benchmarking, recall measurement, and MRR calculation.
Summary written by a language model from the project’s public pages.
- RAG benchmarking
- Recall measurement
- MRR calculation
- Chunk overlap analysis
- Latency metrics
Tags
rag-benchmarkinglocal-evaluationbeir-metrics
AI capabilities
Structured
Weights: Open
Built with & integrations
Runs on
CLI
Trust & compliance
License
Apache-2.0
Verified signals
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about hydrag-benchmark
- What is hydrag-benchmark?
- Hydrag-benchmark focuses on measuring and benchmarking retrieval-augmented generation (RAG) systems locally for developers and researchers. It is catalogued under LLM eval & observability on PulseGate.
- Who should use hydrag-benchmark?
- hydrag-benchmark is an open-source project built for AI researchers.
- Is hydrag-benchmark free?
- Yes — hydrag-benchmark is open source under the Apache-2.0 license and free to use.
- What platforms does hydrag-benchmark run on?
- hydrag-benchmark runs on the command line.
- Is hydrag-benchmark still active?
- The GitHub repository shows 6 commits in the last 90 days.
- When did hydrag-benchmark launch?
- hydrag-benchmark first shipped in 2026.
- Is hydrag-benchmark open source?
- Yes — hydrag-benchmark is open source under the Apache-2.0 license, developed on GitHub.
Similar apps
Closest matches by what these projects do