inspect-evals
inspect-evals is an open-source command-line tool for evaluating large language models against a collection of benchmarks. It helps AI researchers and engineers assess model performance using standardized metrics and workflows. The tool is MIT licensed and maintained by UKGovernmentBEIS.
Overview
4 featuresinspect-evals sits in PulseGate's LLM evaluation & benchmarks category. It focuses on evaluating and benchmarking large language models efficiently using standardized metrics. It is built as an open-source project for AI researchers and ML engineers. The project is open source (MIT). It runs on the command line.
It is developed by UKGovernmentBEIS, and it first shipped in 2024. The project is developed in the open on GitHub with 561 stars and 296 commits in the last 90 days. Key capabilities include model evaluation, benchmarking, and CLI interface.
Summary written by a language model from the project’s public pages.
- Model evaluation
- Benchmarking
- CLI interface
- MIT licensed
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about inspect-evals
- What is inspect-evals?
- Inspect-evals focuses on evaluating and benchmarking large language models efficiently using standardized metrics. It is catalogued under LLM evaluation & benchmarks on PulseGate.
- Who is inspect-evals for?
- inspect-evals is an open-source project built for AI researchers and ML engineers.
- Is inspect-evals free?
- Yes — inspect-evals is open source under the MIT license and free to use.
- What platforms does inspect-evals run on?
- inspect-evals runs on the command line.
- Is inspect-evals still active?
- The GitHub repository shows 296 commits in the last 90 days.
- What projects are similar to inspect-evals?
- Similar projects tracked by PulseGate include inspect-ai, tool-eval, and evalflow.inspect-aitool-evalevalflow
- Who develops inspect-evals?
- inspect-evals is developed by UKGovernmentBEIS.
- How long has inspect-evals been around?
- inspect-evals first shipped in 2024.
Similar projects
Closest matches by what these projects do