evalint
evalint audits LLM evaluation sets by treating them like academic exams. It analyzes what the set can actually measure, identifies ineffective items, and evaluates overall test quality using psychometrics and reliability metrics. Available as a MIT-licensed Python package.
Open SourceMITCLI
Overview
3 featuresevalint sits in PulseGate's LLM eval & observability category. It focuses on identifying flaws, dead weight, and measurement gaps in LLM evaluation datasets before deployment. evalint is an open-source project aimed at developers. The project is open source (MIT). evalint is available on the command line.
Behind evalint is CAOShurong, and it first shipped in 2026. Development happens publicly on GitHub with 13 commits in the last 90 days. Key capabilities include Item Analysis, Reliability Metrics, and Test Quality Audit.
Summary written by a language model from the project’s public pages.
- Item Analysis
- Reliability Metrics
- Test Quality Audit
Tags
llm-evaluationbenchmark-auditpsychometricseval-quality
Built with & integrations
Runs on
CLI
Trust & compliance
License
MIT
Verified signals
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about evalint
- What is evalint?
- Evalint focuses on identifying flaws, dead weight, and measurement gaps in LLM evaluation datasets before deployment. It is catalogued under LLM eval & observability on PulseGate.
- Who is evalint for?
- evalint is an open-source project built for developers.
- Is evalint free?
- Yes — evalint is open source under the MIT license and free to use.
- What platforms does evalint run on?
- evalint runs on the command line.
- Is evalint still active?
- The GitHub repository shows 13 commits in the last 90 days.
- Who makes evalint?
- evalint is developed by CAOShurong.
- When did evalint launch?
- evalint first shipped in 2026.
- Is evalint open source?
- Yes — evalint is open source under the MIT license, developed on GitHub.
Similar apps
Closest matches by what these projects do