Skip to content
Back to the index

AI-Evals

ai-evals.ioAgent evaluation & testing

PulseGate's liveness check found it on 13 Sep 2026; it is registered on GitHub and has been in the index since 28 Jun 2026. How this is checked

AI-Evals.io describes evals as automated checks on AI outputs, ranging from simple keyword matching to LLM-as-judge. It presents them as a way to make proof-of-concept work verifiable, keep quality from fading over time, reduce manual checking, and give teams more confidence when using AI tools.

Inferred · not functionally tested

FreeApache-2.0WebCloud-managed
AI-Evals preview
Visit ai-evals.io
6stars
5features
2026since

Overview

5 features

Purpose: Enables users to reliably evaluate and compare AI system outputs without manual checking.

Inferred · not functionally tested

Audience: software engineers

Inferred · not functionally tested

Functions: analytics, monitoring

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: unknown · Self-hosting: unknown

Recorded constraints: pricing: free · license: Apache-2.0 · platforms: WEB · deployment: browser, cloud_managed

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: ai-evals.io · github.com. These links do not verify the individual claims.

In the Agent evaluation & testing space, AI-Evals takes a focused approach. Inferred · not functionally tested: It enables users to reliably evaluate and compare AI system outputs without manual checking. Inferred · not functionally tested: AI-Evals is a B2B product aimed at software engineers. Basis unknown · not verified: It is available for free. Basis unknown · not verified: AI-Evals is available on the web.

AI-Evals first shipped in 2026. The project is developed in the open on GitHub with 4 commits in the last 90 days. Inferred · not functionally tested: Key capabilities include automated evaluation, output comparison, and custom evals.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Automated evaluation
  • Output comparison
  • Custom evals
  • Result visualization
  • Community sharing

Topics: Inferred · not functionally tested

Tags
ai-evaluationllm-benchmarkingoutput-comparisoneval-dashboard
AI capabilities
Text

JSON profile · Text profile · Access guide

Built with & integrations

Runs on
BrowserCloud-managed

Trust & compliance

License
Apache-2.0
Public signals
HTTPSFree tierGitHub · ★ 6Active maintenance

Indexing history

What PulseGate has recorded for this listing

Nothing recorded for this listing in this window.

Frequently asked questions about AI-Evals

What is AI-Evals?
Inferred · not functionally tested: AI-Evals enables users to reliably evaluate and compare AI system outputs without manual checking. It is catalogued under Agent evaluation & testing on PulseGate.
Who is AI-Evals for?
Inferred · not functionally tested: AI-Evals is a B2B product built for software engineers.
Is AI-Evals free?
Basis unknown · not verified: Yes — AI-Evals is free to use.
What platforms does AI-Evals run on?
Basis unknown · not verified: AI-Evals runs on the web.
Is AI-Evals still active?
PulseGate's liveness check found it on 13 Sep 2026. Its GitHub repository shows 4 commits in the last 90 days.
What are alternatives to AI-Evals?
Similar projects tracked by PulseGate include AI Evaluator, AgentEvals, and EvalsHub AI.AI EvaluatorAgentEvalsEvalsHub AI
How long has AI-Evals been around?
AI-Evals first shipped in 2026.
Is AI-Evals open source?
Basis unknown · not verified: AI-Evals has a public GitHub repository.

Similar projects

Closest matches by what these projects do