Who should use ai-eval-forge?

ai-eval-forge is an open-source project built for AI developers and researchers.

Is ai-eval-forge free?

Yes — ai-eval-forge is open source under the MIT license and free to use.

What platforms does ai-eval-forge run on?

ai-eval-forge runs on the web and the command line.

Is ai-eval-forge still maintained?

The GitHub repository shows 4 commits in the last 90 days.

What projects are similar to ai-eval-forge?

Similar projects tracked by PulseGate include agent-eval, evalforge, and AI Evaluator.

Who makes ai-eval-forge?

ai-eval-forge is developed by Mukunda Katta.

How long has ai-eval-forge been around?

ai-eval-forge first shipped in 2026.

Back to the index

ai-eval-forge

Name: ai-eval-forge
Author: Mukunda Katta

github.comInfrastructure

Zero-dependency eval harness for LLM and agent regression testing. Scores outputs with exact, contains, regex, JSON, citation, and token-F1 checks. Compares two runs to flag regressions.

Open SourceMITWebCLI

Visit github.com

1star

5features

2026since

Overview

5 features

ai-eval-forge sits in PulseGate's LLM eval & observability category. It focuses on automating regression testing and evaluation of LLM and agent outputs for developers and researchers. ai-eval-forge is an open-source project aimed at AI developers and researchers. The project is open source (MIT). It ships for the web and the command line.

It is developed by Mukunda Katta, and it first shipped in 2026. Development happens publicly on GitHub with 4 commits in the last 90 days. Key capabilities include regression testing, output scoring, and multiple check types.

Regression testing
Output scoring
Multiple check types
Run comparison
Zero dependencies

Built with & integrations

Runs on

BrowserCLI

Trust & compliance

License

MIT

Verified signals

HTTPSOpen SourceFree tierGitHub · ★ 1Active maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed16 Jun · 09:09 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about ai-eval-forge

What does ai-eval-forge do?: Ai-eval-forge focuses on automating regression testing and evaluation of LLM and agent outputs for developers and researchers. It is catalogued under LLM eval & observability on PulseGate.
Who should use ai-eval-forge?: ai-eval-forge is an open-source project built for AI developers and researchers.
Is ai-eval-forge free?: Yes — ai-eval-forge is open source under the MIT license and free to use.
What platforms does ai-eval-forge run on?: ai-eval-forge runs on the web and the command line.
Is ai-eval-forge still maintained?: The GitHub repository shows 4 commits in the last 90 days.
What projects are similar to ai-eval-forge?: Similar projects tracked by PulseGate include agent-eval, evalforge, and AI Evaluator.agent-eval evalforge AI Evaluator
Who makes ai-eval-forge?: ai-eval-forge is developed by Mukunda Katta.
How long has ai-eval-forge been around?: ai-eval-forge first shipped in 2026.

At a glance

Platforms: Cli
Languages: English
Open source: Yes · ★ 1
License: MIT
Built for: AI developers and researchers
Model: Open source
Solves: Automating regression testing and evaluation of LLM and agent outputs for developers and researchers.

Registered as

GitHub: MukundaKatta/ai-eval-forge
PyPI: ai-eval-forge

Developer

Mukunda Katta

Solo developer

GitHub

Open source

View on GitHub

Stars: 1
Forks: 0
Open issues: 4
Last commit: 13 Jun 2026
Commits 90d: 4
Contributors: 1
Authorship: Solo
Default branch: main
Latest release: v0.2.0 · 24 Apr 2026

Index record

Identity confidence: Medium · 77.4
Indexed: 16 Jun 2026
Lifecycle: Alive
Last seen: 16 Jun 2026

Identity audit (12)

Slug: ai-eval-forge-pypi-org
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 16 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Written by a language model from the project's public pages.
Category from: Assigned by the 2026 taxonomy migration.
Summary from: Taken from the package registry entry.
Languages from: Detected by a language model from page content.
Canonical URL: https://github.com/MukundaKatta/ai-eval-forge

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do