What does evalforge do?

Evalforge provides a standardized way to evaluate LLM agents across different frameworks. It is catalogued under LLM eval & observability on PulseGate.

Who is evalforge for?

evalforge is an open-source project built for ai researchers.

Does evalforge have a free plan?

Yes — evalforge is open source under the MIT license and free to use.

What platforms does evalforge run on?

evalforge runs on the web and the command line.

Is evalforge still active?

Unverified. evalforge has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.

What projects are similar to evalforge?

Similar projects tracked by PulseGate include ai-eval-forge, evalflow, and envforge-agent.

Is evalforge open source?

Yes — evalforge is open source under the MIT license.

Back to the index

evalforge

PyPIInfrastructure

evalforge is an open-source CLI harness for evaluating LLM agents, designed to work across different frameworks. It helps AI researchers and developers assess agent performance and behavior.

Open SourceMITWebCLI

Visit PyPI

Overview

3 features

evalforge sits in PulseGate's LLM eval & observability category. It provides a standardized way to evaluate LLM agents across different frameworks. evalforge is an open-source project aimed at ai researchers. The project is open source (MIT). It ships for the web and the command line.

evalforge first shipped in 2026. Among its 3 catalogued features are LLM agent evaluation, framework agnostic, and CLI harness.

Summary written by a language model from the project’s public pages.

LLM agent evaluation
Framework agnostic
CLI harness

Built with & integrations

Runs on

BrowserCLI

Trust & compliance

License

MIT

Verified signals

HTTPSOpen SourceFree tier

Indexing history

What PulseGate has recorded for this listing

Indexed25 Jun · 16:36 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about evalforge

What does evalforge do?: Evalforge provides a standardized way to evaluate LLM agents across different frameworks. It is catalogued under LLM eval & observability on PulseGate.
Who is evalforge for?: evalforge is an open-source project built for ai researchers.
Does evalforge have a free plan?: Yes — evalforge is open source under the MIT license and free to use.
What platforms does evalforge run on?: evalforge runs on the web and the command line.
Is evalforge still active?: Unverified. evalforge has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
What projects are similar to evalforge?: Similar projects tracked by PulseGate include ai-eval-forge, evalflow, and envforge-agent.ai-eval-forge evalflow envforge-agent
How long has evalforge been around?: evalforge first shipped in 2026.
Is evalforge open source?: Yes — evalforge is open source under the MIT license.

At a glance

Platforms: Cli
Languages: English
License: MIT
Built for: ai researchers
Model: Open source
Solves: Provides a standardized way to evaluate LLM agents across different frameworks.

Registered as

PyPI: evalforge

Developer

Pypi

Index record

Identity confidence: Low · 64
Indexed: 25 Jun 2026
Lifecycle: Alive
Last seen: 25 Jun 2026

Identity audit (12)

Slug: evalforge-pypi-org
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 25 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Canonical URL: https://pypi.org/project/evalforge

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do