Skip to content
Back to the index

evalforge

PyPIInfrastructure

PulseGate's liveness check found it on 9 Sep 2026; it is registered on PyPI and has been in the index since 25 Jun 2026. How this is checked

evalforge is an open-source CLI harness for evaluating LLM agents, designed to work across different frameworks. It helps AI researchers and developers assess agent performance and behavior.

Inferred · not functionally tested

Open SourceMITWebCLI
Visit PyPI

Overview

3 features

Purpose: Provides a standardized way to evaluate LLM agents across different frameworks.

Inferred · not functionally tested

Audience: ai researchers

Inferred · not functionally tested

Functions: analytics, monitoring

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: unknown

Recorded constraints: pricing: open_source · license: MIT · platforms: CLI · deployment: browser, cli

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: pypi.org. These links do not verify the individual claims.

evalforge sits in PulseGate's Agent evaluation & testing category. Inferred · not functionally tested: It provides a standardized way to evaluate LLM agents across different frameworks. Inferred · not functionally tested: evalforge is an open-source project aimed at ai researchers. Basis unknown · not verified: The project is open source (MIT). Basis unknown · not verified: It ships for the web and the command line.

evalforge first shipped in 2026. Inferred · not functionally tested: Among its 3 catalogued features are LLM agent evaluation, framework agnostic, and CLI harness.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • LLM agent evaluation
  • Framework agnostic
  • CLI harness

Topics: Inferred · not functionally tested

Tags
llm-evaluationagent-testingframework-agnostic
AI capabilities
TextCode

JSON profile · Text profile · Access guide

Built with & integrations

Runs on
BrowserCLI

Trust & compliance

License
MIT
Public signals
HTTPSOpen SourceFree tier

Indexing history

What PulseGate has recorded for this listing

Nothing recorded for this listing in this window.

Frequently asked questions about evalforge

What does evalforge do?
Inferred · not functionally tested: Evalforge provides a standardized way to evaluate LLM agents across different frameworks. It is catalogued under Agent evaluation & testing on PulseGate.
Who is evalforge for?
Inferred · not functionally tested: evalforge is an open-source project built for ai researchers.
Does evalforge have a free plan?
Basis unknown · not verified: Yes — evalforge is open source under the MIT license and free to use.
What platforms does evalforge run on?
Basis unknown · not verified: evalforge runs on the web and the command line.
Is evalforge still active?
PulseGate's liveness check found it on 9 Sep 2026.
What projects are similar to evalforge?
Similar projects tracked by PulseGate include ai-eval-forge, evalflow, and envforge-agent.ai-eval-forgeevalflowenvforge-agent
How long has evalforge been around?
evalforge first shipped in 2026.
Is evalforge open source?
Basis unknown · not verified: Yes — evalforge is open source under the MIT license.

Similar projects

Closest matches by what these projects do