Skip to content
Back to the index

evalite

PyPIInfrastructure

PulseGate's liveness check found it on 3 Oct 2026; it is registered on GitHub and PyPI and has been in the index since 18 Aug 2026. How this is checked

evalite is a lightweight, model-agnostic framework for evaluating AI agents. It provides developers with tools for defining evaluation tests and measuring agent behavior across models.

Inferred · not functionally tested

Open SourceMITCLISelf-hosted
Visit PyPI

Overview

4 features

Purpose: Evaluating AI agent behavior consistently across different models and test cases.

Inferred · not functionally tested

Audience: AI developers

Inferred · not functionally tested

Functions: analytics

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: indicated (inferred, not tested)

Recorded constraints: pricing: open_source · license: MIT · platforms: CLI · deployment: cli, self_hosted

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: pypi.org · github.com. These links do not verify the individual claims.

evalite is an Agent evaluation & testing project. Inferred · not functionally tested: It focuses on evaluating AI agent behavior consistently across different models and test cases. Inferred · not functionally tested: It is built as an open-source project for AI developers. Basis unknown · not verified: The project is open source (MIT). Basis unknown · not verified: evalite is available on the command line, and it can be self-hosted.

It is developed by githyuvi, and it first shipped in 2026. Development happens publicly on GitHub with 69 commits in the last 90 days. Inferred · not functionally tested: Among its 4 catalogued features are agent evaluation, model agnostic, and evaluation metrics.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Agent evaluation
  • Model agnostic
  • Evaluation metrics
  • Test suites

Topics: Inferred · not functionally tested

Tags
agent-evaluationllm-testingmodel-agnosticevaluation-framework

JSON profile · Text profile · Access guide

Built with & integrations

Connectors
github
Runs on
CLISelf-hosted

Trust & compliance

License
MIT
Public signals
HTTPSOpen SourceFree tierGitHubActive maintenance

Indexing history

1

What PulseGate has recorded for this listing

  1. Indexed18 Aug · 19:57 UTC
    evalite seen via PyPI Bulk Enumerator
    Source: PyPI Bulk Enumerator · Open

Frequently asked questions about evalite

What does evalite do?
Inferred · not functionally tested: Evalite focuses on evaluating AI agent behavior consistently across different models and test cases. It is catalogued under Agent evaluation & testing on PulseGate.
Who should use evalite?
Inferred · not functionally tested: evalite is an open-source project built for AI developers.
Does evalite have a free plan?
Basis unknown · not verified: Yes — evalite is open source under the MIT license and free to use.
What platforms does evalite run on?
Basis unknown · not verified: evalite runs on the command line. It can also be self-hosted.
Is evalite still maintained?
PulseGate's liveness check found it on 3 Oct 2026. Its GitHub repository shows 69 commits in the last 90 days.
What projects are similar to evalite?
Similar projects tracked by PulseGate include EvalView, agent-eval, and openagent-eval.EvalViewagent-evalopenagent-eval
Who makes evalite?
evalite is developed by githyuvi.
How long has evalite been around?
evalite first shipped in 2026.

Similar projects

Closest matches by what these projects do