Who should use evalite?

evalite is an open-source project built for AI developers.

Does evalite have a free plan?

Yes — evalite is open source under the MIT license and free to use.

What platforms does evalite run on?

evalite runs on the command line. It can also be self-hosted.

Is evalite still maintained?

The GitHub repository shows 69 commits in the last 90 days.

What projects are similar to evalite?

Similar projects tracked by PulseGate include agent-eval, openagent-eval, and AgentEval.

evalite is developed by githyuvi.

Back to the index

evalite

Name: evalite
Author: githyuvi

PyPIInfrastructure

evalite is a lightweight, model-agnostic framework for evaluating AI agents. It provides developers with tools for defining evaluation tests and measuring agent behavior across models.

Open SourceMITCLISelf-hosted

Visit PyPI

Overview

4 features

evalite is a LLM eval & observability project. It focuses on evaluating AI agent behavior consistently across different models and test cases. It is built as an open-source project for AI developers. The project is open source (MIT). evalite is available on the command line, and it can be self-hosted.

It is developed by githyuvi, and it first shipped in 2026. Development happens publicly on GitHub with 69 commits in the last 90 days. Among its 4 catalogued features are agent evaluation, model agnostic, and evaluation metrics.

Summary written by a language model from the project’s public pages.

Agent evaluation
Model agnostic
Evaluation metrics
Test suites

Built with & integrations

Connectors

github

Runs on

CLISelf-hosted

Trust & compliance

License

MIT

Verified signals

HTTPSOpen SourceFree tierGitHubActive maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed18 Aug · 19:57 UTC
evalite verified against its public source
Source: PulseGate · Open

Frequently asked questions about evalite

What does evalite do?: Evalite focuses on evaluating AI agent behavior consistently across different models and test cases. It is catalogued under LLM eval & observability on PulseGate.
Who should use evalite?: evalite is an open-source project built for AI developers.
Does evalite have a free plan?: Yes — evalite is open source under the MIT license and free to use.
What platforms does evalite run on?: evalite runs on the command line. It can also be self-hosted.
Is evalite still maintained?: The GitHub repository shows 69 commits in the last 90 days.
What projects are similar to evalite?: Similar projects tracked by PulseGate include agent-eval, openagent-eval, and AgentEval.agent-eval openagent-eval AgentEval
Who makes evalite?: evalite is developed by githyuvi.
How long has evalite been around?: evalite first shipped in 2026.

At a glance

Platforms: Cli
Languages: English
Open source: Yes (GitHub)
License: MIT
First seen: 18 Aug 2026
Built for: AI developers
Model: Open source
Solves: Evaluating AI agent behavior consistently across different models and test cases.

Registered as

GitHub: githyuvi/evalite
PyPI: evalite

Developer

githyuvi

Solo developer

GitHub

Open source

View on GitHub

Stars: 0
Forks: 0
Open issues: 0
Last commit: 18 Aug 2026
Commits 90d: 69
Contributors: 1
Authorship: Solo
Default branch: main

Index record

Identity confidence: Low · 64
Indexed: 18 Aug 2026
Lifecycle: Alive
First seen: Aug 2026
Last seen: 18 Aug 2026

Identity audit (13)

Slug: evalite-pypi-org
Lifecycle state recorded: 18 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 18 Aug 2026
Timeline basis: Indexed-at chronology (no inferred launch/funding milestones).
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Last updated: 18 Aug 2026
Canonical URL: https://pypi.org/project/evalite

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do