What does caliper-eval do?

Enabling developers to evaluate and benchmark Claude Code skills and AI agents via the command line. It is catalogued under LLM eval & observability on PulseGate.

Who should use caliper-eval?

caliper-eval is an open-source project built for AI developers and researchers.

Does caliper-eval have a free plan?

Yes — caliper-eval is open source under the MIT license and free to use.

What platforms does caliper-eval run on?

caliper-eval runs on the command line.

Is caliper-eval still active?

The GitHub repository shows 108 commits in the last 90 days.

What projects are similar to caliper-eval?

Similar projects tracked by PulseGate include agent-skill-eval, coder-eval, and caliper-ai.

Who develops caliper-eval?

caliper-eval is developed by edonadei.

When did caliper-eval launch?

caliper-eval first shipped in 2026.

Back to the index

caliper-eval

Name: caliper-eval
Author: edonadei

PyPIInfrastructure

caliper-eval is an open-source CLI tool designed for evaluating Claude Code skills and AI agents. It provides developers and researchers with tools to assess and benchmark AI agent performance from the command line.

Open SourceMITCLI

Visit PyPI

23stars

3forks

5features

2026since

Overview

5 features

caliper-eval is a LLM eval & observability project. Enabling developers to evaluate and benchmark Claude Code skills and AI agents via the command line. caliper-eval is an open-source project aimed at AI developers and researchers. The project is open source (MIT). caliper-eval is available on the command line.

edonadei builds and maintains caliper-eval, and it first shipped in 2026. The project is developed in the open on GitHub with 23 stars and 108 commits in the last 90 days. Among its 5 catalogued features are AI evaluation, Claude Code skills, and agent testing.

Summary written by a language model from the project’s public pages.

AI evaluation
Claude Code skills
Agent testing
CLI interface
Skill assessment

Built with & integrations

AI providers

anthropic

Runs on

CLI

Trust & compliance

License

MIT

Verified signals

HTTPSOpen SourceFree tierGitHub · ★ 23Active maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed3 Jul · 16:46 UTC
caliper-eval verified against its public source
Source: PulseGate · Open

Frequently asked questions about caliper-eval

What does caliper-eval do?: Enabling developers to evaluate and benchmark Claude Code skills and AI agents via the command line. It is catalogued under LLM eval & observability on PulseGate.
Who should use caliper-eval?: caliper-eval is an open-source project built for AI developers and researchers.
Does caliper-eval have a free plan?: Yes — caliper-eval is open source under the MIT license and free to use.
What platforms does caliper-eval run on?: caliper-eval runs on the command line.
Is caliper-eval still active?: The GitHub repository shows 108 commits in the last 90 days.
What projects are similar to caliper-eval?: Similar projects tracked by PulseGate include agent-skill-eval, coder-eval, and caliper-ai.agent-skill-eval coder-eval caliper-ai
Who develops caliper-eval?: caliper-eval is developed by edonadei.
When did caliper-eval launch?: caliper-eval first shipped in 2026.

At a glance

Platforms: Cli
Languages: English
Open source: Yes · ★ 23
License: MIT
First seen: 3 Jul 2026
Built for: AI developers and researchers
Model: Open source
Solves: Enabling developers to evaluate and benchmark Claude Code skills and AI agents via the command line.

Registered as

GitHub: edonadei/caliper
PyPI: caliper-eval

Developer

edonadei

Small team

GitHub

Open source

View on GitHub

Stars: 23
Forks: 3
Open issues: 8
Last commit: 3 Jul 2026
Commits 90d: 108
Contributors: 3
Authorship: Small team
Default branch: main
Latest release: v0.6.0 · 3 Jul 2026

Index record

Identity confidence: Low · 64
Indexed: 3 Jul 2026
Lifecycle: Alive
First seen: Jul 2026
Last seen: 3 Jul 2026

Identity audit (12)

Slug: caliper-eval-pypi-org
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 3 Jul 2026
Timeline basis: Indexed-at chronology (no inferred launch/funding milestones).
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Canonical URL: https://pypi.org/project/caliper-eval

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do