Who should use ai-edge-eval?

ai-edge-eval is an open-source project built for AI researchers and ML engineers.

Does ai-edge-eval have a free plan?

Yes — ai-edge-eval is open source under the Apache-2.0 license and free to use.

What platforms does ai-edge-eval run on?

ai-edge-eval runs on the web and the command line. It can also be self-hosted.

Is ai-edge-eval still active?

The GitHub repository shows 26 commits in the last 90 days.

Who develops ai-edge-eval?

ai-edge-eval is developed by Google AI Edge.

How long has ai-edge-eval been around?

ai-edge-eval first shipped in 2026.

Is ai-edge-eval open source?

Yes — ai-edge-eval is open source under the Apache-2.0 license, developed on GitHub.

Back to the index

ai-edge-eval

Name: ai-edge-eval
Author: Google AI Edge

github.comInfrastructure

ai-edge-eval is an open-source evaluation framework and CLI tool for benchmarking LiteRT LM and native language models. It enables AI researchers and ML engineers to run local evaluations and compare model performance.

Open SourceApache-2.0WebCLISelf-hosted

Visit github.com

7stars

1fork

5features

2026since

Overview

5 features

In the LLM eval & observability space, ai-edge-eval takes a focused approach. It focuses on evaluating and benchmarking local language models and LiteRT LM models efficiently. It is built as an open-source project for AI researchers and ML engineers. The project is open source (Apache-2.0). ai-edge-eval is available on the web and the command line, and it can be self-hosted.

Behind ai-edge-eval is Google AI Edge, and it first shipped in 2026. The project is developed in the open on GitHub with 26 commits in the last 90 days. Key capabilities include model evaluation, CLI runner, and LiteRT LM support.

Summary written by a language model from the project’s public pages.

Model evaluation
CLI runner
LiteRT LM support
Native model support
Framework integration

Built with & integrations

Framework

FastAPI

Runs on

BrowserCLISelf-hosted

Trust & compliance

License

Apache-2.0

Verified signals

HTTPSOpen SourceFree tierGitHub · ★ 7Active maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed17 Jun · 23:14 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about ai-edge-eval

What is ai-edge-eval?: Ai-edge-eval focuses on evaluating and benchmarking local language models and LiteRT LM models efficiently. It is catalogued under LLM eval & observability on PulseGate.
Who should use ai-edge-eval?: ai-edge-eval is an open-source project built for AI researchers and ML engineers.
Does ai-edge-eval have a free plan?: Yes — ai-edge-eval is open source under the Apache-2.0 license and free to use.
What platforms does ai-edge-eval run on?: ai-edge-eval runs on the web and the command line. It can also be self-hosted.
Is ai-edge-eval still active?: The GitHub repository shows 26 commits in the last 90 days.
Who develops ai-edge-eval?: ai-edge-eval is developed by Google AI Edge.
How long has ai-edge-eval been around?: ai-edge-eval first shipped in 2026.
Is ai-edge-eval open source?: Yes — ai-edge-eval is open source under the Apache-2.0 license, developed on GitHub.

At a glance

Platforms: Cli
Languages: English
Open source: Yes · ★ 7
License: Apache-2.0
Built for: AI researchers and ML engineers
Model: Open source
Solves: Evaluating and benchmarking local language models and LiteRT LM models efficiently.

Registered as

GitHub: google-ai-edge/eval
PyPI: ai-edge-eval

Developer

Google AI Edge

Small team

GitHub

Open source

View on GitHub

Stars: 7
Forks: 1
Open issues: 3
Last commit: 15 Jun 2026
Commits 90d: 26
Contributors: 5
Authorship: Small team
Default branch: main

Index record

Identity confidence: Low · 64
Indexed: 17 Jun 2026
Lifecycle: Alive
Last seen: 17 Jun 2026

Identity audit (12)

Slug: ai-edge-eval-pypi-org
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 17 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Canonical URL: https://github.com/google-ai-edge/eval

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do