Skip to content
Back to the index

ai-edge-eval

github.comInfrastructure

PulseGate's liveness check found it on 9 Sep 2026; it is registered on GitHub and PyPI and has been in the index since 17 Jun 2026. How this is checked

ai-edge-eval is an open-source evaluation framework and CLI tool for benchmarking LiteRT LM and native language models. It enables AI researchers and ML engineers to run local evaluations and compare model performance.

Inferred · not functionally tested

Open SourceApache-2.0WebCLISelf-hosted
ai-edge-eval preview
Visit github.com
7stars
1fork
5features
2026since

Overview

5 features

Purpose: Evaluating and benchmarking local language models and LiteRT LM models efficiently.

Inferred · not functionally tested

Audience: AI researchers and ML engineers

Inferred · not functionally tested

Functions: analytics

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: indicated (inferred, not tested)

Recorded constraints: pricing: open_source · license: Apache-2.0 · platforms: CLI · deployment: browser, cli, self_hosted

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: github.com. These links do not verify the individual claims.

In the LLM evaluation & benchmarks space, ai-edge-eval takes a focused approach. Inferred · not functionally tested: It focuses on evaluating and benchmarking local language models and LiteRT LM models efficiently. Inferred · not functionally tested: It is built as an open-source project for AI researchers and ML engineers. Basis unknown · not verified: The project is open source (Apache-2.0). Basis unknown · not verified: ai-edge-eval is available on the web and the command line, and it can be self-hosted.

Behind ai-edge-eval is Google AI Edge, and it first shipped in 2026. The project is developed in the open on GitHub with 26 commits in the last 90 days. Inferred · not functionally tested: Key capabilities include model evaluation, CLI runner, and LiteRT LM support.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Model evaluation
  • CLI runner
  • LiteRT LM support
  • Native model support
  • Framework integration

Topics: Inferred · not functionally tested

Tags
model-evaluationlocal-inferencelanguagemodel-benchmark
AI capabilities
Text
Inference: LocalWeights: Open

JSON profile · Text profile · Access guide

Built with & integrations

Framework
FastAPI
AI providers
local_oss
Runs on
BrowserCLISelf-hosted

Trust & compliance

License
Apache-2.0
Public signals
HTTPSOpen SourceFree tierGitHub · ★ 7Active maintenance

Indexing history

What PulseGate has recorded for this listing

Nothing recorded for this listing in this window.

Frequently asked questions about ai-edge-eval

What is ai-edge-eval?
Inferred · not functionally tested: Ai-edge-eval focuses on evaluating and benchmarking local language models and LiteRT LM models efficiently. It is catalogued under LLM evaluation & benchmarks on PulseGate.
Who should use ai-edge-eval?
Inferred · not functionally tested: ai-edge-eval is an open-source project built for AI researchers and ML engineers.
Does ai-edge-eval have a free plan?
Basis unknown · not verified: Yes — ai-edge-eval is open source under the Apache-2.0 license and free to use.
What platforms does ai-edge-eval run on?
Basis unknown · not verified: ai-edge-eval runs on the web and the command line. It can also be self-hosted.
Is ai-edge-eval still active?
PulseGate's liveness check found it on 9 Sep 2026. Its GitHub repository shows 26 commits in the last 90 days.
What are alternatives to ai-edge-eval?
Similar projects tracked by PulseGate include edge-ai-lab, ai-eval-forge, and evalite.edge-ai-labai-eval-forgeevalite
Who develops ai-edge-eval?
ai-edge-eval is developed by Google AI Edge.
How long has ai-edge-eval been around?
ai-edge-eval first shipped in 2026.

Similar projects

Closest matches by what these projects do