Who is Model Evaluator for?

Model Evaluator is an open-source project built for machine learning engineers.

Does Model Evaluator have a free plan?

Yes — Model Evaluator is free to use.

What platforms does Model Evaluator run on?

Model Evaluator runs on the web. It can also be self-hosted.

Is Model Evaluator still maintained?

Unverified. Model Evaluator has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.

Who makes Model Evaluator?

Model Evaluator is developed by autoevaluate.

When did Model Evaluator launch?

Model Evaluator first shipped in 2022.

Back to the index

Model Evaluator

Name: Model Evaluator
Author: autoevaluate

huggingface.coInfrastructure

Model Evaluator is a Hugging Face Space developed by autoevaluate that allows users to run standardized evaluations on uploaded or selected models. It computes metrics across tasks and datasets, enabling direct comparison of model performance. The tool is primarily used by ML practitioners to validate models before deployment or publication.

FreeWebSelf-hostedCloud-managed

Visit huggingface.co

Overview

4 features

In the LLM eval & observability space, Model Evaluator takes a focused approach. Systematically evaluating and comparing the quality of different machine learning models across standardized benchmarks. It is built as an open-source project for machine learning engineers. It is available for free. It runs on the web, and it can be self-hosted.

Behind Model Evaluator is autoevaluate, and it first shipped in 2022. Key capabilities include model benchmarking, performance metrics, and dataset evaluation.

Summary written by a language model from the project’s public pages.

Model benchmarking
Performance metrics
Dataset evaluation
Comparison tools

Built with & integrations

Hosting

AWS

AI providers

local_oss

Runs on

BrowserSelf-hostedCloud-managed

Detected from

AWS: x-amz-cf-id header · x-amz-cf-pop header · via header
local_oss: huggingface in the HTML

Trust & compliance

Verified signals

HTTPSFree tier

Indexing history

What PulseGate has recorded for this listing

Indexed21 Jul · 19:47 UTC
autoevaluate/model-evaluator verified against its public source
Source: PulseGate · Open

Frequently asked questions about Model Evaluator

What does Model Evaluator do?: Systematically evaluating and comparing the quality of different machine learning models across standardized benchmarks. It is catalogued under LLM eval & observability on PulseGate.
Who is Model Evaluator for?: Model Evaluator is an open-source project built for machine learning engineers.
Does Model Evaluator have a free plan?: Yes — Model Evaluator is free to use.
What platforms does Model Evaluator run on?: Model Evaluator runs on the web. It can also be self-hosted.
Is Model Evaluator still maintained?: Unverified. Model Evaluator has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
Who makes Model Evaluator?: Model Evaluator is developed by autoevaluate.
When did Model Evaluator launch?: Model Evaluator first shipped in 2022.

At a glance

Platforms: Web
Languages: English
Built for: machine learning engineers
Model: Open source
Solves: Systematically evaluating and comparing the quality of different machine learning models across standardized benchmarks.

Registered as

Hugging Face Spaces: autoevaluate/model-evaluator

Developer

autoevaluate

Live coverage

Identity confidence: High · 86
Indexed: 21 Jul 2026
Lifecycle: Alive
Last seen: 21 Jul 2026

Identity audit (13)

Slug: autoevaluate-model-evaluator-huggingface-co
Lifecycle state recorded: 21 Jul 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 21 Jul 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Derived from the project's own page and URL.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Last updated: 2 Aug 2026
Canonical URL: https://huggingface.co/spaces/autoevaluate/model-evaluator

Ship this? Send a correction — no account, and you get a link to follow it.

Similar apps

Closest matches by what these projects do