Who should use Open VLM Leaderboard?

Open VLM Leaderboard is a B2B product built for AI researchers and ML practitioners.

Is Open VLM Leaderboard free?

Yes — Open VLM Leaderboard is free to use.

What platforms does Open VLM Leaderboard run on?

Open VLM Leaderboard runs on the web. It can also be self-hosted.

Is Open VLM Leaderboard still active?

The GitHub repository shows 43 commits in the last 90 days.

What projects are similar to Open VLM Leaderboard?

Similar projects tracked by PulseGate include Open VLM Video Leaderboard, Open LLM Leaderboard, and OpenCompass LLM Leaderboard.

Who develops Open VLM Leaderboard?

Open VLM Leaderboard is developed by opencompass.

How long has Open VLM Leaderboard been around?

Open VLM Leaderboard first shipped in 2023.

Back to the index

Open VLM Leaderboard

Name: Open VLM Leaderboard
Author: opencompass

huggingface.coLLM eval & observability

Open VLM Leaderboard is a web application that allows users to view, filter, and compare the performance of vision-language models on various datasets and evaluation metrics. It is designed for AI researchers and practitioners to benchmark and analyze model results interactively.

FreeApache-2.0WebSelf-hostedCloud-managed

Visit huggingface.co

4.3kstars

730forks

5features

2023since

Overview

5 features

In the LLM eval & observability space, Open VLM Leaderboard takes a focused approach. It focuses on comparing and tracking the performance of vision-language models across datasets and evaluation metrics. Open VLM Leaderboard is a B2B product aimed at AI researchers and ML practitioners. Open VLM Leaderboard is free to use. It runs on the web, and it can be self-hosted.

Behind Open VLM Leaderboard is opencompass, and it first shipped in 2023. Development happens publicly on GitHub with 4.3k stars and 43 commits in the last 90 days. Key capabilities include leaderboard, model comparison, and interactive filters.

Summary written by a language model from the project’s public pages.

Leaderboard
Model comparison
Interactive filters
Dataset selection
Evaluation metrics

Built with & integrations

Hosting

AWS

AI providers

local_ossopenai

Runs on

BrowserSelf-hostedCloud-managed

Detected from

AWS: x-amz-cf-id header · x-amz-cf-pop header · via header
local_oss: huggingface in the HTML

Trust & compliance

License

Apache-2.0

Verified signals

HTTPSFree tierGitHub · ★ 4.3kActive maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed10 Jul · 11:21 UTC
open-compass/VLMEvalKit verified against its public source
Source: PulseGate · Open

Frequently asked questions about Open VLM Leaderboard

What does Open VLM Leaderboard do?: Open VLM Leaderboard focuses on comparing and tracking the performance of vision-language models across datasets and evaluation metrics. It is catalogued under LLM eval & observability on PulseGate.
Who should use Open VLM Leaderboard?: Open VLM Leaderboard is a B2B product built for AI researchers and ML practitioners.
Is Open VLM Leaderboard free?: Yes — Open VLM Leaderboard is free to use.
What platforms does Open VLM Leaderboard run on?: Open VLM Leaderboard runs on the web. It can also be self-hosted.
Is Open VLM Leaderboard still active?: The GitHub repository shows 43 commits in the last 90 days.
What projects are similar to Open VLM Leaderboard?: Similar projects tracked by PulseGate include Open VLM Video Leaderboard, Open LLM Leaderboard, and OpenCompass LLM Leaderboard.Open VLM Video Leaderboard Open LLM Leaderboard OpenCompass LLM Leaderboard
Who develops Open VLM Leaderboard?: Open VLM Leaderboard is developed by opencompass.
How long has Open VLM Leaderboard been around?: Open VLM Leaderboard first shipped in 2023.

At a glance

Platforms: Web
Languages: English
Open source: Yes · ★ 4.3k
License: Apache-2.0
Built for: AI researchers and ML practitioners
Model: B2B
Solves: Comparing and tracking the performance of vision-language models across datasets and evaluation metrics.

Registered as

GitHub: open-compass/VLMEvalKit

Developer

opencompass

Community-driven

GitHub

Open source

View on GitHub

Stars: 4,269
Forks: 730
Open issues: 264
Last commit: 5 Jul 2026
Commits 90d: 43
Contributors: 281
Authorship: Community-driven
Default branch: main
Latest release: v0.2 · 24 Mar 2025

Index record

Identity confidence: High · 95
Indexed: 10 Jul 2026
Lifecycle: Alive
Last seen: 10 Jul 2026

Identity audit (12)

Slug: open-compass-vlmevalkit-huggingface-co
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 10 Jul 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Derived from the project's own page and URL.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Canonical URL: https://huggingface.co/spaces/opencompass/open_vlm_leaderboard

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do