Who should use janus-labs?

janus-labs is an open-source project built for ai researchers.

Does janus-labs have a free plan?

Yes — janus-labs is open source under the Apache-2.0 license and free to use.

What platforms does janus-labs run on?

janus-labs runs on the web and the command line.

Is janus-labs still maintained?

The GitHub repository shows 4 commits in the last 90 days.

What projects are similar to janus-labs?

Similar projects tracked by PulseGate include janus-agent, jetson-arena, and agentlint-dev.

Is janus-labs open source?

Yes — janus-labs is open source under the Apache-2.0 license, developed on GitHub.

Back to the index

janus-labs

github.comInfrastructure

3DMark for AI Agents - Profile AI coding agent capabilities across code quality, error resilience, and instruction resilience

Open SourceApache-2.0WebCLI

Visit github.com

1alternative

5features

2025since

Overview

5 features

In the LLM eval & observability space, janus-labs takes a focused approach. It focuses on evaluating and comparing the capabilities of AI coding agents across multiple dimensions. It is built as an open-source project for ai researchers. The project is open source (Apache-2.0). janus-labs is available on the web and the command line.

janus-labs first shipped in 2025. The project is developed in the open on GitHub with 4 commits in the last 90 days. Among its 5 catalogued features are agent benchmarking, code quality profiling, and error resilience testing.

Agent benchmarking
Code quality profiling
Error resilience testing
Instruction resilience
Radar chart visualization

Built with & integrations

Runs on

BrowserCLI

Trust & compliance

License

Apache-2.0

Verified signals

HTTPSOpen SourceFree tierGitHubActive maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed16 Jun · 04:36 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about janus-labs

What does janus-labs do?: Janus-labs focuses on evaluating and comparing the capabilities of AI coding agents across multiple dimensions. It is catalogued under LLM eval & observability on PulseGate.
Who should use janus-labs?: janus-labs is an open-source project built for ai researchers.
Does janus-labs have a free plan?: Yes — janus-labs is open source under the Apache-2.0 license and free to use.
What platforms does janus-labs run on?: janus-labs runs on the web and the command line.
Is janus-labs still maintained?: The GitHub repository shows 4 commits in the last 90 days.
What projects are similar to janus-labs?: Similar projects tracked by PulseGate include janus-agent, jetson-arena, and agentlint-dev.janus-agent jetson-arena agentlint-dev
How long has janus-labs been around?: janus-labs first shipped in 2025.
Is janus-labs open source?: Yes — janus-labs is open source under the Apache-2.0 license, developed on GitHub.

At a glance

Platforms: Cli
Languages: English
Open source: Yes (GitHub)
License: Apache-2.0
Built for: ai researchers
Model: Open source
Solves: Evaluating and comparing the capabilities of AI coding agents across multiple dimensions.

Registered as

GitHub: alexanderaperry-arch/janus-labs
PyPI: janus-labs

Developer

Alexanderaperryarch

Small team

GitHub

Open source

View on GitHub

Stars: 0
Forks: 0
Open issues: 0
Last commit: 8 Jun 2026
Commits 90d: 4
Contributors: 2
Authorship: Small team
Default branch: main

Index record

Identity confidence: Medium · 77.4
Indexed: 16 Jun 2026
Lifecycle: Alive
Last seen: 16 Jun 2026

Identity audit (12)

Slug: janus-labs-pypi-org
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 16 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Written by a language model from the project's public pages.
Category from: Assigned by the 2026 taxonomy migration.
Summary from: Taken from the package registry entry.
Languages from: Detected by a language model from page content.
Canonical URL: https://github.com/alexanderaperry-arch/janus-labs

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do