Skip to content
Back to the index

janus-labs

github.comInfrastructure

PulseGate's liveness check found it on 9 Oct 2026; it is registered on GitHub and PyPI and has been in the index since 16 Jun 2026. How this is checked

3DMark for AI Agents - Profile AI coding agent capabilities across code quality, error resilience, and instruction resilience

Inferred · not functionally tested

Open SourceApache-2.0WebCLI
janus-labs preview
Visit github.com
1alternative
5features
2025since

Overview

5 features

Purpose: Evaluating and comparing the capabilities of AI coding agents across multiple dimensions.

Inferred · not functionally tested

Audience: ai researchers

Inferred · not functionally tested

Functions: analytics

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: unknown

Recorded constraints: pricing: open_source · license: Apache-2.0 · platforms: CLI · deployment: browser, cli

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: github.com. These links do not verify the individual claims.

In the Agent evaluation & testing space, janus-labs takes a focused approach. Inferred · not functionally tested: It focuses on evaluating and comparing the capabilities of AI coding agents across multiple dimensions. Inferred · not functionally tested: It is built as an open-source project for ai researchers. Basis unknown · not verified: The project is open source (Apache-2.0). Basis unknown · not verified: janus-labs is available on the web and the command line.

janus-labs first shipped in 2025. The project is developed in the open on GitHub with 4 commits in the last 90 days. Inferred · not functionally tested: Among its 5 catalogued features are agent benchmarking, code quality profiling, and error resilience testing.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Agent benchmarking
  • Code quality profiling
  • Error resilience testing
  • Instruction resilience
  • Radar chart visualization

Topics: Inferred · not functionally tested

Tags
agent-benchmarkingllm-evaluationcode-quality
AI capabilities
Code
Weights: Open

JSON profile · Text profile · Access guide

Built with & integrations

Connectors
github
Runs on
BrowserCLI

Trust & compliance

License
Apache-2.0
Public signals
HTTPSOpen SourceFree tierGitHubActive maintenance

Indexing history

What PulseGate has recorded for this listing

Nothing recorded for this listing in this window.

Frequently asked questions about janus-labs

What does janus-labs do?
Inferred · not functionally tested: Janus-labs focuses on evaluating and comparing the capabilities of AI coding agents across multiple dimensions. It is catalogued under Agent evaluation & testing on PulseGate.
Who should use janus-labs?
Inferred · not functionally tested: janus-labs is an open-source project built for ai researchers.
Does janus-labs have a free plan?
Basis unknown · not verified: Yes — janus-labs is open source under the Apache-2.0 license and free to use.
What platforms does janus-labs run on?
Basis unknown · not verified: janus-labs runs on the web and the command line.
Is janus-labs still maintained?
PulseGate's liveness check found it on 9 Oct 2026. Its GitHub repository shows 4 commits in the last 90 days.
What projects are similar to janus-labs?
Similar projects tracked by PulseGate include janus-agent, jetson-arena, and agentlint-dev.janus-agentjetson-arenaagentlint-dev
How long has janus-labs been around?
janus-labs first shipped in 2025.
Is janus-labs open source?
Basis unknown · not verified: Yes — janus-labs is open source under the Apache-2.0 license, developed on GitHub.

Similar projects

Closest matches by what these projects do