Skip to content
Back to the index

leanlab

PyPIInfrastructure

PulseGate's liveness check found it on 14 Sep 2026; it is registered on GitHub and PyPI and has been in the index since 30 Jun 2026. How this is checked

leanlab is an open-source CLI tool designed for evolving and evaluating AI agent experiments and coding tasks. It supports experiment evolution against fixed metrics and automates the spec-to-merge workflow with locked acceptance tests, helping AI researchers and developers improve agent reliability and performance.

Inferred · not functionally tested

Open SourceMITCLI
Visit PyPI

Overview

5 features

Purpose: Automating the evolution and evaluation of AI agent experiments and coding tasks for improved performance and reliability.

Inferred · not functionally tested

Audience: AI researchers and developers

Inferred · not functionally tested

Functions: agents, analytics, workflow_automation

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: unknown

Recorded constraints: pricing: open_source · license: MIT · platforms: CLI · deployment: cli

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: pypi.org · github.com. These links do not verify the individual claims.

leanlab is an Agent evaluation & testing project. Inferred · not functionally tested: It focuses on automating the evolution and evaluation of AI agent experiments and coding tasks for improved performance and reliability. Inferred · not functionally tested: It is built as an open-source project for AI researchers and developers. Basis unknown · not verified: leanlab is open source under the MIT license. Basis unknown · not verified: It runs on the command line.

It is developed by bacharSalleh, and it first shipped in 2026. Development happens publicly on GitHub with 42 commits in the last 90 days. Inferred · not functionally tested: Among its 5 catalogued features are experiment evolution, agent evaluation, and acceptance tests.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Experiment evolution
  • Agent evaluation
  • Acceptance tests
  • Spec-to-merge loop
  • Self-improving lab

Topics: Inferred · not functionally tested

Tags
agent-evaluationml-experimentsself-improvingacceptance-testingcli-tool
AI capabilities
Code

JSON profile · Text profile · Access guide

Built with & integrations

AI providers
anthropic
Connectors
github
Runs on
CLI

Trust & compliance

License
MIT
Public signals
HTTPSOpen SourceFree tierGitHubActive maintenance

Indexing history

What PulseGate has recorded for this listing

Nothing recorded for this listing in this window.

Frequently asked questions about leanlab

What is leanlab?
Inferred · not functionally tested: Leanlab focuses on automating the evolution and evaluation of AI agent experiments and coding tasks for improved performance and reliability. It is catalogued under Agent evaluation & testing on PulseGate.
Who is leanlab for?
Inferred · not functionally tested: leanlab is an open-source project built for AI researchers and developers.
Does leanlab have a free plan?
Basis unknown · not verified: Yes — leanlab is open source under the MIT license and free to use.
What platforms does leanlab run on?
Basis unknown · not verified: leanlab runs on the command line.
Is leanlab still active?
PulseGate's liveness check found it on 14 Sep 2026. Its GitHub repository shows 42 commits in the last 90 days.
What are alternatives to leanlab?
Similar projects tracked by PulseGate include agentlint, labbench-cli, and coder-eval.agentlintlabbench-clicoder-eval
Who makes leanlab?
leanlab is developed by bacharSalleh.
How long has leanlab been around?
leanlab first shipped in 2026.

Similar projects

Closest matches by what these projects do