Skip to content
Back to the index

benchmatrix

PyPIInfrastructure

PulseGate's liveness check found it on 14 Sep 2026; it is registered on GitHub and PyPI and has been in the index since 2 Aug 2026. How this is checked

benchmatrix is a Python package and pytest plugin that works with pytest-benchmark. It helps developers build consistent benchmark matrices by collecting multiple runs of performance tests, storing historical data, and automatically detecting regressions. It is designed for use in continuous integration pipelines to maintain performance quality in Python projects.

Inferred · not functionally tested

Open SourceMITCLI
Visit PyPI
6stars
5features
2026since

Overview

5 features

Purpose: Manually tracking, repeating, and comparing Python benchmark results across code changes to reliably detect performance regressions.

Inferred · not functionally tested

Audience: Python developers

Inferred · not functionally tested

Functions: monitoring

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: unknown

Recorded constraints: pricing: open_source · license: MIT · platforms: CLI · deployment: cli

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: pypi.org · github.com. These links do not verify the individual claims.

In the Testing & QA space, benchmatrix takes a focused approach. Inferred · not functionally tested: Manually tracking, repeating, and comparing Python benchmark results across code changes to reliably detect performance regressions. Inferred · not functionally tested: It is built as an open-source project for python developers. Basis unknown · not verified: benchmatrix is open source under the MIT license. Basis unknown · not verified: It ships for the command line.

It is developed by Ryan Wallace, and it first shipped in 2026. Development happens publicly on GitHub with 187 commits in the last 90 days. Inferred · not functionally tested: Among its 5 catalogued features are Benchmark Matrices, Regression Detection, and Repeated Runs.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Benchmark Matrices
  • Regression Detection
  • Repeated Runs
  • pytest Integration
  • CI Compatibility

Topics: Inferred · not functionally tested

Tags
pytest-pluginbenchmark-matrixperformance-regressionci-benchmarkingrepeated-benchmarking

JSON profile · Text profile · Access guide

Built with & integrations

Runs on
CLI

Trust & compliance

License
MIT
Public signals
HTTPSOpen SourceGitHub · ★ 6Active maintenance

Indexing history

1

What PulseGate has recorded for this listing

  1. Indexed2 Aug · 12:43 UTC
    benchmatrix seen via PyPI Fresh Feed
    Source: PyPI Fresh Feed · Open

Frequently asked questions about benchmatrix

What does benchmatrix do?
Inferred · not functionally tested: Manually tracking, repeating, and comparing Python benchmark results across code changes to reliably detect performance regressions. It is catalogued under Testing & QA on PulseGate.
Who is benchmatrix for?
Inferred · not functionally tested: benchmatrix is an open-source project built for python developers.
Is benchmatrix free?
Basis unknown · not verified: Yes — benchmatrix is open source under the MIT license and free to use.
What platforms does benchmatrix run on?
Basis unknown · not verified: benchmatrix runs on the command line.
Is benchmatrix still active?
PulseGate's liveness check found it on 14 Sep 2026. Its GitHub repository shows 187 commits in the last 90 days.
What are alternatives to benchmatrix?
Similar projects tracked by PulseGate include benchcaddy, benchdiff, and benchstats.benchcaddybenchdiffbenchstats
Who develops benchmatrix?
benchmatrix is developed by Ryan Wallace.
When did benchmatrix launch?
benchmatrix first shipped in 2026.

Similar projects

Closest matches by what these projects do