benchmatrix is a Python package and pytest plugin that works with pytest-benchmark. It helps developers build consistent benchmark matrices by collecting multiple runs of performance tests, storing historical data, and automatically detecting regressions. It is designed for use in continuous integration pipelines to maintain performance quality in Python projects.
In the Testing & QA space, benchmatrix takes a focused approach. Manually tracking, repeating, and comparing Python benchmark results across code changes to reliably detect performance regressions. It is built as an open-source project for python developers. benchmatrix is open source under the MIT license. It ships for the command line.
It is developed by Ryan Wallace, and it first shipped in 2026. Development happens publicly on GitHub with 187 commits in the last 90 days. Among its 5 catalogued features are Benchmark Matrices, Regression Detection, and Repeated Runs.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do