Skip to content
Back to the index

contamcheck

PyPIInfrastructure

PulseGate's liveness check found it on 7 Oct 2026; it is registered on PyPI and has been in the index since 7 Oct 2026. How this is checked

contamcheck is an MIT-licensed Python package for checking whether language models have memorised benchmark data. It is intended for researchers and engineers evaluating the reliability of LLM benchmark results.

Inferred · not functionally tested

Open SourceMITCLISelf-hosted
Visit PyPI

Overview

5 features

Purpose: Determining whether language-model benchmark results are affected by memorisation or training-data contamination.

Inferred · not functionally tested

Audience: machine-learning researchers and LLM evaluators

Inferred · not functionally tested

Functions: analytics

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: indicated (inferred, not tested)

Recorded constraints: pricing: open_source · license: MIT · platforms: CLI · deployment: cli, self_hosted

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: pypi.org. These links do not verify the individual claims.

In the LLM evaluation & benchmarks space, contamcheck takes a focused approach. Inferred · not functionally tested: It focuses on determining whether language-model benchmark results are affected by memorisation or training-data contamination. Inferred · not functionally tested: It is built as an open-source project for machine-learning researchers and LLM evaluators. Basis unknown · not verified: contamcheck is open source under the MIT license. Basis unknown · not verified: It runs on the command line, and it can be self-hosted.

contamcheck first shipped in 2026. Inferred · not functionally tested: Among its 5 catalogued features are benchmark checks, contamination detection, and memorisation analysis.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Benchmark checks
  • Contamination detection
  • Memorisation analysis
  • LLM evaluation
  • Python package

Topics: Inferred · not functionally tested

Tags
benchmark-contaminationllm-evaluationmemorization-detectionmachine-learning
AI capabilities
Text
Inference: Local

JSON profile · Text profile · Access guide

Built with & integrations

Runs on
CLISelf-hosted

Trust & compliance

License
MIT
Public signals
HTTPSOpen SourceFree tier

Indexing history

1

What PulseGate has recorded for this listing

  1. Indexed7 Oct · 00:11 UTC
    contamcheck seen via PyPI Bulk Enumerator
    Source: PyPI Bulk Enumerator · Open

Frequently asked questions about contamcheck

What is contamcheck?
Inferred · not functionally tested: Contamcheck focuses on determining whether language-model benchmark results are affected by memorisation or training-data contamination. It is catalogued under LLM evaluation & benchmarks on PulseGate.
Who should use contamcheck?
Inferred · not functionally tested: contamcheck is an open-source project built for machine-learning researchers and LLM evaluators.
Is contamcheck free?
Basis unknown · not verified: Yes — contamcheck is open source under the MIT license and free to use.
What platforms does contamcheck run on?
Basis unknown · not verified: contamcheck runs on the command line. It can also be self-hosted.
Is contamcheck still active?
PulseGate's liveness check found it on 7 Oct 2026.
What projects are similar to contamcheck?
Similar projects tracked by PulseGate include quantdiff, rerun-bench, and toolkit-eval-harness.quantdiffrerun-benchtoolkit-eval-harness
How long has contamcheck been around?
contamcheck first shipped in 2026.
Is contamcheck open source?
Basis unknown · not verified: Yes — contamcheck is open source under the MIT license.

Also in LLM evaluation & benchmarks

Same category — not a similarity match