scorchmark
scorchmark is an open-source CLI tool and MCP server that helps AI infrastructure teams detect cache-TTL waste, simulate model-swap savings, and analyze pricing drift across multiple AI providers. It provides per-agent attribution and integrates with prompt-caching workflows, supporting cost optimization and observability for large language model deployments.
Overview
6 featuresscorchmark is an Other LLM eval project. It focuses on identifying and reducing unnecessary cache costs and inefficiencies in AI model usage across providers. It is built as an open-source project for AI infrastructure engineers and FinOps teams. scorchmark is open source under the MIT license. scorchmark is available on the command line and API, and it can be self-hosted.
Nas01010101 builds and maintains scorchmark, and it first shipped in 2026. Key capabilities include Cache TTL analysis, model swap simulation, and pricing drift detection. It exposes integrations via an MCP server and a public API.
Summary written by a language model from the project’s public pages.
- Cache TTL analysis
- Model swap simulation
- Pricing drift detection
- Per-agent attribution
- MCP server
- CLI interface
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about scorchmark
- What does scorchmark do?
- Scorchmark focuses on identifying and reducing unnecessary cache costs and inefficiencies in AI model usage across providers. It is catalogued under Other LLM eval on PulseGate.
- Who should use scorchmark?
- scorchmark is an open-source project built for AI infrastructure engineers and FinOps teams.
- Is scorchmark free?
- Yes — scorchmark is open source under the MIT license and free to use.
- What platforms does scorchmark run on?
- scorchmark runs on the command line and API. It can also be self-hosted.
- Is scorchmark still maintained?
- Activity appears to have slowed — PulseGate's most recent liveness signals classify this listing as stale.
- What projects are similar to scorchmark?
- Similar projects tracked by PulseGate include Cross Community Portal, PromptFix, and Wasitvibed.Cross Community PortalPromptFixWasitvibed
- Who makes scorchmark?
- scorchmark is developed by Nas01010101.
- When did scorchmark launch?
- scorchmark first shipped in 2026.
Also in Other LLM eval
Same category — not a similarity match