kvcache-simulator is an open-source CLI tool that simulates key-value cache hit rates for large language model inference using JSONL trace files. It helps machine learning engineers evaluate and optimize cache strategies for efficient inference.
In the Testing & QA space, kvcache-simulator takes a focused approach. It focuses on testing and analyzing the effectiveness of KV cache strategies for LLM inference using real trace data. It is built as an open-source project for machine learning engineers. kvcache-simulator is open source under the MIT license. It runs on the web and the command line, and it can be self-hosted.
It is developed by kvcache.ai, and the product first shipped in 2024. Development happens publicly on GitHub with 14 stars and 15 commits in the last 90 days. PulseGate's similarity index finds few close equivalents — kvcache-simulator occupies a relatively distinct niche. Key capabilities include KV cache simulation, JSONL trace analysis, and command-line interface.
Latest indexed changes and source events
kvcache-simulator discovered by the PulseGate indexer
Other apps tracked under the same category.
