ZeroKV-Neo is an open-source command-line tool that provides adaptive Polar and QJL KV cache compression for large language models. It integrates with vLLM and supports Docker deployment, helping ML engineers optimize memory and compute usage during inference. Suitable for production environments.
Latest indexed changes and source events
Other apps tracked under the same category.
