LMCache is an open-source knowledge delivery network designed to accelerate large language model (LLM) applications by caching conversational histories and optimizing retrieval-augmented generation (RAG) queries. It supports both cloud and self-hosted deployments, enabling faster and more cost-effective AI inference for enterprise and research use cases.
Latest indexed changes and source events
Other apps tracked under the same category.