fraQtl is a web-based platform that provides task-aware inference compression for long-context large language models. It compresses KV cache, model artifacts, and expert-weight lanes to reduce memory and compute requirements, helping AI researchers and ML engineers deploy LLMs more efficiently.
Latest indexed changes and source events
Other apps tracked under the same category.
