VeloxQuant-MLX
VeloxQuant-MLX is an MIT-licensed Python package for quantizing LLM key-value caches on Apple Silicon using MLX. It includes 43 research-adapted compression methods and Metal kernels for developers optimizing local inference workloads.
Overview
6 featuresIn the Inference & model serving space, VeloxQuant-MLX takes a focused approach. It focuses on reducing LLM KV-cache memory usage and improving local inference performance on Apple Silicon. VeloxQuant-MLX is an open-source project aimed at ML engineers and developers running LLM inference on Apple Silicon. VeloxQuant-MLX is open source under the MIT license. It runs on the command line, and it can be self-hosted.
It is developed by rajveer43, and it first shipped in 2026. The project is developed in the open on GitHub with 14 stars and 502 commits in the last 90 days. Key capabilities include KV-cache quantization, 43 compression methods, and metal kernels.
Summary written by a language model from the project’s public pages.
- KV-cache quantization
- 43 compression methods
- Metal kernels
- MLX support
- Apple Silicon optimization
- LLM inference
Built with & integrations
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about VeloxQuant-MLX
- What does VeloxQuant-MLX do?
- VeloxQuant-MLX focuses on reducing LLM KV-cache memory usage and improving local inference performance on Apple Silicon. It is catalogued under Inference & model serving on PulseGate.
- Who should use VeloxQuant-MLX?
- VeloxQuant-MLX is an open-source project built for ML engineers and developers running LLM inference on Apple Silicon.
- Does VeloxQuant-MLX have a free plan?
- Yes — VeloxQuant-MLX is open source under the MIT license and free to use.
- What platforms does VeloxQuant-MLX run on?
- VeloxQuant-MLX runs on the command line. It can also be self-hosted.
- Is VeloxQuant-MLX still active?
- The GitHub repository shows 502 commits in the last 90 days.
- Who develops VeloxQuant-MLX?
- VeloxQuant-MLX is developed by rajveer43.
- How long has VeloxQuant-MLX been around?
- VeloxQuant-MLX first shipped in 2026.
- Is VeloxQuant-MLX open source?
- Yes — VeloxQuant-MLX is open source under the MIT license, developed on GitHub.
Similar projects
Closest matches by what these projects do