vMLX
vMLX is a free, open-source macOS application and inference engine for running LLMs locally on Apple Silicon using MLX. It provides prefix and paged KV caching, continuous batching, MCP tool support, and an OpenAI-compatible API for developers and local AI users.
Overview
10 featuresvMLX sits in PulseGate's Inference & model serving category. It focuses on running and serving language models locally on Apple Silicon without sending data to the cloud. vMLX is an open-source project aimed at mac developers and users running local LLMs. vMLX is open source under the Apache-2.0 license. It ships for the web, the command line, macOS, and API, and it can be self-hosted.
It is developed by jjang-ai, and it first shipped in 2026. Development happens publicly on GitHub with 839 stars and 2.7k commits in the last 90 days. Among its 10 catalogued features are prefix caching, Paged KV cache, and continuous batching. It exposes integrations via an MCP server and a public API.
Summary written by a language model from the project’s public pages.
- Prefix caching
- Paged KV cache
- Continuous batching
- MCP tools
- OpenAI-compatible API
- Streaming responses
- Function calling
- Structured output
- Apple Silicon support
- Local inference
Built with & integrations
- local_oss
- bollama in the HTML · bvllm in the HTML · studio in the HTML
- meta_llama
- llama- in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed5 Sept · 00:46 UTCjjang-ai/vmlx verified via GitHub Search (Smart)Source: GitHub Search (Smart) · Open
Frequently asked questions about vMLX
- What does vMLX do?
- VMLX focuses on running and serving language models locally on Apple Silicon without sending data to the cloud. It is catalogued under Inference & model serving on PulseGate.
- Who should use vMLX?
- vMLX is an open-source project built for mac developers and users running local LLMs.
- Does vMLX have a free plan?
- Yes — vMLX is open source under the Apache-2.0 license and free to use.
- What platforms does vMLX run on?
- vMLX runs on the web, the command line, macOS, and API. It can also be self-hosted.
- Is vMLX still active?
- The GitHub repository shows 2.7k commits in the last 90 days.
- What are alternatives to vMLX?
- Similar projects tracked by PulseGate include ppmlx, mlx-serve, and macOS MLX Control Center v0.4 Released.ppmlxmlx-servemacOS MLX Control Center v0.4 Released
- Who develops vMLX?
- vMLX is developed by jjang-ai.
- How long has vMLX been around?
- vMLX first shipped in 2026.
Similar projects
Closest matches by what these projects do