Overview
4 featuresIn the Inference & model serving space, mlx-omni-server takes a focused approach. It focuses on running OpenAI-compatible APIs locally using Apple's MLX framework for text and audio tasks. It is built as an open-source project for AI developers and researchers. mlx-omni-server is open source under the MIT license. It ships for the web, the command line, and API.
madroidmaq builds and maintains mlx-omni-server, and it first shipped in 2024. Development happens publicly on GitHub with 726 stars and 8 commits in the last 90 days. Among its 4 catalogued features are OpenAI-compatible API, MLX framework integration, and text and audio support. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
- ✓OpenAI-compatible API
- ✓MLX framework integration
- ✓Text and audio support
- ✓Local inference
Tagsopenai-compatiblemlx-frameworklocal-inferenceapi-server
AI capabilitiesTextAudio
Inference: LocalWeights: Open
Built with & integrations
AI providersanthropicopenai
Runs onBrowserCLIAPI-only
Indexing history
1What PulseGate has recorded for this listing
Indexed17 Jun · 23:51 UTC
Listing verified against its public source
Frequently asked questions about mlx-omni-server
- What is mlx-omni-server?
- Mlx-omni-server focuses on running OpenAI-compatible APIs locally using Apple's MLX framework for text and audio tasks. It is catalogued under Inference & model serving on PulseGate.
- Who should use mlx-omni-server?
- mlx-omni-server is an open-source project built for AI developers and researchers.
- Is mlx-omni-server free?
- Yes — mlx-omni-server is open source under the MIT license and free to use.
- What platforms does mlx-omni-server run on?
- mlx-omni-server runs on the web, the command line, and API.
- Is mlx-omni-server still active?
- The GitHub repository shows 8 commits in the last 90 days.
- What projects are similar to mlx-omni-server?
- Similar projects tracked by PulseGate include mlx-serve, mlx-serve, and ppmlx.mlx-servemlx-serveppmlx
- Who makes mlx-omni-server?
- mlx-omni-server is developed by madroidmaq.
- How long has mlx-omni-server been around?
- mlx-omni-server first shipped in 2024.