Open-Source LLM Router for Mixture-of-Models
PulseGate's liveness check found it on 13 Sep 2026; it is registered on GitHub and has been in the index since 27 Jun 2026. How this is checked
vLLM Semantic Router is an open-source system designed to unify and orchestrate inference across a diverse set of large language models (LLMs). It addresses the challenge of managing heterogeneous LLM deployments by enabling users to build mixtures of models, composing personalized model paths that route requests based on a variety of criteria. The platform is positioned to bring system-level intelligence to LLM inference, allowing for seamless integration of models that…
Inferred · not functionally tested
Overview
6 featuresPurpose: Routing and optimizing requests across multiple large language models for cost, latency, and privacy.
Inferred · not functionally tested
Audience: AI engineers and developers managing LLM infrastructure
Inferred · not functionally tested
Functions: agents, workflow_automation, monitoring
Inferred · not functionally tested
Interfaces: API: unknown · MCP: unknown · CLI: unknown · Self-hosting: indicated (inferred, not tested)
Recorded constraints: pricing: open_source · license: Apache-2.0 · platforms: WEB · deployment: browser, self_hosted
Constraint provenance is unknown; confirm requirements with the publisher.
Record sources: vllm-semantic-router.com · github.com. These links do not verify the individual claims.
Open-Source LLM Router for Mixture-of-Models is an Inference & model serving project. Inferred · not functionally tested: It focuses on routing and optimizing requests across multiple large language models for cost, latency, and privacy. Inferred · not functionally tested: It is built as an open-source project for AI engineers and developers managing LLM infrastructure. Basis unknown · not verified: The project is open source (Apache-2.0). Basis unknown · not verified: Open-Source LLM Router for Mixture-of-Models is available on the web, and it can be self-hosted.
Open-Source LLM Router for Mixture-of-Models first shipped in 2025. Development happens publicly on GitHub with 4.6k stars and 375 commits in the last 90 days. Inferred · not functionally tested: Key capabilities include model routing, cost optimization, and latency management. The interface is available in English and Chinese. Open-Source LLM Router for Mixture-of-Models is currently in beta.
Summary written by a language model from the project’s public pages.
Tasks: Inferred · not functionally tested
- Model routing
- Cost optimization
- Latency management
- Privacy controls
- Open-source
- Multi-provider support
Topics: Inferred · not functionally tested
Built with & integrations
- Netlify
- x-nf-request-id header
- local_oss
- bvllm in the HTML
Trust & compliance
Indexing history
What PulseGate has recorded for this listing
Frequently asked questions about Open-Source LLM Router for Mixture-of-Models
- What does Open-Source LLM Router for Mixture-of-Models do?
- Inferred · not functionally tested: Open-Source LLM Router for Mixture-of-Models focuses on routing and optimizing requests across multiple large language models for cost, latency, and privacy. It is catalogued under Inference & model serving on PulseGate.
- Who is Open-Source LLM Router for Mixture-of-Models for?
- Inferred · not functionally tested: Open-Source LLM Router for Mixture-of-Models is an open-source project built for AI engineers and developers managing LLM infrastructure.
- Does Open-Source LLM Router for Mixture-of-Models have a free plan?
- Basis unknown · not verified: Yes — Open-Source LLM Router for Mixture-of-Models is open source under the Apache-2.0 license and free to use.
- What platforms does Open-Source LLM Router for Mixture-of-Models run on?
- Basis unknown · not verified: Open-Source LLM Router for Mixture-of-Models runs on the web. It can also be self-hosted.
- Is Open-Source LLM Router for Mixture-of-Models still maintained?
- PulseGate's liveness check found it on 13 Sep 2026. Its GitHub repository shows 375 commits in the last 90 days.
- What are alternatives to Open-Source LLM Router for Mixture-of-Models?
- Similar projects tracked by PulseGate include Build Your Mixture-of-Models, vLLM, and Routerly.ai.Build Your Mixture-of-ModelsvLLMRouterly.ai
- When did Open-Source LLM Router for Mixture-of-Models launch?
- Open-Source LLM Router for Mixture-of-Models first shipped in 2025.
- Is Open-Source LLM Router for Mixture-of-Models open source?
- Basis unknown · not verified: Yes — Open-Source LLM Router for Mixture-of-Models is open source under the Apache-2.0 license, developed on GitHub.
Similar projects
Closest matches by what these projects do