Skip to content
Back to the index

llmroutes

PyPIInfrastructure

No liveness check has reached it yet; it is registered on PyPI and has been in the index since 11 Oct 2026. How this is checked

llmroutes is an open-source Python package for routing requests across OpenAI-compatible LLM endpoints. It uses benchmark data to select endpoints and supports gateway and failover use cases for developers operating multi-provider LLM applications.

Inferred · not functionally tested

Open SourceMITCLIAPISelf-hosted
Visit PyPI

Overview

5 features

Purpose: Choosing and routing requests across OpenAI-compatible LLM endpoints based on benchmark performance and availability.

Inferred · not functionally tested

Audience: developers building applications with multiple LLM endpoints

Inferred · not functionally tested

Functions: Unknown

Interfaces: API: indicated (inferred, not tested) · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: indicated (inferred, not tested)

Recorded constraints: pricing: open_source · license: MIT · platforms: CLI · deployment: cli, api_only, self_hosted

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: pypi.org. These links do not verify the individual claims.

In the Inference & model serving space, llmroutes takes a focused approach. Inferred · not functionally tested: It focuses on choosing and routing requests across OpenAI-compatible LLM endpoints based on benchmark performance and availability. Inferred · not functionally tested: It is built as an open-source project for developers building applications with multiple LLM endpoints. Basis unknown · not verified: llmroutes is open source under the MIT license. Basis unknown · not verified: It ships for the command line and API, and it can be self-hosted.

llmroutes first shipped in 2026. Inferred · not functionally tested: Key capabilities include endpoint routing, benchmark selection, and failover handling. Inferred · not functionally tested: Catalogued interfaces include a public API.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Endpoint routing
  • Benchmark selection
  • Failover handling
  • OpenAI compatibility
  • Gateway support

Topics: Inferred · not functionally tested

Tags
llm-routingbenchmark-based-routingendpoint-failoveropenai-compatible
AI capabilities
Text
Inference: Cloud API

JSON profile · Text profile · Access guide

Built with & integrations

Connectors
API
Runs on
CLIAPI-onlySelf-hosted

Trust & compliance

License
MIT
Public signals
HTTPSOpen SourceFree tier

Indexing history

2

What PulseGate has recorded for this listing

  1. Indexed11 Oct · 15:56 UTC
    llmroutes seen via PyPI Fresh Feed
    Source: PyPI Fresh Feed · Open
  2. Indexed11 Oct · 14:50 UTC
    llmroutes seen via PyPI Bulk Enumerator
    Source: PyPI Bulk Enumerator · Open

Frequently asked questions about llmroutes

What is llmroutes?
Inferred · not functionally tested: Llmroutes focuses on choosing and routing requests across OpenAI-compatible LLM endpoints based on benchmark performance and availability. It is catalogued under Inference & model serving on PulseGate.
Who should use llmroutes?
Inferred · not functionally tested: llmroutes is an open-source project built for developers building applications with multiple LLM endpoints.
Is llmroutes free?
Basis unknown · not verified: Yes — llmroutes is open source under the MIT license and free to use.
What platforms does llmroutes run on?
Basis unknown · not verified: llmroutes runs on the command line and API. It can also be self-hosted.
Is llmroutes still maintained?
Unverified. llmroutes has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
When did llmroutes launch?
llmroutes first shipped in 2026.
Is llmroutes open source?
Basis unknown · not verified: Yes — llmroutes is open source under the MIT license.
Does llmroutes have an API or integrations?
Inferred · not functionally tested: Yes — llmroutes exposes a public API.

Similar projects

Closest matches by what these projects do