Wyolet Relay is an open-source LLM routing layer designed to sit between applications and large language model providers such as OpenAI, Anthropic, Google Gemini, AWS Bedrock, and others. It enables users to pool their own API keys behind a single endpoint that is compatible with both OpenAI and Anthropic wire formats, simplifying integration and providing a unified access point for multiple providers. The tool is aimed at developers and teams managing LLM-powered applications who require efficient routing, failover, and observability across different providers and models.
Key features of Wyolet Relay include automatic failover, per-key rate limiting, and real-time cost tracking, all delivered with minimal added latency (sub-2 ms at the 50th percentile). It supports load balancing across many keys, accounts, or providers, and can mint disposable relay keys scoped to specific models and limits for granular access control. The relay translates between OpenAI and Anthropic wire formats on the fly, allowing, for example, calls to Claude models using the OpenAI SDK or vice versa, without requiring code rewrites. Usage and cost are metered per request, with token counts and pricing sourced directly from the underlying providers. Circuit breakers automatically quarantine misbehaving upstreams based on authentication failures or rate limits, ensuring robust operation.
Wyolet Relay is delivered as a self-hosted solution, deployable as a single container or within Kubernetes environments, and includes an API, admin UI, and a pre-seeded catalog of over 400 models from more than 40 hosts. 0 license, with no telemetry or phone-home functionality. For those preferring a managed option, a hosted relay is available in beta, offering unlimited relay keys, policy management, and dashboards for usage and cost, with authentication via Google or email. The self-hosted version is free forever, while the hosted relay is free during beta; in both cases, users pay only their underlying model providers, as Wyolet Relay does not mark up token costs.
This tool targets teams and organizations seeking to centralize and secure their LLM provider integrations, manage keys and policies efficiently, and maintain flexibility across a growing ecosystem of language models.
wyolet-primitives is a Frameworks & SDKs product. It simplifies implementation of common backend primitives for FastAPI applications, reducing boilerplate and complexity. wyolet-primitives is an open-source project aimed at python backend developers using FastAPI. The project is open source (MIT). wyolet-primitives is available on the web, the command line, and API, and it can be self-hosted.
It is developed by wyolet, and the product first shipped in 2026. Across PulseGate's embedding index, wyolet-primitives has few near neighbours, marking it as relatively distinct. Among its 9 catalogued features are rate limiting, distributed lock, and idempotency.
Latest indexed changes and source events
Other apps tracked under the same category.
