LiteLLM is an open-source gateway and proxy that enables developers to manage authentication, load balancing, and spend tracking across 100+ LLM providers using a unified OpenAI-compatible API. It streamlines integration and monitoring for AI applications.
LiteLLM is an Infrastructure & Backend project. It focuses on simplifying integration and management of multiple LLM providers for developers via a unified gateway and API. LiteLLM is an open-source project aimed at developers and AI platform integrators. The project is open source (Open Source). It ships for the web and API.
LiteLLM first shipped in 2023. The project is developed in the open on GitHub with 50.5k stars and 3.9k commits in the last 90 days. Key capabilities include LLM proxy, authentication management, and load balancing. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do