Skip to content
Alternatives
Software like llm-relay
What else does this job. Matched on what each project does, not on who links to whom.
Closest first
- llmpypi.orgllm is an open-source command-line utility and Python library that enables developers to interact with large language models from providers like OpenAI, Anthropic, and Google Gemini, as well as local models. It supports prompt management, model selection, and streaming responses, making it easy to work with LLMs in scripts or development workflows.
- llms-pygithub.comA lightweight CLI tool and OpenAI-compatible server for querying multiple Large Language Model (LLM) providers
- llm-usage-reportgithub.comllm-usage-report is an open-source CLI tool that parses logs from LLM APIs (Anthropic, OpenAI, Google) to generate detailed reports on token usage and costs. It supports budget alerts and is designed for developers and teams managing LLM API expenses.
- llm4sgithub.comllm4s is an open-source CLI tool inspired by K9s, designed to provide observability and debugging for LLM and MCP servers. It offers a terminal UI for monitoring server activity, integrating with MCP, and assisting AI developers in managing and troubleshooting their deployments.
- airlock-llmgithub.comairlock-llm is an open-source proxy for large language models, offering logging, guardrails, and unified access for AI-powered coding tools. It helps enterprises secure and monitor LLM usage, enforce compliance, and manage sensitive data. Built on LiteLLM, it is suitable for platform engineers and AI infrastructure teams.
- LiteLLMlitellm.aiLiteLLM is an open-source gateway and proxy that enables developers to manage authentication, load balancing, and spend tracking across 100+ LLM providers using a unified OpenAI-compatible API. It streamlines integration and monitoring for AI applications.
- llm-authpypi.orgllm-auth is an open-source Python package that provides a local authentication surface for managing API keys and OAuth tokens used with large language model APIs. It is designed for developers who need to securely store and access credentials in local development or CLI workflows. The tool supports various authentication methods and is distributed under the MIT license.
- llm-workflow-enginegithub.comllm-workflow-engine is an open-source CLI tool and workflow manager for common large language models. It enables developers and researchers to automate and manage LLM tasks efficiently from the command line. The tool is MIT licensed and available on PyPI.
Ranked by how close each one sits to llm-relay in the index, not by popularity. Back to llm-relay →