Paddler is an open-source platform for deploying, balancing, and serving large language models (LLMs) on private infrastructure. It supports local inference, integrates with llama.cpp, and provides APIs and CLI tools for teams seeking privacy, reliability, and cost efficiency in AI operations.
Paddler sits in PulseGate's AI & ML category. It enables teams to deploy and manage large language models on their own infrastructure for privacy and cost control. Paddler is an open-source project aimed at AI engineers and infrastructure teams. The project is open source (Apache-2.0). The product ships for the web, API, and the command line, and it can be self-hosted.
Behind Paddler is Intentee, and the product first shipped in 2024. The project is developed in the open on GitHub with 1.6k stars and 285 commits in the last 90 days. Among its 5 catalogued features are LLM load balancing, self-hosted inference, and model deployment. It exposes integrations via a public API.
Latest indexed changes and source events
Other apps tracked under the same category.
