neuralbroker
neuralbroker is an open-source daemon that routes LLM inference requests, prioritizing local GPU resources and using cloud providers only when necessary. It is OpenAI-compatible and designed for developers managing hybrid AI deployments.
Overview
5 featuresIn the Inference & model serving space, neuralbroker takes a focused approach. Efficiently routing LLM inference requests between local GPUs and cloud providers based on VRAM availability. It is built as an open-source project for developers deploying large language models on hybrid infrastructure. The project is open source (MIT License). neuralbroker is available on the web, the command line, and API.
neuralbroker first shipped in 2026. Among its 5 catalogued features are LLM routing, VRAM awareness, and local-first inference. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
- LLM routing
- VRAM awareness
- Local-first inference
- OpenAI compatibility
- Cloud fallback
Built with & integrations
- Vercel
- x-vercel-id header · x-vercel-cache header
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about neuralbroker
- What does neuralbroker do?
- Efficiently routing LLM inference requests between local GPUs and cloud providers based on VRAM availability. It is catalogued under Inference & model serving on PulseGate.
- Who is neuralbroker for?
- neuralbroker is an open-source project built for developers deploying large language models on hybrid infrastructure.
- Does neuralbroker have a free plan?
- Yes — neuralbroker is open source under the MIT License and free to use.
- What platforms does neuralbroker run on?
- neuralbroker runs on the web, the command line, and API.
- Is neuralbroker still maintained?
- Activity appears to have slowed — PulseGate's most recent liveness signals classify this listing as stale.
- What projects are similar to neuralbroker?
- Similar projects tracked by PulseGate include Dynex Quantum Computing, forewarm, and AxonSDK.Dynex Quantum ComputingforewarmAxonSDK
- How long has neuralbroker been around?
- neuralbroker first shipped in 2026.
- Is neuralbroker open source?
- Yes — neuralbroker is open source under the MIT License, developed on GitHub.
Also in Inference & model serving
Same category — not a similarity match