A DP-based dynamic batching scheduler for inference workloads
razors-edge-batching-scheduler is a Frameworks & SDKs product. Efficiently batching inference workloads to optimize resource usage and latency. razors-edge-batching-scheduler is an open-source project aimed at machine learning engineers. The project is open source (MIT License). razors-edge-batching-scheduler is available on the web and the command line, and it can be self-hosted.
razors-edge-batching-scheduler first shipped in 2026. Among its 5 catalogued features are dynamic batching, inference scheduling, and DP-based optimization.
Latest indexed changes and source events
Other apps tracked under the same category.
