Who is onnx-genai-server for?

onnx-genai-server is an open-source project built for developers.

Is onnx-genai-server free?

Yes — onnx-genai-server is open source under the MIT license and free to use.

What platforms does onnx-genai-server run on?

onnx-genai-server runs on the command line and API. It can also be self-hosted.

Is onnx-genai-server still maintained?

The GitHub repository shows 1.1k commits in the last 90 days.

What projects are similar to onnx-genai-server?

Similar projects tracked by PulseGate include isaac-acp, applyr, and cosmo-cli.

Is onnx-genai-server open source?

Yes — onnx-genai-server is open source under the MIT license, developed on GitHub.

Back to the index

onnx-genai-server

PyPIInfrastructure

onnx-genai-server provides a command-line tool and a server that implements an OpenAI-compatible API backed by ONNX Runtime. It enables local execution of generative AI models without relying on cloud services. Suitable for developers building applications that require on-device or self-hosted inference with standard OpenAI client libraries.

Open SourceMITCLIAPISelf-hosted

Visit PyPI

2stars

4features

2026since

Overview

4 features

onnx-genai-server is a CLI tools & terminal project. It focuses on running generative AI models locally with an OpenAI-compatible API using ONNX Runtime. onnx-genai-server is an open-source project aimed at developers. The project is open source (MIT). onnx-genai-server is available on the command line and API, and it can be self-hosted.

onnx-genai-server first shipped in 2026. The project is developed in the open on GitHub with 1.1k commits in the last 90 days. Key capabilities include ONNX Runtime, OpenAI Compatible, and CLI Tool. It exposes integrations via a public API.

Summary written by a language model from the project’s public pages.

ONNX Runtime
OpenAI Compatible
CLI Tool
Local Inference

Built with & integrations

Connectors

API

Runs on

CLIAPI-onlySelf-hosted

Trust & compliance

License

MIT

Verified signals

HTTPSOpen Source GitHub · ★ 2Active maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed21 Jul · 03:04 UTC
onnx-genai-server verified against its public source
Source: PulseGate · Open

Frequently asked questions about onnx-genai-server

What does onnx-genai-server do?: Onnx-genai-server focuses on running generative AI models locally with an OpenAI-compatible API using ONNX Runtime. It is catalogued under CLI tools & terminal on PulseGate.
Who is onnx-genai-server for?: onnx-genai-server is an open-source project built for developers.
Is onnx-genai-server free?: Yes — onnx-genai-server is open source under the MIT license and free to use.
What platforms does onnx-genai-server run on?: onnx-genai-server runs on the command line and API. It can also be self-hosted.
Is onnx-genai-server still maintained?: The GitHub repository shows 1.1k commits in the last 90 days.
What projects are similar to onnx-genai-server?: Similar projects tracked by PulseGate include isaac-acp, applyr, and cosmo-cli.isaac-acp applyr cosmo-cli
How long has onnx-genai-server been around?: onnx-genai-server first shipped in 2026.
Is onnx-genai-server open source?: Yes — onnx-genai-server is open source under the MIT license, developed on GitHub.

At a glance

Platforms: Cli
Languages: English
Open source: Yes · ★ 2
License: MIT
First seen: 21 Jul 2026
Built for: developers
Model: Open source
Solves: Running generative AI models locally with an OpenAI-compatible API using ONNX Runtime.

Registered as

GitHub: justinchuby/onnx-genai
PyPI: onnx-genai-server

Developer

Justinchuby

Team

GitHub

Open source

View on GitHub

Stars: 2
Forks: 0
Open issues: 49
Last commit: 21 Jul 2026
Commits 90d: 1,074
Contributors: 6
Authorship: Team
Default branch: main

Live coverage

Identity confidence: Low · 64
Indexed: 21 Jul 2026
Lifecycle: Unverified
First seen: Jul 2026
Last seen: 21 Jul 2026

Identity audit (12)

Slug: onnx-genai-server-pypi-org
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 21 Jul 2026
Timeline basis: Indexed-at chronology (no inferred launch/funding milestones).
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Last updated: 24 Jul 2026
Canonical URL: https://pypi.org/project/onnx-genai-server

Ship this? Send a correction — no account, and you get a link to follow it.

Also in CLI tools & terminal

Same category — not a similarity match