Skip to content
Back to the index

Mesh LLM

meshllm.cloudInfrastructure

PulseGate's liveness check found it on 14 Sep 2026; it is registered on GitHub and has been in the index since 2 Jul 2026. How this is checked

Mesh LLM is a distributed model inference tool for running large language models across multiple nodes. It is described as a way to run bigger models without buying bigger GPUs, by splitting large models into smaller pieces so memory-bound GPUs can handle smaller layer slices on right-sized nodes.

Inferred · not functionally tested

Open SourceApache-2.0WebCLIAPISelf-hosted
Mesh LLM preview
Visit meshllm.cloud
1.3kstars
151forks
10features
2026since

Overview

6 features

Purpose: Running large language models on limited hardware by distributing inference across multiple local or networked machines.

Inferred · not functionally tested

Audience: developers and ML engineers

Inferred · not functionally tested

Functions: code_generation, agents

Inferred · not functionally tested

Interfaces: API: indicated (inferred, not tested) · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: indicated (inferred, not tested)

Recorded constraints: pricing: open_source · license: Apache-2.0 · platforms: CLI, WEB · deployment: browser, cli, api_only, self_hosted

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: meshllm.cloud · github.com. These links do not verify the individual claims.

Mesh LLM is an Inference & model serving project. Inferred · not functionally tested: It focuses on running large language models on limited hardware by distributing inference across multiple local or networked machines. Inferred · not functionally tested: Mesh LLM is an open-source project aimed at developers and ML engineers. Basis unknown · not verified: The project is open source (Apache-2.0). Basis unknown · not verified: It runs on the web, the command line, and API, and it can be self-hosted.

Mesh LLM first shipped in 2026. Development happens publicly on GitHub with 1.3k stars and 1.1k commits in the last 90 days. Inferred · not functionally tested: Among its 6 catalogued features are distributed inference, OpenAI-compatible API, and model sharding. Inferred · not functionally tested: Catalogued interfaces include a public API.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Distributed inference
  • OpenAI-compatible API
  • Model sharding
  • Multi-node support
  • CLI installation
  • Local API endpoint

Topics: Inferred · not functionally tested

Tags
distributed-inferenceopenai-compatiblelocal-llmgpu-shardinghomelab-ai
AI capabilities
Text
Inference: Local

JSON profile · Text profile · Access guide

Built with & integrations

Hosting
Cloudflare
AI providers
meta_llamaopenai
Connectors
API
Runs on
BrowserCLIAPI-onlySelf-hosted
Detected from
openai
bgpt- in the HTML
Cloudflare
cf-ray header · cf-cache-status header
meta_llama
llama- in the HTML

Trust & compliance

License
Apache-2.0
Public signals
HTTPSOpen SourceFree tierGitHub · ★ 1.3kActive maintenance

Indexing history

What PulseGate has recorded for this listing

Nothing recorded for this listing in this window.

Frequently asked questions about Mesh LLM

What is Mesh LLM?
Inferred · not functionally tested: Mesh LLM focuses on running large language models on limited hardware by distributing inference across multiple local or networked machines. It is catalogued under Inference & model serving on PulseGate.
Who is Mesh LLM for?
Inferred · not functionally tested: Mesh LLM is an open-source project built for developers and ML engineers.
Does Mesh LLM have a free plan?
Basis unknown · not verified: Yes — Mesh LLM is open source under the Apache-2.0 license and free to use.
What platforms does Mesh LLM run on?
Basis unknown · not verified: Mesh LLM runs on the web, the command line, and API. It can also be self-hosted.
Is Mesh LLM still maintained?
PulseGate's liveness check found it on 14 Sep 2026. Its GitHub repository shows 1.1k commits in the last 90 days.
What projects are similar to Mesh LLM?
Similar projects tracked by PulseGate include llm-d, cloudmesh-ai-llm, and FreeModel.llm-dcloudmesh-ai-llmFreeModel
When did Mesh LLM launch?
Mesh LLM first shipped in 2026.
Is Mesh LLM open source?
Basis unknown · not verified: Yes — Mesh LLM is open source under the Apache-2.0 license, developed on GitHub.

Similar projects

Closest matches by what these projects do