LLM Engine
LLM Engine is an open-source infrastructure tool that enables developers to fine-tune and serve large language models. It provides a Python SDK, Helm charts for deployment, and supports both self-hosted and cloud-managed options. Designed for ML engineers and organizations building custom AI solutions.
Open SourceApache-2.0CLISelf-hostedAPICloud-managed
831stars
77forks
9features
2023since
Overview
9 featuresLLM Engine is an Infrastructure & Backend project. It simplifies the process of fine-tuning and deploying large language models for developers and organizations. LLM Engine is an open-source project aimed at machine learning engineers and AI developers. The project is open source (Apache-2.0). LLM Engine is available on the command line and API, and it can be self-hosted.
Scale AI builds and maintains LLM Engine, and it first shipped in 2023. The project is developed in the open on GitHub with 831 stars and 42 commits in the last 90 days. Key capabilities include model fine-tuning, model serving, and Python SDK. It exposes integrations via a public API.
Summary written by a language model from the project’s public pages.
- Model fine-tuning
- Model serving
- Python SDK
- Helm chart deployment
- API access
- Self-hosting
- Cloud hosting
- Rate limiting
- Operator support
Tags
llm-fine-tuningmodel-servingpython-libraryhelm-chartai-infrastructure
AI capabilities
TextMultimodal
Inference: HybridWeights: Open
Built with & integrations
Hosting
Cloudflare
AI providers
meta_llama
Connectors
API
Runs on
CLISelf-hostedAPI-onlyCloud-managed
Detected from
- Cloudflare
- cf-ray header · cf-cache-status header
- meta_llama
- llama- in the HTML
Trust & compliance
License
Apache-2.0
Verified signals
Indexing history
1What PulseGate has recorded for this listing
Frequently asked questions about LLM Engine
- What is LLM Engine?
- LLM Engine simplifies the process of fine-tuning and deploying large language models for developers and organizations. It is catalogued under Infrastructure & Backend on PulseGate.
- Who is LLM Engine for?
- LLM Engine is an open-source project built for machine learning engineers and AI developers.
- Does LLM Engine have a free plan?
- Yes — LLM Engine is open source under the Apache-2.0 license and free to use.
- What platforms does LLM Engine run on?
- LLM Engine runs on the command line and API. It can also be self-hosted.
- Is LLM Engine still maintained?
- The GitHub repository shows 42 commits in the last 90 days.
- What are alternatives to LLM Engine?
- Similar projects tracked by PulseGate include llm, llm, and Mesh LLM.llmllmMesh LLM
- Who develops LLM Engine?
- LLM Engine is developed by Scale AI, based in the United States.
- When did LLM Engine launch?
- LLM Engine first shipped in 2023.
Similar projects
Closest matches by what these projects do