my-model-gguf is an open-source text generation model distributed in GGUF format, supporting local inference and CLI usage. It is compatible with transformer libraries and is designed for developers and researchers who require efficient, customizable language models for local deployment.
In the Quantised & converted weights space, hally-petter/my-model-gguf takes a focused approach. It focuses on providing a local, open-source text generation model for developers and researchers. It is built as an open-source project for developers and researchers needing local language models. The project is open source (Apache-2.0). It runs on the web, the command line, and API, and it can be self-hosted.
Behind hally-petter/my-model-gguf is hally-petter, and it first shipped in 2023. The project is developed in the open on GitHub with 68.4k stars and 1.2k commits in the last 90 days. Key capabilities include text generation, CLI support, and GGUF format.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do