my-model-gguf is an open-source text generation model distributed in GGUF format, supporting local inference and CLI usage. It is compatible with transformer libraries and is designed for developers and researchers who require efficient, customizable language models for local deployment.
In the Foundation models & chat space, takes a focused approach. It focuses on providing a local, open-source text generation model for developers and researchers. It is built as an open-source project for developers and researchers needing local language models. is open source under the Apache-2.0 license. is available on the web, the command line, and API, and it can be self-hosted.
Behind is hally-petter, and the product first shipped in 2023. Development happens publicly on GitHub with 68.4k stars and 1.2k commits in the last 90 days. Key capabilities include text generation, CLI support, and GGUF format.
Latest indexed changes and source events
hally-petter/my-model-gguf verified by the PulseGate indexer
Other apps tracked under the same category.
