marlin-2b-gguf is an open model repository containing quantized weights for local language-model inference. It is intended for developers and machine-learning practitioners running compatible inference tools on their own hardware.
Marlin 2b is a Foundation models & chat project. It focuses on running a smaller language model locally with reduced memory and compute requirements. It is built as an open-source project for developers and machine-learning practitioners. The project is open source (Open Source). Marlin 2b is available on the command line, and it can be self-hosted.
It is developed by jadeonrails. Key capabilities include quantized weights, GGUF format, and local inference.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do