This is a 4-bit quantized version of the Hermes-4 70B model optimized for the MLX framework on Apple silicon. It supports advanced reasoning, tool use, and long-context conversations. The model is distributed on Hugging Face for local deployment using LM Studio or compatible runtimes.
Hermes 4 70B is a Foundation models & chat product. It focuses on running a high-capability language model locally with reduced memory requirements. It is built as an open-source project for developers. Hermes 4 70B is open source under the MIT license. The product ships for the web, the command line, and API.
It is developed by lmstudio-community, and the product first shipped in 2023. Development happens publicly on GitHub with 6.4k stars and 19 commits in the last 90 days. Key capabilities include Large Language Model, Function Calling, and Quantized Inference.
Latest indexed changes and source events
lmstudio-community/Hermes-4-70B-MLX-4bit verified by the PulseGate indexer
Other apps tracked under the same category.
