quantfit is an open-source command-line tool that enables users to quantize large language models (LLMs) for efficient GPU inference while ensuring safety compliance. It is designed for AI researchers and engineers working with custom or open-source LLMs.
Latest indexed changes and source events
Other apps tracked under the same category.
