This is a FP8 quantized version of Meta's Llama 3.1 8B model, published by RedHatAI. It supports multiple languages including English, German, French, and Italian. The model is compatible with the transformers library and vLLM, making it suitable for efficient text generation in production environments.
Meta Llama 3.1 8B is a Foundation models & chat product. It focuses on running the Llama 3.1 8B model efficiently using FP8 precision for reduced memory usage and faster inference. Meta Llama 3.1 8B is an open-source project aimed at developers and enterprises. The project is open source (Apache-2.0). It runs on the web, the command line, and API.
RedHatAI builds and maintains Meta Llama 3.1 8B, and the product first shipped in 2019. The project is developed in the open on GitHub with 3.6k stars and 164 commits in the last 90 days. PulseGate's similarity index places it among 7 comparable tools.
Latest indexed changes and source events
RedHatAI/Meta-Llama-3.1-8B-FP8 verified by the PulseGate indexer
Other apps tracked under the same category.