This is a FP8 quantized version of Meta's Llama 3.1 8B model, published by RedHatAI. It supports multiple languages including English, German, French, and Italian. The model is compatible with the transformers library and vLLM, making it suitable for efficient text generation in production environments.
Meta Llama 3.1 8B sits in PulseGate's Text generation category. It focuses on running the Llama 3.1 8B model efficiently using FP8 precision for reduced memory usage and faster inference. It is built as an open-source project for developers and enterprises. Meta Llama 3.1 8B is open source under the Apache-2.0 license. It runs on the web, the command line, and API.
Behind Meta Llama 3.1 8B is RedHatAI, and it first shipped in 2019. The project is developed in the open on GitHub with 3.6k stars and 164 commits in the last 90 days. It operates in a well-populated space: PulseGate tracks 7 similar projects.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Closest matches by what these projects do