ModernBERT Large
ModernBERT-large is a BERT-based language model hosted on Hugging Face. It is designed for fill-mask tasks and supports long-context processing in English. The model carries the Apache 2.0 license and is published by Answer.AI under the identifier answerdotai/ModernBERT-large.
It belongs to the class of masked language models within the Transformers framework. The model is provided in PyTorch, ONNX, and Safetensors formats. Its parameter count stands at 395881664 in F32 precision, with a total file size of 1583544840 bytes when stored in Safetensors. The associated paper is listed under arXiv 2412.13663.
The model is available for use through the Hugging Face ecosystem, including libraries such as Transformers. It can be deployed via inference providers and supports local applications and notebooks. Community discussions around the model total 15, with both open and closed threads.
ModernBERT-large is intended for developers and researchers working on natural language processing applications that require masked token prediction or extended context handling.
Overview
4 featuresIn the Foundation models & chat space, ModernBERT Large takes a focused approach. It focuses on providing advanced fill-mask and long-context NLP capabilities for developers and researchers. ModernBERT Large is an open-source project aimed at NLP developers and researchers. The project is open source (Open Source). ModernBERT Large is available on the web, the command line, and API.
Behind ModernBERT Large is Answer.AI, and it first shipped in 2024. Among its 4 catalogued features are fill-mask prediction, long-context support, and transformer architecture.
Summary written by a language model from the project’s public pages.
- Fill-mask prediction
- Long-context support
- Transformer architecture
- ONNX support
Built with & integrations
- AWS
- x-amz-cf-id header · x-amz-cf-pop header · via header
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed19 Jul · 19:18 UTCanswerdotai/ModernBERT-large verified against its public sourceSource: PulseGate · Open
Frequently asked questions about ModernBERT Large
- What does ModernBERT Large do?
- ModernBERT Large focuses on providing advanced fill-mask and long-context NLP capabilities for developers and researchers. It is catalogued under Foundation models & chat on PulseGate.
- Who should use ModernBERT Large?
- ModernBERT Large is an open-source project built for NLP developers and researchers.
- Does ModernBERT Large have a free plan?
- Yes — ModernBERT Large is open source under the Open Source license and free to use.
- What platforms does ModernBERT Large run on?
- ModernBERT Large runs on the web, the command line, and API.
- Is ModernBERT Large still maintained?
- Unverified. ModernBERT Large has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
- What projects are similar to ModernBERT Large?
- Similar projects tracked by PulseGate include ModernBERT Base, BioLinkBERT Large, and Bert Large Portuguese Cased.ModernBERT BaseBioLinkBERT LargeBert Large Portuguese Cased
- Who makes ModernBERT Large?
- ModernBERT Large is developed by Answer.AI.
- When did ModernBERT Large launch?
- ModernBERT Large first shipped in 2024.
Similar projects
Closest matches by what these projects do