RoCBert is a Chinese BERT variant pretrained by WeChatAI that is specifically designed to be robust under various forms of adversarial attacks. It can be used for masked language modeling and other downstream NLP tasks in Chinese. The model is distributed on Hugging Face and integrates directly with the Transformers library for easy loading and inference.
Roc Bert Base Zh sits in PulseGate's Foundation models & chat category. It focuses on training and deploying Chinese language models that remain robust against various adversarial attacks. It is built as an open-source project for NLP researchers and developers. Roc Bert Base Zh is open source under the Apache-2.0 license. The product ships for the web, the command line, and API.
Behind Roc Bert Base Zh is WeChatAI, and the product first shipped in 2022. Development happens publicly on GitHub with 20 stars.
Latest indexed changes and source events
weiweishi/roc-bert-base-zh verified by the PulseGate indexer
