ricelang is a Python library and CLI tool specialized in language identification and tokenization for Southeast Asian languages including Burmese, various Karen and Chin variants, Eastern Kayah, Shan, and others. It addresses the gap in NLP tooling for these low-resource languages by providing accurate detection and segmentation capabilities. The package is MIT-licensed, published on PyPI, and its source code is hosted on GitHub.
In the Developer Tools space, ricelang takes a focused approach. Accurately identifying and tokenizing low-resource Southeast Asian languages like Burmese, Karen, Chin, and Shan in text processing pipelines. ricelang is an open-source project aimed at NLP developers. ricelang is open source under the MIT license. ricelang is available on the command line.
kaunghtetsan275 builds and maintains ricelang, and it first shipped in 2020. Development happens publicly on GitHub with 42 stars and 49 commits in the last 90 days. Key capabilities include Language Identification, tokenization, and Southeast Asian Languages.
Summary written by a language model from the project’s public pages.
What PulseGate has recorded for this listing
Same category — not a similarity match