LangTest is an open-source framework that enables users to generate and run over 100 types of tests on LLM and NLP models, covering aspects like accuracy, bias, fairness, and robustness. It integrates with popular NLP frameworks and provides a simple interface for comprehensive model evaluation. Designed for ML engineers and researchers to ensure model quality before deployment.
LangTest sits in PulseGate's LLM eval & observability category. It focuses on ensuring the safety, fairness, and effectiveness of language models through automated, comprehensive evaluation and testing. It is built as an open-source project for machine learning engineers and NLP researchers. LangTest is open source under the Apache-2.0 license. The product ships for the web, the command line, and API.
John Snow Labs builds and maintains LangTest, and the product first shipped in 2022. Development happens publicly on GitHub with 561 stars and 1 commits in the last 90 days. PulseGate's similarity index finds few close equivalents — LangTest occupies a relatively distinct niche. Key capabilities include model evaluation, bias testing, and fairness testing.
Latest indexed changes and source events
langtest.org discovered by the PulseGate indexer
Other apps tracked under the same category.
