auditai-cli is an open-source command-line tool that enables developers to perform safety audits on large language model (LLM) and retrieval-augmented generation (RAG) systems within CI/CD pipelines. It checks for issues like prompt injection, faithfulness, and overall safety, helping machine learning engineers maintain robust and secure AI deployments.
auditai-cli is a LLM eval & observability product. It focuses on ensuring the safety and reliability of LLM and RAG systems in automated CI/CD workflows. It is built as an open-source project for machine learning engineers and developers. auditai-cli is open source under the MIT license. auditai-cli is available on the command line.
Behind auditai-cli is iZenDeveloper, and the product first shipped in 2026. Development happens publicly on GitHub with 25 commits in the last 90 days. Key capabilities include prompt injection detection, faithfulness evaluation, and CI/CD integration.
Latest indexed changes and source events
Other apps tracked under the same category.