nvidia-nat-ragas is an open source subpackage for the NVIDIA NeMo Agent Toolkit, providing tools for evaluating retrieval-augmented generation (RAG) systems in AI agents. Below are 14 llm eval & observability apps with similar functionality to nvidia-nat-ragas, matched by what each product actually does — not ranked or scored. Explore each to find the closest fit for your use case.
nvidia-nat-rag is an open-source subpackage for the NeMo Agent Toolkit, providing retrieval-augmented generation (RAG) capabilities for AI agent workflows. It is intended for developers building advanced AI systems.
nvidia-nat-ragaai is an open-source subpackage that integrates RagaAI Catalyst with NVIDIA's NeMo Agent Toolkit, providing observability and evaluation features for AI agent development. It is designed for AI developers and researchers.
nvidia-nat-agno is an open-source subpackage that integrates Agno into the NeMo Agent Toolkit, enabling developers to build, manage, and enhance AI agents with retrieval-augmented generation and other advanced features.
Subpackage for evaluation in NVIDIA NeMo Agent Toolkit
nvidia-nat-s3 is an open-source subpackage for the NeMo Agent Toolkit that adds S3-compatible storage integration, allowing AI agents to store and access data efficiently. It is distributed via PyPI under the Apache-2.0 license.
nvidia-nat-app is an open-source CLI toolkit by NVIDIA that provides reusable performance primitives for building and optimizing agentic applications. It is framework-agnostic and designed for developers working on AI-driven or agent-based systems.
nvidia-nat-mysql is an open source subpackage for the NVIDIA NeMo Agent Toolkit, enabling seamless MySQL database integration for AI agent development. It provides CLI and API support for developers building data-driven AI agents.
nvidia-nat-openpipe-art is an open-source Python subpackage that integrates OpenPipe ART with NVIDIA's NeMo Agent Toolkit. It provides developers with tools for agent development and finetuning, supporting advanced AI workflows in research and production.
nvidia-nat-phoenix is an open-source CLI subpackage that integrates Arize Phoenix observability features into the NeMo Agent Toolkit. It helps AI developers monitor and evaluate agent workflows more effectively.
nvidia-nat-a2a is an open-source subpackage for the NeMo Agent Toolkit that adds A2A Protocol integration, enabling AI agents to communicate and interoperate using standardized protocols. It supports retrieval-augmented generation and is distributed via PyPI under Apache-2.0.
Vanna-based Text-to-SQL integration for NeMo Agent Toolkit with Databricks support
nvidia-nat-strands is an open-source subpackage that integrates AWS Strands with the NeMo Agent Toolkit, supporting autonomous agent workflows and retrieval-augmented generation (RAG) for AI developers.
Subpackage for Mem0 integration in NeMo Agent Toolkit
NVIDIA NeMo Agent Toolkit