A command-line and library test runner for prompts, models and RAG pipelines. Test cases are declared in YAML, run side by side across providers, and the project also performs red-team scans for prompt injection and jailbreaks.
Source: Official GitHub repository. Last checked 2026-09-18. Spot an error? Tell us.
Nearby and similar
An observability and evaluation platform that turns production traces into datasets and prompt improvements, marketed for teams running self-improving agents.
An open-source workspace where engineers and subject-matter experts iterate on prompts and agent configurations side by side, with versioning, evaluation runs and observability.
Arize's commercial platform for agent observability and evaluation, adding hosted tracing, online evaluators and issue tracking on top of the open-source Phoenix project.
Arize's open-source observability tool that runs locally or self-hosted, offering OpenTelemetry tracing, a prompt playground with saved prompt versions and built-in evaluators.
An evaluation and observability platform for AI products, with a prompt playground, dataset management, scorers and production tracing in one workspace.
An open-source visual environment for stress-testing prompts. Prompt variants, models and evaluators are wired together as nodes, and results are compared in charts and tables.