Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
What it is, and how people use it
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. It sits on the Dev Agents & Programs shelf of the catalog, maintained by @comet-ml.
Why builders keep it installedDev Agents & Programs benefits
These CLIs and dashboards solve one job well and install with a single command. Value shows up in the first hour, not after a config weekend.
Most of them ship an MCP server, skill or hooks - so the same tool you use manually becomes an action your agent can call safely.
Star counts here track repos people actually run daily: the issue history shows bug classes fixed under production pressure, not demo-week polish.
Every tool on this page ships under an open license and can be self-hosted. Your usage data and your configs stay yours.
Contributorsloading from GitHub…
Languagesestimated from snapshot
- Python 71.0%
- TypeScript 17.0%
- Shell 12.0%