raga-ai-hub/RagaAI-Catalyst
RagaAI Catalyst is a Python SDK platform for observability, monitoring, and evaluation of AI agents and LLM projects, featuring tracing, debugging, advanced analytics, and project management tools.
Awesome AI Agents › Agent Monitoring Tools
junhoyeo/tokscale
Tokscale (v2, now with native Rust TUI) is a high-performance command-line interface tool accompanied by a visualization dashboard designed for comprehensive monitoring of token usage and associated costs from multiple AI coding agents. It provides detailed insights into how developers consume tokens across a wide array of AI tools. The project supports token usage tracking for popular agents such as OpenCode, Claude Code, Codex CLI, Sakana Fugu, GitHub Copilot CLI, Gemini CLI, Cursor IDE, Amp (AmpCode), Codebuff, Factory Droid, Pi, Kimi CLI/Code, Qwen CLI, Roo Code, Kilo, Mux, Crush, and Goose. Tokscale also offers a 'Wrapped 2025' feature, allowing users to generate a summary of their AI agent usage. Key features include cross-platform support, a native Rust-based Terminal User Interface (TUI) for interactive data exploration, and an online dashboard available at tokscale.ai, which includes a 3D contributions graph and a leaderboard for public usage data submission.
https://github.com/junhoyeo/tokscale
Also in Agent Monitoring Tools
MervinPraison/PraisonAI
PraisonAI is a production-ready Multi AI Agents framework that enables the creation and management of intelligent AI agents to automate and solve complex problems through collaboration and customization.
FailproofAI/failproofai
Local observability and policy-enforcement layer that hooks into 12 AI agent harnesses, including Claude Code, Codex and Hermes, to log every run and block dangerous tool calls before they execute.
apache/hertzbeat
Apache HertzBeat is an AI-powered open source real-time observability system that unifies metrics and logs collection, alerting, and notification with high performance and customizable monitoring capabilities.
matt1398/claude-devtools
Desktop and Docker application that reads local Claude Code session logs and reconstructs tool calls, thinking steps, subagent trees and per-turn token attribution in a visual interface.
eumemic/ai-legion
AI Legion is a platform for autonomous agents powered by large language models that collaborate to accomplish tasks with minimal human intervention.
traceroot-ai/traceroot
TraceRoot is open-source observability for AI agents that traces runs, detects failures with LLM judges, root-causes them against source code and GitHub history, opens fix PRs and evaluates each fix.
chiphuyen/sniffly
Sniffly is a local analytics dashboard that parses Claude Code logs to show usage statistics, error breakdowns and full message history, with optional shareable dashboards.