raga-ai-hub/RagaAI-Catalyst
RagaAI Catalyst is a Python SDK platform for observability, monitoring, and evaluation of AI agents and LLM projects, featuring tracing, debugging, advanced analytics, and project management tools.
Awesome AI Agents › Agent Monitoring Tools
Sniffly is a Python 3.10+ command-line tool and web dashboard that analyses Claude Code logs so users can understand and improve how they work with the coding agent. After installation through uv, uvx, pip or a source checkout, running sniffly init starts a local server and opens a browser dashboard, by default on 127.0.0.1 port 8081. The dashboard covers three areas: usage pattern statistics that summarise how the agent is being used, an error breakdown that shows where Claude Code makes mistakes so those situations can be avoided, and a message history view that walks through all instructions given to the agent, which can then be reviewed or passed to colleagues. Configuration is handled by a small config subcommand with set, unset and show verbs; available keys include server port and host, whether the browser opens automatically, the maximum number of projects held in the memory cache, a per-project cache size limit in megabytes, how many messages are loaded initially, and the maximum span in days for date range selection. Settings are stored in a JSON file under the user home directory and can be reset per key or removed wholesale. A share button generates a link to a project dashboard for coworkers, with a choice between private links visible only to link holders and public listing in a gallery, plus an explicit opt-in for including the actual command text. All parsing and processing happen on the local machine, there is no telemetry, conversation content never leaves the computer, and sharing is opt-in only. The README also documents troubleshooting for port conflicts, browsers that fail to open and stale configuration, and recommends port forwarding when the tool runs on a remote server. It is MIT licensed.
https://github.com/chiphuyen/sniffly
RagaAI Catalyst is a Python SDK platform for observability, monitoring, and evaluation of AI agents and LLM projects, featuring tracing, debugging, advanced analytics, and project management tools.
PraisonAI is a production-ready Multi AI Agents framework that enables the creation and management of intelligent AI agents to automate and solve complex problems through collaboration and customization.
Local observability and policy-enforcement layer that hooks into 12 AI agent harnesses, including Claude Code, Codex and Hermes, to log every run and block dangerous tool calls before they execute.
Apache HertzBeat is an AI-powered open source real-time observability system that unifies metrics and logs collection, alerting, and notification with high performance and customizable monitoring capabilities.
Tokscale is a CLI utility and dashboard for tracking and visualizing token usage and costs across various AI coding agents.
Desktop and Docker application that reads local Claude Code session logs and reconstructs tool calls, thinking steps, subagent trees and per-turn token attribution in a visual interface.
AI Legion is a platform for autonomous agents powered by large language models that collaborate to accomplish tasks with minimal human intervention.
TraceRoot is open-source observability for AI agents that traces runs, detects failures with LLM judges, root-causes them against source code and GitHub history, opens fix PRs and evaluates each fix.