Awesome AI AgentsMCP Server Framework

AgentOps-AI/agentops

⭐ 5817 Python repository created 2023-08-15

AgentOps is a Python SDK designed to provide comprehensive monitoring, cost tracking, benchmarking, and observability tools for AI agents and large language models (LLMs). It supports integration with a wide range of popular LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI, making it a versatile tool for developers working with AI agents. The platform offers features such as replay analytics and debugging, which allow developers to visualize step-by-step execution graphs of their agents, helping to identify issues and optimize performance. It also includes LLM cost management capabilities to track spending across different foundation model providers, enabling better budget control and cost efficiency. AgentOps supports agent benchmarking with over 1,000 evaluation tests, allowing developers to assess and compare the performance of their AI agents effectively. Security and compliance are also key focuses, with tools to detect common prompt injection attacks and data exfiltration exploits, ensuring safer deployment of AI agents. The SDK emphasizes a first-class developer experience by enabling powerful observability with minimal code changes, using decorators to create session, agent, operation, task, and workflow spans that automatically record inputs, outputs, exceptions, and support asynchronous and generator functions. The project provides a user-friendly dashboard for viewing session analytics and debugging information, accessible via the AgentOps web app. It is open-source under the MIT license and actively maintained, with integrations expanding to include Microsoft and Cohere among others. Overall, AgentOps is a robust observability and developer tool platform that helps AI developers build, evaluate, monitor, and secure their AI agents from prototype to production.

https://github.com/AgentOps-AI/agentops

ag2agentagent-benchmarkingagent-frameworksagentopsagents-sdkaiai-agent-evaluationai-agent-monitoringanthropicasync-supportautogenbenchmarkingcamelaicompliancecost-estimationcost-managementcrewaidata-exfiltrationdebuggingdeveloper-toolsevalsevaluation-metricsgroqlangchainllmllm-cost-trackingmistralmit-licenseobservabilityollamaopenaiopenai-agentsopenai-agents-sdkoperation-spansprompt-injection-detectionpython-sdkreplay-analyticssecuritysession-spansworkflow-spans

Also in MCP Server Framework

thedaviddias/Front-End-Checklist

Front-End Checklist is an open-source quality system for modern web development, offering comprehensive best practices for humans and AI agents.

PrefectHQ/fastmcp

FastMCP offers a Pythonic framework for building Model Context Protocol (MCP) servers and clients, facilitating structured communication for AI agents and models.

pascalorg/editor

Local-first 3D building editor built with React Three Fiber and WebGPU that exposes an MCP service so AI agents can create and edit 3D scenes.

trycua/cua

c/ua is a high-performance framework that enables AI agents to control full macOS and Linux operating systems within secure, lightweight virtual containers on Apple Silicon Macs, supporting complex autonomous workflows and LLM integration.

nukeop/nuclear

Nuclear is a free, open-source, ad-free music player for Windows, macOS, and Linux, featuring streaming from various sources, playlist management, a powerful plugin system, and integration with AI ...

googleapis/mcp-toolbox

MCP Toolbox for Databases is an open-source server that connects AI agents and applications to enterprise databases using the Model Context Protocol (MCP).

apify/apify-mcp-server

Model Context Protocol server that exposes thousands of Apify Actors as tools, letting AI agents scrape social media, search engines, maps and e-commerce sites over hosted HTTP or local stdio.

grab/cursor-talk-to-figma-mcp

Cursor Talk to Figma MCP is an integration that enables Cursor AI to communicate with Figma programmatically for reading and modifying designs, automating and enhancing the design workflow.