diegosouzapw/OmniRoute
OmniRoute is a free AI gateway that consolidates over 237 AI providers, including 90+ free tiers, into a single endpoint, offering token compression and smart auto-fallback for various AI tools.
Awesome AI Agents › AI Agent Gateway
mastra-ai/mastra
Mastra is an opinionated TypeScript framework designed to accelerate the development of AI applications and features. It provides a comprehensive set of primitives including workflows, agents, retrieval-augmented generation (RAG), integrations, and evaluations (evals) to streamline the building process. Mastra supports any large language model (LLM) such as GPT-4, Claude, Gemini, and Llama through the Vercel AI SDK, which offers a unified interface for interacting with various LLM providers like OpenAI, Anthropic, and Google Gemini. This flexibility allows developers to select specific models and providers and choose whether to stream responses. A core component of Mastra is its agent system, where language models can execute sequences of actions by utilizing tools, workflows, and synchronized data. Agents can invoke custom functions, third-party APIs, and access knowledge bases constructed via RAG. Tools in Mastra are typed functions with defined input schemas and executor logic, integrated with third-party services for enhanced functionality. Workflows in Mastra are durable, graph-based state machines capable of handling loops, branching, human input, embedding other workflows, error handling, retries, and parsing. These workflows can be created programmatically or through a visual editor, with each step featuring OpenTelemetry tracing for observability. The RAG feature enables the construction of knowledge bases using ETL pipelines with chunking, embedding, and vector search techniques, enhancing the agents' ability to generate informed responses. Integrations are auto-generated, type-safe API clients for third-party services, usable as tools or workflow steps. Evals provide automated testing for LLM outputs using model-graded, rule-based, and statistical methods, returning normalized scores for performance comparison. Mastra can be run locally or deployed to serverless cloud environments, making it versatile for different development and deployment needs. Overall, Mastra offers a robust, flexible, and developer-friendly framework for building sophisticated AI applications with support for multiple LLMs, advanced agent capabilities, and comprehensive tooling for workflows, integrations, and evaluation.
https://github.com/mastra-ai/mastra
Also in AI Agent Gateway
simstudioai/sim
Sim Studio is an open-source platform for building, testing, and optimizing AI agent workflows with flexible deployment options including cloud and self-hosting.
decolua/9router
9Router is a FREE AI router and token saver that connects various AI coding tools to over 40 providers and 100+ models, with features like auto-fallback and token compression.
TransformerOptimus/SuperAGI
SuperAGI is an open-source autonomous AI agent framework that enables developers to build, manage, and deploy scalable and efficient autonomous AI agents with extensible capabilities through toolkits and a user-friendly interface.
casdoor/casdoor
Casdoor is an open-source, AI-first Identity and Access Management (IAM) / LLM MCP gateway and authentication server with a web UI and broad protocol support.
Arize-ai/phoenix
Phoenix is an open-source AI observability platform that enables tracing, evaluation, and optimization of large language model applications across various deployment environments.
corsairdev/corsair
Open-source product integration platform with a single REST API syntax for connecting agents, backend services, and dashboards to third-party apps.
Upsonic/Upsonic
Upsonic is a reliability-focused AI agent framework that supports Model Context Protocol (MCP) and provides advanced features for trustworthy, production-ready AI agent workflows with integrated tool use and secure runtime environments.