cheaper-inference/OmniRoute
Free AI gateway routing coding-agent traffic across 375 providers and 150+ free tiers through one OpenAI-compatible endpoint.
Awesome AI Agents › AI Agent Gateway
cloudflare/agents
Cloudflare Agents is an innovative project designed to build and deploy intelligent AI agents at the edge of the network using Cloudflare's platform. The project aims to create a new paradigm in AI development by providing a robust framework where AI agents can maintain persistent state and memory, engage in real-time communication, process and learn from interactions, and operate autonomously on a global scale. These agents can hibernate when idle and awaken when needed, making them efficient and responsive. The project is actively evolving, with a core agent framework already available that includes state management, real-time WebSocket communication, HTTP endpoints and routing, React integration hooks, and basic AI chat capabilities. Future developments include advanced memory systems, WebRTC support for audio and video, email integration, an evaluation framework, enhanced observability, and a self-hosting guide. The project offers a quick start with templates and npm packages, comprehensive documentation covering the core framework, effective agent-building patterns, human-in-the-loop guides, and playground examples. Contributions are encouraged in the form of new examples, documentation improvements, bug fixes, and feature suggestions. Licensed under the MIT License, Cloudflare Agents invites developers to build meaningful AI applications that leverage the power of edge computing and intelligent agent technology.
https://github.com/cloudflare/agents
Also in AI Agent Gateway
decolua/9router
9Router is a FREE AI router and token saver that connects various AI coding tools to over 40 providers and 100+ models, with features like auto-fallback and token compression.
simstudioai/sim
Sim Studio is an open-source platform for building, testing, and optimizing AI agent workflows with flexible deployment options including cloud and self-hosting.
mastra-ai/mastra
Mastra is a TypeScript AI agent framework that enables rapid development of AI applications with support for multiple LLMs, advanced agents, workflows, RAG, integrations, and automated evaluations.
TransformerOptimus/SuperAGI
SuperAGI is an open-source autonomous AI agent framework that enables developers to build, manage, and deploy scalable and efficient autonomous AI agents with extensible capabilities through toolkits and a user-friendly interface.
corsairdev/corsair
Open-source product integration platform with a single REST API syntax for connecting agents, backend services, and dashboards to third-party apps.
casdoor/casdoor
Casdoor is an open-source, AI-first Identity and Access Management (IAM) / LLM MCP gateway and authentication server with a web UI and broad protocol support.
Arize-ai/phoenix
Phoenix is an open-source AI observability platform that enables tracing, evaluation, and optimization of large language model applications across various deployment environments.