Awesome AI AgentsAI Workflow Orchestrators

langdb/ai-gateway

⭐ 811 Rust added to this list on 2025-03-09 repository created 2025-01-27

AI Gateway by LangDB is an open-source enterprise-grade AI gateway designed to govern, secure, and optimize AI traffic across multiple large language models (LLMs). It provides a unified interface compatible with the OpenAI API format, enabling seamless integration with various LLM providers such as OpenAI, Google Gemini, Anthropic, Cohere, Meta, and others. The gateway is built in Rust, emphasizing high performance, reliability, and security. Key features include high-speed processing due to Rust's efficiency, compatibility with popular frameworks like Langchain and Vercel AI SDK, and support for MCP servers. It offers enterprise-ready capabilities such as comprehensive usage analytics, cost tracking, rate limiting, cost control, advanced routing, load balancing, failover mechanisms, and evaluation tools. Data control is a priority, with full ownership of LLM usage data, detailed logging, and tracing to ensure transparency and security. The project supports multiple LLM providers and models, allowing users to route requests dynamically based on criteria like latency, cost, and availability. It exposes OpenAI-compatible API endpoints for chat completions, model listing, embeddings, and image generation, making it easy to integrate into existing AI workflows. Installation is straightforward, with options to deploy via Docker or Cargo. Configuration is flexible, supporting environment variables, command-line options, and YAML config files for customizing providers, HTTP settings, rate limits, cost controls, and database connections. LangDB also offers hosted and enterprise versions with additional features such as zero infrastructure management, automatic updates, advanced team management, custom security guardrails, monitoring dashboards, priority support, and SLA guarantees. Overall, AI Gateway is a robust solution for organizations looking to manage multiple LLMs efficiently, ensuring performance, cost-effectiveness, security, and operational control in AI deployments.

https://github.com/langdb/ai-gateway

agentsai-gatewayanthropicapi-endpointsbedrockcargochat-completionsclaudeclickhousecost-controlcost-trackingdata-controldeepseekdockerdynamic-routingembeddingsenterpriseenterprise-solutionfailovergeminihosted-solutionimage-generationlangchainlangdbllmllm-gatewayload-balancingloggingmodel-context-protocolmulti-provider-supportopenaiopenai-apiperformancerate-limitingreliabilityroutingrustrust-langtracingusage-analyticsvercelaisdk

Also in AI Workflow Orchestrators

langflow-ai/langflow

Langflow is a powerful open-source platform for building, testing, and deploying AI-powered agents and workflows with visual authoring, multi-agent orchestration, and API integration capabilities.

stablyai/orca

Orca is an AI Orchestrator that provides an integrated development environment for running and managing parallel AI agents across various platforms, including desktop and mobile.

calesthio/OpenMontage

OpenMontage is an open-source, agentic video production system that transforms AI coding assistants into full video studios for automated video creation from text prompts.

stanfordnlp/dspy

DSPy is a framework that enables programming language models with compositional Python code to build modular AI systems and optimize their performance beyond traditional prompting methods.

kestra-io/kestra

Kestra is an open-source, event-driven orchestration platform for data, AI, and infrastructure workflows, enabling declarative and code-based automation with a rich plugin ecosystem.

humanlayer/12-factor-agents

12 Factor Agents is a comprehensive framework outlining principles for building reliable, scalable, and production-ready LLM-powered AI software agents.

yoheinakajima/babyagi

BabyAGI is an experimental framework for building self-building autonomous agents using a function-centric approach with comprehensive management, logging, and a dashboard interface.

teableio/teable

Teable is an AI spreadsheet platform that integrates data management, AI workflows, and app building on a PostgreSQL backend, enabling users to create custom business applications.