Awesome AI Agents › AI Agent Operating System

wassim249/fastapi-langgraph-agent-production-ready-template

⭐ 2657 Python added to this list on 2025-04-19 repository created 2025-04-07

The project "fastapi-langgraph-agent-production-ready-template" is a comprehensive and production-ready template designed for building AI agent applications using FastAPI integrated with LangGraph. It offers a robust foundation for developing scalable, secure, and maintainable AI agent services. The template leverages FastAPI for high-performance asynchronous API endpoints and integrates LangGraph to facilitate AI agent workflows. It also incorporates Langfuse for observability and monitoring of large language models (LLMs), ensuring detailed insights into model performance and behavior. Key features include a production-ready architecture with structured logging tailored to different environments, rate limiting with configurable rules to protect the service, and PostgreSQL for reliable data persistence. The template supports Docker and Docker Compose for containerized deployment and includes Prometheus metrics and Grafana dashboards for comprehensive monitoring of API performance, rate limiting statistics, database performance, and system resource usage. Security is a major focus, with JWT-based authentication, session management, input sanitization, CORS configuration, and rate limiting to safeguard the application. The developer experience is enhanced through environment-specific configuration, a clear project structure, extensive use of type hints, and an easy setup process for local development. A standout component is the model evaluation framework, which automates metric-based evaluation of model outputs. It integrates with Langfuse to fetch traces and analyze them, producing detailed JSON reports that include success and failure metrics. The evaluation process is interactive via a command-line interface and supports customizable evaluation metrics defined in markdown files. Reports generated provide high-level statistics, per-metric performance, and trace-level details for debugging. The project includes thorough documentation on setup, including database configuration with PostgreSQL, local development, and Docker-based deployment. It also provides commands for running evaluations in various modes, making it a versatile and powerful template for AI agent application development with a strong emphasis on observability, security, and maintainability.

https://github.com/wassim249/fastapi-langgraph-agent-production-ready-template

agentagentic-aiai-agentautomated-evaluationclicorscustomizable-metricsdockerdocker-composeenvironment-specific-configurationfastapifastapi-templategrafanainput-sanitizationjson-reportsjwt-authenticationlangchainlangchain-pythonlangfuselanggraphlanggraph-pythonllmllm-observabilitymaintainablememorymodel-evaluationmonitoringpostgresqlproduction-readyprometheusrate-limitingscalablesecuresession-managementstructured-logging