mudler/LocalAI
LocalAI is an open-source AI engine that enables running various AI models (LLMs, vision, voice, image, video) on any hardware, including CPU-only systems, with a composable and extensible architec...
Awesome AI Agents › LLM Framework Tools
LLM Framework Tools
langfuse/langfuse
Langfuse is an open source LLM engineering platform that enables collaborative development, monitoring, evaluation, and debugging of AI applications with comprehensive observability, prompt management, and integration features.
567-labs/instructor
Instructor is a popular Python library that simplifies working with structured outputs from large language models by providing validation, retries, and streaming support across multiple LLM providers.
TEN-framework/ten-framework
TEN Framework is a real-time, distributed, cloud-edge collaborative multimodal AI agent framework supporting multiple programming languages for building high-performance AI applications.
google/adk-samples
A collection of sample agents built with the Agent Development Kit (ADK) to accelerate development of conversational and multi-agent workflows, designed for customization and integration with Google Cloud services.
truefoundry/cognita
Cognita is an open-source, modular, and production-ready RAG framework by TrueFoundry that simplifies building, customizing, and deploying scalable Retrieval Augmented Generation applications with a no-code UI and extensive integration features.
lemony-ai/cascadeflow
In-process Python and TypeScript library that cascades model calls inside the agent loop, routing each query or tool call between small and flagship models by quality, cost, latency and budget.
shroominic/codeinterpreter-api
An open-source API that implements the ChatGPT Code Interpreter for sandboxed Python code execution, enabling data analysis, visualization, and interactive AI-driven computational tasks with local execution and scalable production deployment.
agentscope-ai/ReMe
Local-first memory layer for AI agents that converts conversations and resources into readable markdown memory nodes and retrieves them through a hybrid of wikilinks, BM25 and embeddings.
patterns-ai-core/langchainrb
Langchain.rb is a Ruby gem that provides a unified interface to build LLM-powered applications, supporting multiple AI providers and features like embeddings, prompt completions, chat completions, and Retrieval Augmented Generation.
universal-tool-calling-protocol/code-mode
Library from the UTCP project that replaces per-call tool invocation with sandboxed TypeScript execution, letting an agent chain many MCP, HTTP, CLI or file tools inside one generated code block.
farizrahman4u/loopgpt
LoopGPT is a modular and extensible Auto-GPT framework that enables users to create customizable AI agents with efficient token usage, human feedback integration, and full state serialization.
tavily-ai/tavily-python
Python SDK for the Tavily API, giving LLM and RAG applications web search, content extraction, crawling, mapping, and research through a single client.
awslabs/generative-ai-cdk-constructs
AWS Generative AI CDK Constructs is an open-source library providing well-architected, reusable infrastructure patterns to simplify building and deploying generative AI solutions on AWS using the AWS Cloud Development Kit.
MoonshotAI/kosong
Kosong is Moonshot AI's Python abstraction layer over chat models for building LLM agent applications; active development has moved into the kimi-cli monorepo, where the package now lives.
Undertone0809/promptulate
Promptulate is a lightweight Pythonic framework for building autonomous AI language agent applications with extensive model support and easy integration.
TeleAI-UAGI/telemem
TeleMem is a Python memory layer for LLM agents that acts as a drop-in replacement for Mem0, adding isolated per-character profiles, long-term text recall and a video-to-vector pipeline for multimodal memory.
chr15m/runprompt
runprompt is a single-file Python script that executes dotprompt files from the shell, rendering templates, calling tools and returning schema-validated JSON across Anthropic, OpenAI, Gemini, OpenRouter and Ollama.
alexfazio/crewAI-quickstart
CrewAI Quickstart is a collection of notebooks, code templates, and guides designed to help developers build and experiment with agentic workflows using CrewAI's tools and integrations.
dreadnode/rigging
Rigging is a lightweight and flexible framework that simplifies the use of large language models in production by providing structured prompt definitions, broad model support, and advanced features like async batching and integrated tracing.
genia-dev/GeniA
GeniA is an open-source AI platform that acts as a virtual engineering team member, automating and assisting with a wide range of software engineering tasks in production environments through seamless Slack integration and extensible tool support.
mcpdotdirect/evm-mcp-server
EVM MCP Server is a Model Context Protocol server providing AI agents with unified blockchain services across 30+ EVM-compatible networks, supporting token transfers, smart contract interactions, and ENS name resolution.
nginx/agent
NGINX Agent is a tool for remotely managing, configuring, and monitoring NGINX instances, providing real-time metrics and event collection to enhance server performance and administration.
ServiceNow/TapeAgents
TapeAgents is a flexible framework that uses a structured replayable log to support all stages of Large Language Model Agent development, including building, debugging, serving, and optimizing agents.
pinpoint-apm/pinpoint-c-agent
Pinpoint C Agent is a cross-platform tool that enables monitoring of PHP and Python applications by integrating them with the Pinpoint APM system using C/C++ APIs and auto-injection techniques.
proficientai/js
Proficient AI provides TypeScript/JavaScript SDKs and tools to quickly add and manage conversational AI agents powered by large language models in applications.