langfuse/langfuse
Langfuse is an open source LLM engineering platform that enables collaborative development, monitoring, evaluation, and debugging of AI applications with comprehensive observability, prompt management, and integration features.
Awesome AI Agents › LLM Framework Tools
mudler/LocalAI
LocalAI is an open-source, versatile AI engine designed to run a wide array of artificial intelligence models locally, including Large Language Models (LLMs), vision models, voice models, image generation, and video processing models. A key feature is its hardware agnosticism, allowing operation on various hardware configurations, including those without a dedicated GPU, and supporting NVIDIA, AMD, Intel, Apple Silicon, and Vulkan GPUs. The platform is built with a small, composable core, where backends for specific engines like llama.cpp, vLLM, whisper.cpp, and stable-diffusion are pulled on demand, ensuring users only install what they need. It offers drop-in API compatibility with services like OpenAI, Anthropic, and ElevenLabs, providing a unified interface across different backends. LocalAI emphasizes privacy by keeping data on the user's infrastructure and includes features like multi-user support with API key authentication, quotas, and role-based access. Furthermore, it incorporates built-in AI agents with tool use, RAG (Retrieval Augmented Generation), MCP, and skill capabilities, making it a comprehensive solution for local AI deployment and development.
https://github.com/mudler/LocalAI
Also in LLM Framework Tools
567-labs/instructor
Instructor is a popular Python library that simplifies working with structured outputs from large language models by providing validation, retries, and streaming support across multiple LLM providers.
TEN-framework/ten-framework
TEN Framework is a real-time, distributed, cloud-edge collaborative multimodal AI agent framework supporting multiple programming languages for building high-performance AI applications.
google/adk-samples
A collection of sample agents built with the Agent Development Kit (ADK) to accelerate development of conversational and multi-agent workflows, designed for customization and integration with Google Cloud services.
truefoundry/cognita
Cognita is an open-source, modular, and production-ready RAG framework by TrueFoundry that simplifies building, customizing, and deploying scalable Retrieval Augmented Generation applications with a no-code UI and extensive integration features.
lemony-ai/cascadeflow
In-process Python and TypeScript library that cascades model calls inside the agent loop, routing each query or tool call between small and flagship models by quality, cost, latency and budget.
shroominic/codeinterpreter-api
An open-source API that implements the ChatGPT Code Interpreter for sandboxed Python code execution, enabling data analysis, visualization, and interactive AI-driven computational tasks with local execution and scalable production deployment.
agentscope-ai/ReMe
Local-first memory layer for AI agents that converts conversations and resources into readable markdown memory nodes and retrieves them through a hybrid of wikilinks, BM25 and embeddings.