mudler/LocalAI
LocalAI is an open-source AI engine that enables running various AI models (LLMs, vision, voice, image, video) on any hardware, including CPU-only systems, with a composable and extensible architec...
Awesome AI Agents › LLM Framework Tools
proficientai/js
Proficient AI is a platform designed to enable developers to integrate conversational AI agents into their applications quickly and efficiently, typically within minutes. This project is a TypeScript/JavaScript monorepo that houses the source code for Proficient AI's SDKs, including React, Admin, and Client SDKs. These SDKs provide interaction APIs and tools that simplify the process of adding and managing large language model (LLM)-powered conversational agents in end-user applications. The platform also includes a powerful web dashboard that supports teams in operating these AI agents effectively. The repository is currently in private beta, indicating that it is in an early access phase for select users. The project is licensed under the AGPL-3.0 License, promoting open-source collaboration while ensuring that derivative works remain open. The documentation is comprehensive and accessible online, and there is an active community available through a Discord server for support and engagement. The project aims to streamline the integration of conversational AI, making it accessible for developers to enhance their applications with advanced AI-driven conversational capabilities without extensive development overhead. This makes it a valuable tool for teams looking to leverage AI in customer service, virtual assistants, or any application requiring natural language interaction.
https://github.com/proficientai/js
Also in LLM Framework Tools
langfuse/langfuse
Langfuse is an open source LLM engineering platform that enables collaborative development, monitoring, evaluation, and debugging of AI applications with comprehensive observability, prompt management, and integration features.
567-labs/instructor
Instructor is a popular Python library that simplifies working with structured outputs from large language models by providing validation, retries, and streaming support across multiple LLM providers.
TEN-framework/ten-framework
TEN Framework is a real-time, distributed, cloud-edge collaborative multimodal AI agent framework supporting multiple programming languages for building high-performance AI applications.
google/adk-samples
A collection of sample agents built with the Agent Development Kit (ADK) to accelerate development of conversational and multi-agent workflows, designed for customization and integration with Google Cloud services.
truefoundry/cognita
Cognita is an open-source, modular, and production-ready RAG framework by TrueFoundry that simplifies building, customizing, and deploying scalable Retrieval Augmented Generation applications with a no-code UI and extensive integration features.
lemony-ai/cascadeflow
In-process Python and TypeScript library that cascades model calls inside the agent loop, routing each query or tool call between small and flagship models by quality, cost, latency and budget.
shroominic/codeinterpreter-api
An open-source API that implements the ChatGPT Code Interpreter for sandboxed Python code execution, enabling data analysis, visualization, and interactive AI-driven computational tasks with local execution and scalable production deployment.