mudler/LocalAI
LocalAI is an open-source AI engine that enables running various AI models (LLMs, vision, voice, image, video) on any hardware, including CPU-only systems, with a composable and extensible architec...
Awesome AI Agents › LLM Framework Tools
patterns-ai-core/langchainrb
Langchain.rb is a Ruby gem designed to facilitate the development of applications powered by Large Language Models (LLMs). It provides a unified interface to interact with various LLM providers such as OpenAI, Anthropic, AI21, Google Gemini, Cohere, HuggingFace, and others, allowing developers to switch between different backends seamlessly without altering their application code. The gem supports key functionalities including generating embeddings, prompt completions, and chat completions, making it versatile for a wide range of natural language processing tasks. The project offers comprehensive features such as prompt management with templates and few-shot learning capabilities, output parsers, and tools for building Retrieval Augmented Generation (RAG) systems and chat assistants. It also includes evaluation tools and logging support to aid in development and debugging. Langchain.rb is designed with modularity in mind, allowing users to include only the necessary components for their specific use cases. Installation is straightforward via RubyGems or Bundler, and the gem integrates deeply with Ruby on Rails through a companion gem, langchainrb_rails. The gem is actively maintained with continuous integration and documentation available online. It supports advanced parameters for fine-tuning LLM outputs such as temperature, top_p, presence and frequency penalties, and token limits. Langchain.rb is ideal for developers looking to build intelligent applications like chatbots, virtual assistants, and systems that leverage vector search and RAG techniques within the Ruby ecosystem. Its abstraction over multiple LLM providers and rich feature set make it a powerful tool for harnessing the capabilities of modern AI language models in Ruby applications.
https://github.com/patterns-ai-core/langchainrb
Also in LLM Framework Tools
langfuse/langfuse
Langfuse is an open source LLM engineering platform that enables collaborative development, monitoring, evaluation, and debugging of AI applications with comprehensive observability, prompt management, and integration features.
567-labs/instructor
Instructor is a popular Python library that simplifies working with structured outputs from large language models by providing validation, retries, and streaming support across multiple LLM providers.
TEN-framework/ten-framework
TEN Framework is a real-time, distributed, cloud-edge collaborative multimodal AI agent framework supporting multiple programming languages for building high-performance AI applications.
google/adk-samples
A collection of sample agents built with the Agent Development Kit (ADK) to accelerate development of conversational and multi-agent workflows, designed for customization and integration with Google Cloud services.
truefoundry/cognita
Cognita is an open-source, modular, and production-ready RAG framework by TrueFoundry that simplifies building, customizing, and deploying scalable Retrieval Augmented Generation applications with a no-code UI and extensive integration features.
lemony-ai/cascadeflow
In-process Python and TypeScript library that cascades model calls inside the agent loop, routing each query or tool call between small and flagship models by quality, cost, latency and budget.
shroominic/codeinterpreter-api
An open-source API that implements the ChatGPT Code Interpreter for sandboxed Python code execution, enabling data analysis, visualization, and interactive AI-driven computational tasks with local execution and scalable production deployment.