mudler/LocalAI
LocalAI is an open-source AI engine that enables running various AI models (LLMs, vision, voice, image, video) on any hardware, including CPU-only systems, with a composable and extensible architec...
Awesome AI Agents › LLM Framework Tools
genia-dev/GeniA
GeniA is an innovative AI platform designed to act as a virtual engineering team member that works alongside software development teams in their production environments. It leverages the latest advancements in large language models (LLMs) and OpenAI's function-calling capabilities to assist with a wide range of engineering tasks beyond just coding. GeniA is built to be intuitive, powerful, and capable of learning quickly to adapt to the specific workflows and tools used by a team. It integrates seamlessly into team communication channels like Slack, enabling real-time collaboration and task execution. The platform is open source and production-grade, emphasizing reliability and practical utility from the outset. It supports a variety of engineering scenarios including research and development, FinOps, SecOps, SRE, and DevOps. For example, GeniA can deploy Kubernetes services, troubleshoot deployment failures, summarize logs, generate cloud resource usage reports, conduct security vulnerability analyses, manage service scaling, and optimize cloud expenditures. This broad functionality helps reduce boilerplate work, minimize time wastage, and decrease cross-team dependencies. GeniA is designed to be extensible, allowing teams to teach it new tools and capabilities easily. This adaptability ensures that it can grow with the evolving needs of engineering teams. The project also provides comprehensive documentation and encourages community contributions to enhance its features. Future plans include integrating OKTA for single sign-on (SSO), adding role-based access control (RBAC), and expanding its toolset significantly. Overall, GeniA aims to boost engineering productivity by automating routine tasks, providing expert assistance during incidents, and enabling faster, more efficient workflows. It represents a new class of AI-powered team members that augment human engineers rather than replace them, fostering collaboration and innovation in software development environments.
https://github.com/genia-dev/GeniA
Also in LLM Framework Tools
langfuse/langfuse
Langfuse is an open source LLM engineering platform that enables collaborative development, monitoring, evaluation, and debugging of AI applications with comprehensive observability, prompt management, and integration features.
567-labs/instructor
Instructor is a popular Python library that simplifies working with structured outputs from large language models by providing validation, retries, and streaming support across multiple LLM providers.
TEN-framework/ten-framework
TEN Framework is a real-time, distributed, cloud-edge collaborative multimodal AI agent framework supporting multiple programming languages for building high-performance AI applications.
google/adk-samples
A collection of sample agents built with the Agent Development Kit (ADK) to accelerate development of conversational and multi-agent workflows, designed for customization and integration with Google Cloud services.
truefoundry/cognita
Cognita is an open-source, modular, and production-ready RAG framework by TrueFoundry that simplifies building, customizing, and deploying scalable Retrieval Augmented Generation applications with a no-code UI and extensive integration features.
lemony-ai/cascadeflow
In-process Python and TypeScript library that cascades model calls inside the agent loop, routing each query or tool call between small and flagship models by quality, cost, latency and budget.
shroominic/codeinterpreter-api
An open-source API that implements the ChatGPT Code Interpreter for sandboxed Python code execution, enabling data analysis, visualization, and interactive AI-driven computational tasks with local execution and scalable production deployment.