ollama/ollama
Ollama is a versatile platform that enables easy deployment, customization, and management of large language models locally across multiple operating systems with support for various model formats and a REST API.
Awesome AI Agents › AI Agent Deployment
Forethought-Technologies/AutoChain
AutoChain is a lightweight, extensible framework designed to simplify the creation and evaluation of generative agents powered by large language models (LLMs). It addresses the challenges developers face when customizing generative agents for specific use cases, which often require heavy customization and can be overwhelming with existing tools. AutoChain draws inspiration from LangChain and AutoGPT but aims to provide a simpler, more navigable interface for rapid iteration and development of custom agents. The framework supports the integration of custom tools and OpenAI's function calling, enabling agents to perform a variety of tasks with ease. It includes features such as simple memory tracking for conversation history and tool outputs, facilitating better context management during interactions. One of the standout features of AutoChain is its automated multi-turn conversation evaluation system. This system uses simulated conversations with LLM-generated test users to evaluate the agent's performance across different scenarios, making the evaluation process less manual, repetitive, and costly. This approach helps identify regressions and improvements in agent behavior across multiple use cases. AutoChain emphasizes ease of use by minimizing abstraction layers, allowing developers to quickly update prompts and visualize outputs, which is crucial for prompt engineering. The framework is compatible with Python and can be installed via pip or from source. It provides example scripts and detailed documentation to help users get started with building and evaluating conversational agents. Overall, AutoChain is a powerful tool for developers looking to build, customize, and rigorously test generative agents efficiently and effectively.
https://github.com/Forethought-Technologies/AutoChain
Also in AI Agent Deployment
alibaba/nacos
Nacos is a dynamic service discovery, configuration, and service management platform designed to simplify building and managing cloud-native applications and microservices.
e2b-dev/E2B
E2B is an open-source secure cloud runtime infrastructure that enables safe execution of AI-generated code in isolated sandboxes for AI applications and agents.
GoogleCloudPlatform/agent-starter-pack
A collection of production-ready Generative AI Agent templates for Google Cloud that accelerates development by addressing deployment, evaluation, customization, and observability challenges.
zebbern/claude-code-guide
Claude Code Guide is a comprehensive and authoritative resource providing detailed instructions, tips, and references for using the Claude Code CLI tool to interact with the Claude AI model, including advanced features and MCP integration.
boxlite-ai/boxlite
Rust engine giving AI agents hardware-isolated persistent micro-VMs that run any OCI image, embeddable as a daemonless library in Python, Node, Go, Rust or C, or run as a CLI, REST server or cloud control plane.
jim-schwoebel/awesome_ai_agents
A comprehensive and community-driven repository offering over 1,500 curated resources, tools, and projects related to AI agents for various applications and development needs.
nndeploy/nndeploy
nndeploy is a workflow-based multi-platform AI deployment tool that enables efficient, high-performance, and customizable deployment of AI models across cloud, desktop, mobile, and edge platforms using a visual drag-and-drop interface and extensive framework support.