ollama/ollama
Ollama is a versatile platform that enables easy deployment, customization, and management of large language models locally across multiple operating systems with support for various model formats and a REST API.
Awesome AI Agents › AI Agent Deployment
GoogleCloudPlatform/agent-starter-pack
The GoogleCloudPlatform/agent-starter-pack is a comprehensive collection of production-ready Generative AI Agent templates designed specifically for Google Cloud. It aims to accelerate the development process by providing a holistic and production-ready solution that addresses common challenges encountered when building and deploying Generative AI agents. These challenges include deployment and operations, evaluation, customization, and observability. The starter pack offers a variety of pre-built agent templates such as ReAct, Retrieval-Augmented Generation (RAG), multi-agent systems, and a live multimodal API agent. These templates serve as foundational building blocks that developers can launch quickly, experiment with, deploy in production, and customize to meet specific needs. The pack supports integration with Google Cloud services like Vertex AI for evaluation and monitoring, Cloud Run and Agent Engine for deployment, and includes CI/CD automation to streamline continuous integration and delivery. Users can get started rapidly by installing the package, creating a new agent project, and immediately having a fully functional agent with backend, frontend, and deployment infrastructure. The starter pack also supports advanced features like a data pipeline for RAG using Terraform and CI/CD, enabling seamless embedding processing and integration with Vertex AI Search and Vector Search. The architecture covers the entire lifecycle of agent development from prototyping and evaluation to deployment and monitoring, ensuring a robust and scalable solution. The project is well-documented with guides on installation, deployment, observability, data ingestion, and troubleshooting. It also provides video walkthroughs and encourages community contributions. Overall, this project is an essential toolkit for developers looking to build, deploy, and manage Generative AI agents efficiently on Google Cloud, leveraging best practices and production-ready infrastructure.
https://github.com/GoogleCloudPlatform/agent-starter-pack
Also in AI Agent Deployment
alibaba/nacos
Nacos is a dynamic service discovery, configuration, and service management platform designed to simplify building and managing cloud-native applications and microservices.
e2b-dev/E2B
E2B is an open-source secure cloud runtime infrastructure that enables safe execution of AI-generated code in isolated sandboxes for AI applications and agents.
zebbern/claude-code-guide
Claude Code Guide is a comprehensive and authoritative resource providing detailed instructions, tips, and references for using the Claude Code CLI tool to interact with the Claude AI model, including advanced features and MCP integration.
boxlite-ai/boxlite
Rust engine giving AI agents hardware-isolated persistent micro-VMs that run any OCI image, embeddable as a daemonless library in Python, Node, Go, Rust or C, or run as a CLI, REST server or cloud control plane.
jim-schwoebel/awesome_ai_agents
A comprehensive and community-driven repository offering over 1,500 curated resources, tools, and projects related to AI agents for various applications and development needs.
Forethought-Technologies/AutoChain
AutoChain is a lightweight and extensible framework that simplifies building and automatically evaluating custom generative agents powered by large language models using custom tools and simulated multi-turn conversations.
nndeploy/nndeploy
nndeploy is a workflow-based multi-platform AI deployment tool that enables efficient, high-performance, and customizable deployment of AI models across cloud, desktop, mobile, and edge platforms using a visual drag-and-drop interface and extensive framework support.