ollama/ollama
Ollama is a versatile platform that enables easy deployment, customization, and management of large language models locally across multiple operating systems with support for various model formats and a REST API.
Awesome AI Agents › AI Agent Deployment
alibaba/nacos
Nacos is a dynamic service discovery, configuration, and service management platform designed to facilitate the development of cloud-native applications and microservices. It supports various types of services including Dubbo/gRPC, Spring Cloud RESTful, and Kubernetes services, making it versatile for different cloud environments. The platform offers four main functionalities: service discovery and health checks, dynamic configuration management, dynamic DNS service, and service and metadata management. Service discovery allows services to register themselves and discover others via DNS or HTTP interfaces, with real-time health checks to avoid routing to unhealthy instances. Dynamic configuration management centralizes and streamlines configuration updates across environments without requiring redeployment, enhancing agility and efficiency. The dynamic DNS service supports weighted routing for load balancing, flexible routing policies, and flow control, simplifying DNS-based service discovery and reducing vendor lock-in. Additionally, Nacos provides a user-friendly dashboard for managing service metadata, configurations, Kubernetes DNS, health, and metrics. The project offers easy deployment options including cloud deployment and standalone server startup packages for various operating systems. Comprehensive documentation, quick start guides, and integration examples with other open-source projects like Dubbo, Spring Cloud, and Kubernetes are available. The community is active with multiple channels for support and contribution, including Gitter, GitHub issues, and mailing lists. Nacos also has related projects for Spring integration and ecosystem tools. Enterprise support and cloud product services are available through Alibaba Cloud's microservice engine. Overall, Nacos is a robust platform aimed at simplifying service management and configuration in modern cloud-native architectures, promoting efficient service discovery, configuration agility, and operational ease.
https://github.com/alibaba/nacos
Also in AI Agent Deployment
e2b-dev/E2B
E2B is an open-source secure cloud runtime infrastructure that enables safe execution of AI-generated code in isolated sandboxes for AI applications and agents.
GoogleCloudPlatform/agent-starter-pack
A collection of production-ready Generative AI Agent templates for Google Cloud that accelerates development by addressing deployment, evaluation, customization, and observability challenges.
zebbern/claude-code-guide
Claude Code Guide is a comprehensive and authoritative resource providing detailed instructions, tips, and references for using the Claude Code CLI tool to interact with the Claude AI model, including advanced features and MCP integration.
boxlite-ai/boxlite
Rust engine giving AI agents hardware-isolated persistent micro-VMs that run any OCI image, embeddable as a daemonless library in Python, Node, Go, Rust or C, or run as a CLI, REST server or cloud control plane.
jim-schwoebel/awesome_ai_agents
A comprehensive and community-driven repository offering over 1,500 curated resources, tools, and projects related to AI agents for various applications and development needs.
Forethought-Technologies/AutoChain
AutoChain is a lightweight and extensible framework that simplifies building and automatically evaluating custom generative agents powered by large language models using custom tools and simulated multi-turn conversations.
nndeploy/nndeploy
nndeploy is a workflow-based multi-platform AI deployment tool that enables efficient, high-performance, and customizable deployment of AI models across cloud, desktop, mobile, and edge platforms using a visual drag-and-drop interface and extensive framework support.