ollama/ollama
Ollama is a versatile platform that enables easy deployment, customization, and management of large language models locally across multiple operating systems with support for various model formats and a REST API.
Awesome AI Agents › AI Agent Deployment
ArcadeAI/arcade-ai
ArcadeAI/arcade-ai is a comprehensive developer platform designed to facilitate the creation, deployment, and management of tools for AI agents. The project provides a Python SDK and CLI that enable developers to build powerful, secure tools that AI agents can use to interact with the world. The platform supports the development of toolkits, which are collections of related tools tailored to specific services, use cases, or agents. These toolkits are distributed as Python packages, allowing for easy versioning, dependency management, and distribution. The Arcade Tool SDK simplifies the process of creating new tools and integrating them with large language models (LLMs). Developers can install the SDK via pip, log in through the CLI, and start building tools immediately. The SDK supports customization and extension of existing tools, as well as the creation of entirely new ones. Once developed, toolkits can be deployed to Arcade Cloud, making them accessible for LLMs to call and use. The platform also includes features for evaluating tools and LLMs, with optional extras for enhanced functionality. The CLI provides commands to show hosted tools, inspect toolkits, and interact with tools through a chat interface that allows natural language commands to trigger tool actions. This makes it easy to test and use tools without complex setup. ArcadeAI emphasizes community and support, offering documentation, quickstart guides, and channels for contact and collaboration. The project is open-source under the MIT license and actively maintained, with integration capabilities for various agent frameworks and authentication APIs. Overall, ArcadeAI/arcade-ai is a robust and user-friendly platform for developers looking to build AI agent tools efficiently, deploy them seamlessly, and manage their lifecycle with ease.
https://github.com/ArcadeAI/arcade-ai
Also in AI Agent Deployment
alibaba/nacos
Nacos is a dynamic service discovery, configuration, and service management platform designed to simplify building and managing cloud-native applications and microservices.
e2b-dev/E2B
E2B is an open-source secure cloud runtime infrastructure that enables safe execution of AI-generated code in isolated sandboxes for AI applications and agents.
GoogleCloudPlatform/agent-starter-pack
A collection of production-ready Generative AI Agent templates for Google Cloud that accelerates development by addressing deployment, evaluation, customization, and observability challenges.
zebbern/claude-code-guide
Claude Code Guide is a comprehensive and authoritative resource providing detailed instructions, tips, and references for using the Claude Code CLI tool to interact with the Claude AI model, including advanced features and MCP integration.
boxlite-ai/boxlite
Rust engine giving AI agents hardware-isolated persistent micro-VMs that run any OCI image, embeddable as a daemonless library in Python, Node, Go, Rust or C, or run as a CLI, REST server or cloud control plane.
jim-schwoebel/awesome_ai_agents
A comprehensive and community-driven repository offering over 1,500 curated resources, tools, and projects related to AI agents for various applications and development needs.
Forethought-Technologies/AutoChain
AutoChain is a lightweight and extensible framework that simplifies building and automatically evaluating custom generative agents powered by large language models using custom tools and simulated multi-turn conversations.