ollama/ollama
Ollama is a versatile platform that enables easy deployment, customization, and management of large language models locally across multiple operating systems with support for various model formats and a REST API.
Awesome AI Agents › AI Agent Deployment
C0deMunk33/bespoke_automata
Bespoke Automata is a sophisticated software platform designed to create, test, and deploy complex AI agents locally and offline. It provides a graphical user interface (GUI) based on a directed graph system, allowing users to design AI brains by combining large language models with various instruments such as database input/output, dictionaries, arrays, logic, and APIs. This modular approach enables the creation of powerful AI agents capable of pursuing specific goals set by their designers. The platform supports both local and remote execution of language models, enhancing flexibility and control over AI deployment. The GUI is powered by a modified version of litegraph, making it familiar to users of similar node-based UI systems like ComfyUI. Bespoke Automata also offers a deployment pipeline that exposes each designed brain as a separate API endpoint, simplifying integration with other applications. The backend supports text and vision models, leveraging llama-cpp-python for inference tasks. Users can place their models in designated folders and configure the system to run on various hardware setups, including CPU, CUDA-enabled GPUs, and Apple Silicon with Metal support. Installation requires some technical proficiency, as it involves setting up dependencies such as NPM, Electron-forge, Yarn, Python, Flask, and sentence_transformers. GPU support is optional but recommended for enhanced performance. The platform is currently in development, and users are encouraged to report issues and contribute to its improvement via GitHub or Discord. Overall, Bespoke Automata is a powerful tool for AI developers and researchers who want to build custom AI agents with complex behaviors and deploy them efficiently through user-friendly APIs, all while maintaining control over their local environment and data privacy.
https://github.com/C0deMunk33/bespoke_automata
Also in AI Agent Deployment
alibaba/nacos
Nacos is a dynamic service discovery, configuration, and service management platform designed to simplify building and managing cloud-native applications and microservices.
e2b-dev/E2B
E2B is an open-source secure cloud runtime infrastructure that enables safe execution of AI-generated code in isolated sandboxes for AI applications and agents.
GoogleCloudPlatform/agent-starter-pack
A collection of production-ready Generative AI Agent templates for Google Cloud that accelerates development by addressing deployment, evaluation, customization, and observability challenges.
zebbern/claude-code-guide
Claude Code Guide is a comprehensive and authoritative resource providing detailed instructions, tips, and references for using the Claude Code CLI tool to interact with the Claude AI model, including advanced features and MCP integration.
boxlite-ai/boxlite
Rust engine giving AI agents hardware-isolated persistent micro-VMs that run any OCI image, embeddable as a daemonless library in Python, Node, Go, Rust or C, or run as a CLI, REST server or cloud control plane.
jim-schwoebel/awesome_ai_agents
A comprehensive and community-driven repository offering over 1,500 curated resources, tools, and projects related to AI agents for various applications and development needs.
Forethought-Technologies/AutoChain
AutoChain is a lightweight and extensible framework that simplifies building and automatically evaluating custom generative agents powered by large language models using custom tools and simulated multi-turn conversations.