ollama/ollama
Ollama is a versatile platform that enables easy deployment, customization, and management of large language models locally across multiple operating systems with support for various model formats and a REST API.
Awesome AI Agents › AI Agent Deployment
MLT-OSS/open-assistant-api
Open Assistant API is an open-source, self-hosted AI intelligent assistant API designed to provide a ready-to-use framework for creating and orchestrating AI agents and GPTs. It supports extensive customization and extension capabilities, including integration with large language models (LLMs), retrieval-augmented generation (RAG) engines, function calls, and various tools. The API is compatible with the official OpenAI interface, allowing developers to use it seamlessly with the OpenAI Python client and other SDKs like LangChain. It supports multiple LLMs beyond just GPT models by integrating with One API, enabling broader model compatibility. The API also supports RAG engines such as R2R, which enhances its ability to handle diverse file types including text, HTML, markdown, PDF, DOCX, PPTX, XLSX, PNG, MP3, and MP4, providing a robust retrieval and generation mechanism. Open Assistant API offers features like internet search integration, custom functions, extendable built-in tools, message streaming output for smoother user experience, and local deployment options, which are not fully supported by the official OpenAI assistant API. It supports simple user isolation and token-based authentication to meet SaaS deployment needs. The project provides a Docker Compose setup for easy deployment and configuration, including API keys for OpenAI and Bing search. It also supports tool integration to connect with external systems, enabling functionalities like code execution and access to proprietary information sources. The community is active with Slack, Discord, and WeChat channels for support and collaboration. The project is licensed under the MIT license and encourages contributions from the community.
https://github.com/MLT-OSS/open-assistant-api
Also in AI Agent Deployment
alibaba/nacos
Nacos is a dynamic service discovery, configuration, and service management platform designed to simplify building and managing cloud-native applications and microservices.
e2b-dev/E2B
E2B is an open-source secure cloud runtime infrastructure that enables safe execution of AI-generated code in isolated sandboxes for AI applications and agents.
GoogleCloudPlatform/agent-starter-pack
A collection of production-ready Generative AI Agent templates for Google Cloud that accelerates development by addressing deployment, evaluation, customization, and observability challenges.
zebbern/claude-code-guide
Claude Code Guide is a comprehensive and authoritative resource providing detailed instructions, tips, and references for using the Claude Code CLI tool to interact with the Claude AI model, including advanced features and MCP integration.
boxlite-ai/boxlite
Rust engine giving AI agents hardware-isolated persistent micro-VMs that run any OCI image, embeddable as a daemonless library in Python, Node, Go, Rust or C, or run as a CLI, REST server or cloud control plane.
jim-schwoebel/awesome_ai_agents
A comprehensive and community-driven repository offering over 1,500 curated resources, tools, and projects related to AI agents for various applications and development needs.
Forethought-Technologies/AutoChain
AutoChain is a lightweight and extensible framework that simplifies building and automatically evaluating custom generative agents powered by large language models using custom tools and simulated multi-turn conversations.