GetStream/Vision-Agents
Open Vision Agents by Stream is a platform for building real-time, low-latency multi-modal AI agents that understand and interact with video content using advanced models and Stream's edge network.
Awesome AI Agents › Video Processing Agents
microsoft/DeepVideoDiscovery
Deep Video Discovery is the official implementation of a NeurIPS 2025 paper from Microsoft on agentic search for understanding very long videos. Rather than feeding a whole video to a multimodal model at once, the system segments the video into clips and treats that segmented collection as an environment the agent explores. A large language model plans autonomously, chooses among tools that work at different granularities, from a global browse tool that reasons over textual descriptions of many clips down to detailed inspection of a single segment, and iterates: it extracts evidence, summarises and reflects on what it has observed, then decides what to look at next until it can answer the user question. This deep research style loop lets the agent answer complex questions about hours of footage without processing every frame at full detail. The repository provides the agent code, configuration for both the OpenAI API and Azure OpenAI, a local run script that takes a YouTube URL and a question, and a Gradio demo with automatic subtitle support. A lite mode uses subtitles only, which suits podcast style recordings and lowers cost. Reported results place the method well ahead of prior work on several long video benchmarks, including LVBench, Video-MME, LongVideoBench and EgoSchema, and the authors publish precomputed captions for those benchmarks together with a reproduction guide so the numbers can be checked. Compared with the original paper code, the released version was refactored for readability and the global browse tool was changed to use textual clip descriptions instead of raw pixels for efficiency. It targets researchers and engineers building video understanding systems and anyone studying tool-using agents over non-text environments.
https://github.com/microsoft/DeepVideoDiscovery
Also in Video Processing Agents
RayVentura/ShortGPT
ShortGPT is an AI-powered framework that automates video content creation and editing for platforms like YouTube Shorts and TikTok, supporting multi-language voiceovers and automated footage sourcing.
showlab/Awesome-Video-Diffusion
A curated list of recent diffusion models and resources for video generation, editing, restoration, and various AI-driven video applications.
dramaclaw/dramaclaw
Source-available AIGC video production pipeline that turns a manuscript into a finished short drama, handling character extraction, episode planning, scripts, storyboards, voice-over and final editing.
nexu-io/html-video
Apache-2.0 toolkit that lets local coding agents turn HTML, CSS and data into real MP4 video through pluggable render engines, 21 animated templates and an optional AI soundtrack.
HKUDS/VideoAgent
Multi-agent framework for video understanding, editing and generation that parses user intent, builds a graph-based tool workflow and produces edited or newly created videos from natural language.
video-db/Director
Director is an AI video agents framework that enables complex video tasks like search, editing, and generation through natural language commands and real-time streaming, built on VideoDB's video-as-data infrastructure.
video-db/StreamRAG
StreamRAG is a GPT-powered video search and streaming agent that enables real-time video search, summarization, and publishing of searchable video collections on the ChatGPT store.