GetStream/Vision-Agents
Open Vision Agents by Stream is a platform for building real-time, low-latency multi-modal AI agents that understand and interact with video content using advanced models and Stream's edge network.
Awesome AI Agents › Video Processing Agents
showlab/Awesome-Video-Diffusion
The project 'Awesome Video Diffusion' is a curated list that compiles recent advancements and models in the field of video diffusion technology. It focuses on various applications such as video generation, editing, restoration, understanding, neural radiance fields (nerf), and more. The repository serves as a comprehensive resource for researchers, developers, and enthusiasts interested in the latest diffusion models that enable the creation and manipulation of video content through AI-driven techniques. The list includes open-source toolboxes and foundation models that provide the backbone for video diffusion tasks. It also covers evaluation benchmarks and metrics to assess the performance of these models. The project highlights commercial products that utilize diffusion models for video applications, showcasing practical implementations. Key areas covered include video generation, efficient video generation, controllable video generation, character and motion customization, long video and film generation, and video generation with 3D or physical priors. Additionally, it addresses video editing, human or subject motion, video enhancement and restoration, audio synthesis for video, talking head generation, and human/AI feedback mechanisms for video generation. The repository also explores policy learning, virtual try-on, 3D and 4D video technologies, game generation, AI safety, rendering with virtual engines, open-world models, video understanding, healthcare and biology applications, and other miscellaneous applications. It provides links to various projects, papers, and websites, making it a valuable hub for anyone looking to explore or contribute to the field of video diffusion. Overall, 'Awesome Video Diffusion' is an extensive and well-organized collection that facilitates access to cutting-edge research and tools in video diffusion, promoting innovation and collaboration in this rapidly evolving domain.
https://github.com/showlab/Awesome-Video-Diffusion
Also in Video Processing Agents
RayVentura/ShortGPT
ShortGPT is an AI-powered framework that automates video content creation and editing for platforms like YouTube Shorts and TikTok, supporting multi-language voiceovers and automated footage sourcing.
dramaclaw/dramaclaw
Source-available AIGC video production pipeline that turns a manuscript into a finished short drama, handling character extraction, episode planning, scripts, storyboards, voice-over and final editing.
nexu-io/html-video
Apache-2.0 toolkit that lets local coding agents turn HTML, CSS and data into real MP4 video through pluggable render engines, 21 animated templates and an optional AI soundtrack.
HKUDS/VideoAgent
Multi-agent framework for video understanding, editing and generation that parses user intent, builds a graph-based tool workflow and produces edited or newly created videos from natural language.
video-db/Director
Director is an AI video agents framework that enables complex video tasks like search, editing, and generation through natural language commands and real-time streaming, built on VideoDB's video-as-data infrastructure.
video-db/StreamRAG
StreamRAG is a GPT-powered video search and streaming agent that enables real-time video search, summarization, and publishing of searchable video collections on the ChatGPT store.
microsoft/DeepVideoDiscovery
Microsoft research agent for long-form video question answering that treats segmented clips as an environment and iteratively selects multi-granular search tools, reaching state of the art on LVBench.