browser-use/browser-use
Browser-use is a project that enables AI agents to control and automate web browsers, allowing users to perform complex tasks through natural language commands and AI-driven browser interactions.
Awesome AI Agents › Browser Automation Tools
OSU-NLP-Group/Mind2Web
Mind2Web is a pioneering dataset and framework designed to develop and evaluate generalist web agents capable of following natural language instructions to perform complex tasks across a wide variety of real-world websites. Unlike previous datasets that rely on simulated or limited website environments, Mind2Web encompasses over 2,000 open-ended tasks collected from 137 websites spanning 31 diverse domains, providing a rich and realistic environment for training and testing web agents. The dataset includes crowdsourced action sequences that detail the steps required to complete each task, capturing a broad spectrum of user interaction patterns such as clicking, typing, and selecting elements on web pages. The project offers a comprehensive dataset structure with training and multiple test splits designed to evaluate generalization across tasks, websites, and domains. The training set contains over a thousand instances, while the test sets are divided into cross-task, cross-website, and cross-domain splits to rigorously assess the agent's ability to handle unseen tasks and environments. Each data instance includes detailed annotations such as unique task IDs, website and domain information, task descriptions, and step-by-step action sequences with corresponding HTML snapshots before each action. Mind2Web also provides raw data dumps with full traces, network traffic captures, video recordings, and snapshots to facilitate in-depth analysis and replay of user interactions. The project is actively maintained with updates including fine-tuning code, models, and related datasets like Multimodal-Mind2Web, which pairs HTML documents with webpage screenshots for multimodal learning. Additionally, the project links to follow-up works such as SeeAct, which enables GPT-4V-based web agents. Overall, Mind2Web represents a significant advancement in building versatile and robust web agents that can operate across diverse real-world websites by leveraging a large-scale, richly annotated dataset and comprehensive tooling for training, evaluation, and analysis.
https://github.com/OSU-NLP-Group/Mind2Web
Also in Browser Automation Tools
CloakHQ/CloakBrowser
CloakBrowser provides a stealthy Chromium binary with C++ source-level fingerprint patches to pass bot detection, serving as a drop-in Playwright/Puppeteer replacement.
jackwener/OpenCLI
OpenCLI converts any website or local tool into a command-line interface, enabling both human interaction and AI agent automation through logged-in browser sessions.
browserbase/stagehand
Stagehand is a production-ready AI web browsing framework that combines code and natural language to enable reliable and extensible browser automation.
browser-use/web-ui
A web-based user interface, powered by Gradio, for interacting with browser automation agents, supporting various LLMs and custom browser configurations.
citrolabs/ego-lite
ego lite is a specialized browser designed for AI agents to perform web automation in parallel with human browsing, offering isolated workspaces and enhanced page snapshots.
jo-inc/camofox-browser
Camofox-browser is a stealth headless browser server, powered by Camoufox (a Firefox fork), designed for AI agents to bypass bot detection and Cloudflare, offering a Puppeteer/Playwright alternative.
microsoft/fara
Fara-7B is a compact and efficient agentic small language model by Microsoft designed to perform multi-step computer tasks through visual interaction, achieving state-of-the-art performance on web automation benchmarks while enabling on-device deployment for privacy and low latency.