Awesome AI AgentsBrowser Automation Tools

magicgh/Self-MAP

⭐ 16 Python added to this list on 2025-04-19 repository created 2024-02-22

Self-MAP is an advanced project focused on improving multi-turn instruction following for conversational web agents, as presented in the ACL 2024 paper titled "On the Multi-turn Instruction Following for Conversational Web Agents." The project provides an official implementation of the methods described in the paper and utilizes the MT-Mind2Web dataset, which is specifically designed for training and evaluating conversational web agents in multi-turn dialogue scenarios. The repository includes detailed setup instructions, requiring Python 3.11 or lower and installation of necessary dependencies. Users are guided to download the MT-Mind2Web dataset and configure paths for data and logs in configuration files. The project is divided into two main components: Candidate Generation and Conversational Action Planning. Candidate Generation involves fine-tuning models like DeBERTa-v3-base to rank and score element candidates within test sets, with scripts provided for training, evaluation, and generating pickle files for further use. Conversational Action Planning focuses on fine-tuning models such as FLAN-T5-base for predicting conversational actions, with support for distributed training across multiple GPUs. The repository also supports enabling various modules like generation, memory simplification, memory refinement, and multifaceted matching to enhance the model's capabilities. The codebase is derived from the Mind2Web project and is licensed under the MIT License, while the MT-Mind2Web dataset is available under the CC-BY-4.0 license. The project is well-documented, including citation information for academic use. Overall, Self-MAP aims to advance the state-of-the-art in conversational AI by enabling web agents to better understand and follow complex, multi-turn instructions in web-based interactions.

https://github.com/magicgh/Self-MAP

acl-2024candidate-generationconversational-action-planningconversational-aiconversational-web-agentsdeberta-v3-basedistributed-trainingfine-tuningflan-t5-basememory-refinementmt-mind2web-datasetmulti-turn-dialoguemulti-turn-instruction-followingmultifaceted-matchingweb-interaction

Also in Browser Automation Tools

browser-use/browser-use

Browser-use is a project that enables AI agents to control and automate web browsers, allowing users to perform complex tasks through natural language commands and AI-driven browser interactions.

CloakHQ/CloakBrowser

CloakBrowser provides a stealthy Chromium binary with C++ source-level fingerprint patches to pass bot detection, serving as a drop-in Playwright/Puppeteer replacement.

jackwener/OpenCLI

OpenCLI converts any website or local tool into a command-line interface, enabling both human interaction and AI agent automation through logged-in browser sessions.

browserbase/stagehand

Stagehand is a production-ready AI web browsing framework that combines code and natural language to enable reliable and extensible browser automation.

browser-use/web-ui

A web-based user interface, powered by Gradio, for interacting with browser automation agents, supporting various LLMs and custom browser configurations.

citrolabs/ego-lite

ego lite is a specialized browser designed for AI agents to perform web automation in parallel with human browsing, offering isolated workspaces and enhanced page snapshots.

jo-inc/camofox-browser

Camofox-browser is a stealth headless browser server, powered by Camoufox (a Firefox fork), designed for AI agents to bypass bot detection and Cloudflare, offering a Puppeteer/Playwright alternative.

microsoft/fara

Fara-7B is a compact and efficient agentic small language model by Microsoft designed to perform multi-step computer tasks through visual interaction, achieving state-of-the-art performance on web automation benchmarks while enabling on-device deployment for privacy and low latency.