firecrawl/firecrawl
Firecrawl is an advanced web data API that crawls and scrapes entire websites to convert content into clean, LLM-ready markdown or structured data for AI applications.
Awesome AI Agents › Web Automation Systems
Web Automation Systems
nanobrowser/nanobrowser
Nanobrowser is an open-source Chrome extension that enables AI-powered web automation through a multi-agent system using user-configured LLM API keys, offering a privacy-focused and cost-effective alternative to commercial tools like OpenAI Operator.
steel-dev/steel-browser
Steel Browser is an open-source browser API that enables developers to build AI-powered web agents and automation tools with full browser control, session management, proxy support, and debugging features, simplifying web automation without infrastructure overhead.
fake-useragent/fake-useragent
fake-useragent is a Python package that provides an up-to-date and customizable user-agent faker using a real-world database for realistic user-agent strings.
ishan0102/vimGPT
vimGPT is a project that combines GPT-4V's vision capabilities with the Vimium keyboard navigation extension to enable AI-assisted web browsing through visual and keyboard interactions.
brightdata/brightdata-mcp
Bright Data MCP is a powerful Model Context Protocol server that enables AI agents and applications to access and extract real-time web data seamlessly, bypassing geo-restrictions and bot protections for enhanced web scraping and navigation.
spider-rs/spider
A concurrency-first web crawler and scraper written in Rust that streams pages as they arrive and renders JavaScript only when needed, with bindings for Node.js and Python and an MCP server for agents.
nottelabs/notte
Notte is an open-source full stack framework that creates intelligent web browsing agents using a perception layer to enable fast, reliable, and cost-effective interactions with websites through large language models.
TaxyAI/browser-extension
Taxy AI is an open-source Chrome extension that uses GPT-4 to automate repetitive browser tasks by interpreting natural language instructions and interacting with web pages through an action cycle.
EmergenceAI/Agent-E
Agent-E is an agent-based automation system that enables natural language-driven web browser automation and multi-agent orchestration for personal and enterprise use.
theredsix/cerebellum
Cerebellum is a lightweight browser automation system that uses AI-driven planning with a large language model to navigate web pages and perform user-defined goals through keyboard and mouse actions.
OSU-NLP-Group/SeeAct
SeeAct is a system that enables autonomous generalist web agents to perform tasks on any website using large multimodal models like GPT-4V, supported by a robust codebase and innovative framework for live web interaction.
steel-dev/surf.new
surf.new is an open-source playground for testing and visualizing AI-powered web agents interacting with the web in real-time, built with modern web technologies and supporting multiple AI providers.
OTA-Tech-AI/web-agent-protocol
Web Agent Protocol (WAP) is a standardized framework for recording, converting, and replaying user interactions in browsers to enable efficient and reusable web automation with MCP support.
idosal/AgentLLM
AgentLLM is a proof-of-concept project that enables autonomous agents powered by open-source large language models to run efficiently and privately within web browsers using GPU acceleration.
dendrite-systems/dendrite-python-sdk
Dendrite is an open-source framework for building intelligent web AI agents that can authenticate, interact with, and extract data from any website in a human-like manner.
iMeanAI/WebCanvas
WebCanvas is an open-source framework for building, training, and evaluating web agents in live, dynamic web environments using key-node based evaluation and modular components.
kohjingyu/search-agents
This project implements an inference-time tree search algorithm to enable language model agents to perform exploration and multi-step planning in interactive web environments, demonstrated on VisualWebArena and WebArena benchmarks.
McGill-NLP/weblinx
WebLINX is a benchmark and toolkit for building and evaluating conversational web navigation agents through multi-turn dialogues on real-world websites.
stanfordnlp/wge
wge is a research codebase for training sample-efficient reinforcement learning agents to perform web tasks specified by natural language instructions using workflow-guided exploration.
ykyritsis/ChatGPT-code-preview
A Chrome extension that enhances ChatGPT by providing live previews, syntax highlighting, and interaction capabilities for code snippets within the chat interface.
platonai/PulsarRPA
PulsarRPA is a high-performance, distributed, open-source RPA framework designed for large-scale web automation and accurate data extraction from complex websites using AI and advanced crawling techniques.