Awesome AI Agents › AI Assistants

firecrawl/open-scouts

⭐ 1363 TypeScript repository created 2025-11-28

Open Scouts is an open-source monitoring platform from Firecrawl in which a user defines scouts, automated tasks that run on a schedule and continuously search the web for a described target, then send a notification when they find it. Typical examples given are watching for new restaurants nearby or tracking AI news, but the pattern generalises to any recurring information hunt. The stack is Next.js 15 with React 19, TypeScript and Tailwind CSS v4 on the front end, and Supabase for the database, authentication and Edge Functions on the back end. Retrieval and scraping go through the Firecrawl SDK, while OpenAI supplies both the agent that runs a scout and the embeddings stored in pgvector, which power semantic search over AI-generated summaries of past executions. Resend delivers email notifications. Setup is scripted: after cloning and installing dependencies, the user creates a Supabase project, enables the pg_cron, pg_net, vector and supabase_vault extensions, fills in an environment file, links the project with the Supabase CLI and runs a database setup task. That task creates the scouts, scout_executions and scout_execution_steps tables, adds user columns and row level security, enables realtime subscriptions, configures a dispatcher architecture built on pg_cron and pg_net with credentials held in the vault, registers cron jobs for dispatching and cleanup, and syncs the API keys into Edge Function secrets. Two Edge Functions are deployed, one that runs scouts on the cron schedule and one that sends a test email. Authentication supports email and password out of the box and optional Google OAuth. Firecrawl keys can be entered per user in the application settings so usage is billed to each account, with a shared server-side key available for self-hosted deployments.

https://github.com/firecrawl/open-scouts

web-monitoringautonomous-agentsfirecrawlsupabasenotifications