This repository is a curated list of tools, frameworks, and resources for building AI agents that can interact with the web. It serves as a comprehensive directory for developers, researchers, and power users interested in autonomous web navigation, AI-powered web automation, and web scraping. The primary benefit is providing a centralized, categorized overview of the rapidly evolving AI web agent ecosystem.

How It Works

The list categorizes various projects and resources related to AI web agents, including autonomous agents, computer-use agents, automation tools, scrapers, search utilities, benchmarks, and tutorials. It highlights specific projects like Steel.dev (an open-source browser API for AI agents), BrowserGPT, and AutoGPT, showcasing different approaches to web interaction, from headless browser APIs to browser extensions and research prototypes.

Quick Start & Requirements

This is a curated list, not a runnable project. Specific projects within the list will have their own installation and execution requirements. For example, Steel.dev is described as an open-source browser API.

Highlighted Details

• Extensive categorization of AI web agent projects, covering autonomous navigation, automation, scraping, and evaluation.
• Features prominent projects like Steel.dev, Browser-Use, Skyvern-AI, and Google Project Mariner.
• Includes sections on benchmarks and research, such as Web Agent Leaderboard, Mind2Web, and WebArena, for evaluating agent performance.
• Provides tutorials and guides for building and deploying AI web agents.

Maintenance & Community

The project is maintained by steel-dev and encourages community contributions. Links to Discord and X (@steeldotdev) are provided for community engagement.

Licensing & Compatibility

The repository itself is a list and does not have a specific license. Individual projects linked within the list will have their own licenses, which may vary.

Limitations & Caveats

As a curated list, the quality and maintenance status of individual projects are not guaranteed by this repository. Users must evaluate each linked project independently for its suitability, licensing, and ongoing support.