agentql  by tinyfish-io

AI agent tool for web data extraction and workflow automation

Created 1 year ago
947 stars

Top 38.7% on SourcePulse

GitHubView on GitHub
Project Summary

AgentQL provides a suite of tools for AI agents to interact with and extract data from live websites, including authenticated and dynamic content. It targets developers building AI-powered web scraping, automation, and data extraction solutions, offering a natural language query language and robust Playwright integration for efficient and resilient web interactions.

How It Works

AgentQL leverages natural language processing to interpret user queries, translating them into precise web element selectors. This approach allows for intuitive data pinpointing and extraction, even across sites with similar content structures. Its core advantage lies in its self-healing capabilities, adapting to UI changes and maintaining query functionality over time, reducing maintenance overhead for automation scripts.

Quick Start & Requirements

  • Install: pip install agentql (Python SDK) or use the JavaScript SDK.
  • Prerequisites: Playwright is integrated, requiring browser binaries. Python 3.7+ or Node.js.
  • Resources: Browser debugger extension available.
  • Docs: Official Documentation

Highlighted Details

  • Natural language selectors for intuitive element targeting.
  • Cross-site compatibility and resilience to UI changes.
  • Structured data output with in-query transforms.
  • Playwright integration for advanced automation.

Maintenance & Community

  • Active community on Discord.
  • Presence on GitHub, Twitter, and LinkedIn.

Licensing & Compatibility

  • License not explicitly stated in the README.

Limitations & Caveats

The README does not specify the project's license, which is crucial for determining commercial use and compatibility with closed-source projects.

Health Check
Last Commit

2 weeks ago

Responsiveness

1+ week

Pull Requests (30d)
1
Issues (30d)
0
Star History
41 stars in the last 30 days

Explore Similar Projects

Starred by Travis Fischer Travis Fischer(Founder of Agentic), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
4 more.

open-operator by browserbase

0.4%
2k
Template for building web agents using Browserbase and Stagehand
Created 7 months ago
Updated 3 months ago
Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Luis Capelo Luis Capelo(Cofounder of Lightning AI), and
15 more.

stagehand by browserbase

0.5%
17k
AI browser automation framework for production
Created 1 year ago
Updated 1 day ago
Feedback? Help us improve.