agentql  by tinyfish-io

AI agent tool for web data extraction and workflow automation

created 1 year ago
889 stars

Top 41.5% on sourcepulse

GitHubView on GitHub
Project Summary

AgentQL provides a suite of tools for AI agents to interact with and extract data from live websites, including authenticated and dynamic content. It targets developers building AI-powered web scraping, automation, and data extraction solutions, offering a natural language query language and robust Playwright integration for efficient and resilient web interactions.

How It Works

AgentQL leverages natural language processing to interpret user queries, translating them into precise web element selectors. This approach allows for intuitive data pinpointing and extraction, even across sites with similar content structures. Its core advantage lies in its self-healing capabilities, adapting to UI changes and maintaining query functionality over time, reducing maintenance overhead for automation scripts.

Quick Start & Requirements

  • Install: pip install agentql (Python SDK) or use the JavaScript SDK.
  • Prerequisites: Playwright is integrated, requiring browser binaries. Python 3.7+ or Node.js.
  • Resources: Browser debugger extension available.
  • Docs: Official Documentation

Highlighted Details

  • Natural language selectors for intuitive element targeting.
  • Cross-site compatibility and resilience to UI changes.
  • Structured data output with in-query transforms.
  • Playwright integration for advanced automation.

Maintenance & Community

  • Active community on Discord.
  • Presence on GitHub, Twitter, and LinkedIn.

Licensing & Compatibility

  • License not explicitly stated in the README.

Limitations & Caveats

The README does not specify the project's license, which is crucial for determining commercial use and compatibility with closed-source projects.

Health Check
Last commit

1 week ago

Responsiveness

1+ week

Pull Requests (30d)
2
Issues (30d)
0
Star History
152 stars in the last 90 days

Explore Similar Projects

Starred by Ying Sheng Ying Sheng(Author of SGLang), Jiayi Pan Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and
1 more.

webarena by web-arena-x

1.1%
1k
Web environment for autonomous agent development
created 2 years ago
updated 5 months ago
Starred by Wes McKinney Wes McKinney(Author of Pandas), Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and
9 more.

autogen by microsoft

0.6%
48k
Agentic framework for multi-agent AI applications
created 1 year ago
updated 1 day ago
Feedback? Help us improve.