ddgs  by deedy5

DuckDuckGo search via Python library and CLI tool

created 4 years ago
1,709 stars

Top 25.5% on sourcepulse

GitHubView on GitHub
Project Summary

This Python library provides programmatic access to DuckDuckGo search results for text, images, videos, and news. It's designed for developers and researchers who need to automate web scraping or data collection from DuckDuckGo, offering flexibility in query parameters and proxy support.

How It Works

The library utilizes HTTP requests to interact with DuckDuckGo's search interfaces, specifically targeting html.duckduckgo.com or lite.duckduckgo.com backends. It parses the returned HTML or JSON to extract relevant data, abstracting away the complexities of direct web scraping. The DDGS class allows for configurable search parameters, including regions, safe search settings, time limits, and media-specific filters.

Quick Start & Requirements

Highlighted Details

  • Supports text, image, video, and news searches with extensive filtering options.
  • Integrates with Tor Browser or custom proxies (HTTP/SOCKS5) for anonymity and bypassing rate limits.
  • Provides specific exceptions for rate limiting, timeouts, and conversation limits.
  • Allows specifying search regions, safe search levels, and media-specific attributes (e.g., image size, video resolution).

Maintenance & Community

The project is maintained by deedy5. Community interaction channels are not explicitly listed in the README.

Licensing & Compatibility

The library is provided for educational purposes and is not intended for commercial use or any purpose that violates DuckDuckGo's Terms of Service. The specific license is not stated, but the disclaimer implies a non-commercial, educational use restriction.

Limitations & Caveats

The library is explicitly stated as not affiliated with DuckDuckGo and is for educational purposes only, with a disclaimer against commercial use or violation of DuckDuckGo's Terms of Service. DuckDuckGo's terms may change, potentially impacting the library's functionality.

Health Check
Last commit

1 day ago

Responsiveness

1 day

Pull Requests (30d)
24
Issues (30d)
14
Star History
166 stars in the last 90 days

Explore Similar Projects

Starred by Tobi Lutke Tobi Lutke(Cofounder of Shopify), Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and
7 more.

firecrawl by mendableai

1.9%
44k
API service for turning websites into LLM-ready data
created 1 year ago
updated 1 day ago
Feedback? Help us improve.