MCP server adds web scraping to LLM clients
Top 12.5% on sourcepulse
This project provides a Model Context Protocol (MCP) server that integrates Firecrawl's web scraping capabilities into LLM clients like Cursor and Claude. It enables LLMs to perform web scraping, crawling, searching, and data extraction, enhancing their ability to research and interact with web content.
How It Works
The server acts as a bridge, translating LLM requests into Firecrawl API calls. It supports various scraping and research tasks, including single URL scraping, batch scraping, web crawling, and deep research using LLM analysis. It leverages Firecrawl's JS rendering, automatic retries, rate limiting, and content filtering, offering both cloud and self-hosted Firecrawl instance support.
Quick Start & Requirements
npx -y firecrawl-mcp
Highlighted Details
Maintenance & Community
The project acknowledges contributions from @vrknetha and @cawstudios for initial implementation. Integrations and hosting support are noted from MCP.so and Klavis AI.
Licensing & Compatibility
Limitations & Caveats
The README mentions specific version requirements for Cursor integration (0.45.6+). Some configurations might require adjustments for Windows environments.
1 week ago
1 week