Skill_Seekers  by yusufkaraaslan

Convert documentation websites into Claude AI skills

Created 2 weeks ago

New!

3,284 stars

Top 14.7% on SourcePulse

GitHubView on GitHub
Project Summary

This project provides an automated tool to convert any documentation website into a production-ready Claude AI skill. It targets developers, game developers, teams, and learners by significantly reducing the manual effort required to create specialized AI assistants for technical documentation, typically completing the process in 20-40 minutes.

How It Works

Skill Seeker employs a multi-stage process: it first scrapes content from a given documentation website using a universal scraper. The extracted information is then automatically organized into categorized reference files. An AI enhancement step, which can be performed locally using Claude Code Max or via API, transforms these references into a comprehensive SKILL.md file, enriching it with extracted code examples and key concepts. Finally, the tool packages all generated assets into a .zip file, ready for direct upload to Claude AI.

Quick Start & Requirements

  • Installation: Install core dependencies via pip: pip3 install requests beautifulsoup4. For API-based AI enhancement, pip3 install anthropic is required, along with setting the ANTHROPIC_API_KEY environment variable.
  • Prerequisites: Python 3.x. Local AI enhancement requires Claude Code Max.
  • Setup Time: Initial scraping and building takes approximately 20-40 minutes. Rebuilding with cached data (--skip-scrape) is very fast (< 3 minutes). AI enhancement adds about 60 seconds.
  • Usage: Presets are available in the configs/ directory (e.g., python3 doc_scraper.py --config configs/react.json). An interactive mode (python3 doc_scraper.py --interactive) guides users through creating custom configurations.
  • Documentation: Links to QUICKSTART.md, docs/ENHANCEMENT.md, docs/UPLOAD_GUIDE.md, docs/CLAUDE.md, and STRUCTURE.md are provided within the repository.

Highlighted Details

  • Universal Scraper: Capable of extracting content from virtually any documentation website.
  • AI-Powered Enhancement: Transforms basic documentation into rich SKILL.md files with practical code examples and key concepts, supporting both local (free) and API-based (paid) modes.
  • 8 Ready-to-Use Presets: Includes pre-configured settings for popular frameworks like Godot, React, Vue, Django, and FastAPI.
  • Smart Categorization: Automatically organizes scraped content by topic based on URL structure, page titles, and content keywords.
  • Code Language Detection: Identifies and tags code blocks for various programming languages (Python, JavaScript, GDScript, C++, etc.).
  • Caching System: Allows for rapid rebuilding of skills by reusing previously scraped data.

Maintenance & Community

The provided README focuses on the tool's functionality and usage. It does not contain explicit information regarding community channels (like Discord or Slack), notable contributors, sponsorships, or a public roadmap.

Licensing & Compatibility

The project is released under the MIT License, which is permissive and generally suitable for commercial use and integration into closed-source projects.

Limitations & Caveats

The "Universal Scraper" may require manual adjustment of CSS selectors for websites with non-standard structures. While local AI enhancement is free, it depends on the availability and setup of Claude Code Max. The quality of the generated SKILL.md is significantly higher with AI enhancement; without it, the output is described as a "basic template."

Health Check
Last Commit

6 days ago

Responsiveness

Inactive

Pull Requests (30d)
17
Issues (30d)
153
Star History
3,343 stars in the last 18 days

Explore Similar Projects

Starred by Alex Yu Alex Yu(Research Scientist at OpenAI; Cofounder of Luma AI), Will Brown Will Brown(Research Lead at Prime Intellect), and
7 more.

avante.nvim by yetone

0.5%
16k
Neovim plugin emulating Cursor AI IDE for AI-driven code assistance
Created 1 year ago
Updated 4 days ago
Feedback? Help us improve.