x-reader  by runesleo

Universal content reader for diverse platforms and modalities

Created 1 month ago
881 stars

Top 40.8% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

runesleo/x-reader is a universal content reader fetching, normalizing, and digesting information from 7+ platforms (WeChat, Telegram, X, YouTube, Bilibili, Xiaohongshu, RSS). It targets engineers, researchers, and power users, offering a unified content schema and flexible integration via CLI, Python library, MCP server, or Claude Code skills.

How It Works

The project features a composable, three-layered architecture. The core Python CLI/Library layer handles basic fetching and schema unification using Jina Reader and yt-dlp. An optional Claude Code Skills layer integrates Whisper for video/podcast transcription and AI analysis, requiring a repository clone. A third optional layer exposes reading as an MCP server. This modular design allows users to select necessary components, offering flexibility from simple CLI usage to deep AI integration.

Quick Start & Requirements

Installation is recommended via pip: pip install git+https://github.com/runesleo/x-reader.git. Variants exist for Telegram ([telegram]), browser fallback ([browser]), or all dependencies ([all]). Browser fallback requires playwright install chromium. Video/audio transcription dependencies include yt-dlp and ffmpeg. Whisper transcription necessitates setting the GROQ_API_KEY environment variable. Advanced features like Claude Code skills and MCP server require cloning the repository.

Highlighted Details

  • Comprehensive platform support: YouTube, Bilibili, X, WeChat, Xiaohongshu, Telegram, RSS, Xiaoyuzhou, Apple Podcasts.
  • Optional Whisper transcription for video/audio content via Claude Code skills.
  • AI-powered content analysis capabilities through Claude Code skills.
  • Flexible deployment as CLI, Python library, or MCP server.
  • Handles anti-scraping for certain platforms using Playwright, requiring user login.

Maintenance & Community

Authored by @runes_leo. The README does not detail community channels (e.g., Discord, Slack), sponsorships, or a public roadmap.

Licensing & Compatibility

x-reader is released under the MIT license. This permissive license generally allows commercial use and integration within closed-source projects without significant restrictions.

Limitations & Caveats

Advanced features (Claude Code skills, MCP server) require repository cloning, not just pip installation. Whisper transcription is contingent on obtaining and configuring a GROQ API key. Certain platforms may necessitate a one-time user login for successful fetching due to anti-scraping measures.

Health Check
Last Commit

2 weeks ago

Responsiveness

Inactive

Pull Requests (30d)
1
Issues (30d)
1
Star History
90 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.