auto-ski-info-subscribe  by cyohei9907

Automated X (Twitter) monitoring and AI analysis system

Created 2 months ago
290 stars

Top 91.0% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

This project provides an automated system for monitoring X (Twitter) accounts, performing AI-driven content analysis, and exposing data via the MCP protocol. It targets developers and researchers seeking to analyze X data without relying on official APIs, offering benefits like automated data collection, AI insights, and service integration.

How It Works

The system employs Playwright for headless browser scraping, utilizing user-provided X account cookies for authentication, thereby bypassing official API key requirements. Scheduled tasks, managed by Celery and Redis, automate tweet fetching. Google Gemini AI is integrated for advanced content analysis, including sentiment, summarization, and topic extraction. The Model Context Protocol (MCP) facilitates data exposure to external services.

Quick Start & Requirements

  • Primary install/run command: docker-compose up -d after cloning the repository and configuring environment variables.
  • Non-default prerequisites: Docker & Docker Compose, valid X (Twitter) account cookies (auth_token, ct0), and an optional Google Gemini API Key for AI features.
  • Links: Detailed setup and debugging guides are available within the repository (DOCKER_DEBUG.md, LOCAL_SETUP.md, MCP_INTEGRATION.md).

Highlighted Details

  • Cookie-based authentication for X (Twitter) access, eliminating the need for official API keys.
  • AI-powered analysis of tweet content, including sentiment, summarization, and topic extraction via Google Gemini.
  • MCP protocol integration for seamless data sharing with other applications.
  • Deployment flexibility with Docker and optional Google Cloud Run support.
  • A React-based web interface for managing monitored accounts and viewing collected tweets.

Maintenance & Community

Contribution guidelines are provided, encouraging community involvement. No specific community channels (e.g., Discord, Slack) or details on core maintainers/sponsors are listed in the provided text.

Licensing & Compatibility

The project is licensed under the MIT License. However, its usage is strictly restricted to personal learning and research purposes; commercial use is explicitly prohibited. Users must also comply with X's (Twitter's) Terms of Service.

Limitations & Caveats

Users must manage X account cookies, which are prone to expiration and require periodic renewal. The tool is intended solely for personal study and research, with commercial applications forbidden. Adherence to X's Terms of Service is mandatory to mitigate risks such as account suspension.

Health Check
Last Commit

1 month ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
12 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.