Discover and explore top open-source AI tools and projects—updated daily.
tgmeng-comReal-time web hot list aggregator with AI integration
Top 84.1% on SourcePulse
Summary
Tgmeng API provides a backend service for aggregating real-time trending topics ("hot lists") from numerous sources across the web. It targets users and developers needing up-to-date information streams, offering features like minute-level updates, RSS subscriptions, historical data tracking, and multi-platform push notifications. The project aims to simplify access to trending information and facilitate its integration into other applications or workflows, with a focus on ease of deployment.
How It Works
The backend service fetches data from over a hundred official sources, updating most minute-by-minute, with specific sources like GitHub and NetEase Cloud Music having slightly longer intervals. It employs a robust caching mechanism using Caffeine for in-memory storage, with configurable expiration times and automatic refresh timers. The system also supports proxy pools for accessing third-party services and includes comprehensive exception handling, request header simulation, and global logging. Historical data is stored locally in Parquet format, queried via DuckDB, requiring careful disk space management.
Quick Start & Requirements
AI_PLATFORM_CONFIG environment variable with specific JSON format is required. Docker deployment requires volume mounts for logs (/app/logs), data (/app/data), and heap dumps (/app/heapdumps). Historical data storage can consume significant disk space (~600MB per day).Highlighted Details
Maintenance & Community
The project is actively developed by tgmeng-com. Specific details regarding community channels (like Discord/Slack), notable contributors, or sponsorships are not detailed in the provided README.
Licensing & Compatibility
Limitations & Caveats
Historical data storage requires substantial disk space and monitoring. The AI platform configuration is optional and requires specific formatting. The GPL v3 license may impose restrictions on integration into proprietary software.
9 months ago
Inactive
veekaybee