Whimbox  by nikkigallery

LLM-powered AI agent for game automation

Created 6 months ago
255 stars

Top 98.8% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

Whimbox is an AI agent for "Infinite Warmth" (无限暖暖), automating repetitive gameplay tasks using LLMs and image recognition. It assists players by handling daily activities, resource gathering, and complex sequences, aiming to improve convenience and efficiency.

How It Works

This system integrates Large Language Models (LLMs) with image recognition (OCR, YOLO) to interact with the game. It processes screenshots and simulates user inputs (mouse/keyboard) without altering game files or memory, enabling natural language-driven orchestration of game functions and task automation.

Quick Start & Requirements

This repository is the backend for Whimbox 2.0; the UI is in a separate app. For command-line task execution (e.g., startOneDragon), ensure the Whimbox app is running, locate its embedded Python, and run "<your Whimbox app installation directory>\python-embedded\python.exe" -m whimbox.main startOneDragon as administrator. Requires Python 3.12, a mid-to-high-end PC, and standard 16:9 resolution. Links to the Whimbox homepage and app project are mentioned but not provided.

Highlighted Details

  • Automates daily/weekly tasks: resource gathering, specific events ("美鸭梨挖掘", "素材激化幻境", "朝夕心愿").
  • Supports automated dialogue, collection, fishing, cleaning, and map traversal with route recording/editing (main world, "Star Sea").
  • Includes macro recording/playback (excluding view rotation) and AI-driven dialogue for function orchestration.
  • Future plans: home tasks, mobile control, expanded LLM features (photo scoring, outfit analysis).

Maintenance & Community

Significant development is ongoing; contributors are welcome via Q group: 821908945. Acknowledges open-source projects (GIA, BetterGI) and AI models.

Licensing & Compatibility

The README does not specify a software license. Compatibility is primarily with "Infinite Warmth" and system requirements; no explicit notes on commercial use or closed-source linking are provided.

Limitations & Caveats

This backend repo lacks a UI, requiring the separate Whimbox app. Performance demands a mid-to-high-end PC. It strictly supports 16:9 resolution. While not modifying game files, automation tools carry an inherent risk of violating game ToS; users assume full responsibility for consequences.

Health Check
Last Commit

3 days ago

Responsiveness

Inactive

Pull Requests (30d)
3
Issues (30d)
2
Star History
18 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.