This Python script enables Anthropic's Claude 3.5 Sonnet to interact with macOS by simulating mouse and keyboard actions and executing bash commands, offering a local, container-free alternative to Anthropic's official demo. It's designed for users who want to leverage AI for automating tasks on their Mac.

How It Works

The script utilizes the pyautogui library to simulate user input on macOS, allowing Claude to control the mouse and keyboard. It also integrates with the Anthropic API to process natural language instructions and generate sequences of actions or commands to be executed on the local machine. This approach bypasses the need for Docker, simplifying setup for macOS users.

Quick Start & Requirements

• Install via pip: pip3.12 install -r requirements.txt after cloning the repository.
• Requires Python 3.12 and an Anthropic API key.
• macOS accessibility permissions must be granted to the terminal or Python interpreter.
• Official Anthropic docs: https://docs.anthropic.com/claude/docs/computer-use

Highlighted Details

• MacOS-native execution, avoiding Docker dependency.
• Simulates mouse/keyboard actions and runs bash commands.
• Supports direct command-line instructions or default script instructions.

Maintenance & Community

No specific community channels or notable contributors are mentioned in the README.

Licensing & Compatibility

The repository's license is not explicitly stated in the README. Compatibility for commercial use or closed-source linking is not specified.

Limitations & Caveats

The script carries significant security risks due to granting AI control over the computer. Users assume all responsibility for its use. The README does not detail specific limitations regarding the types of tasks Claude can perform or potential failure modes.