Thuki is a macOS-native, fully local AI secretary designed for quick, context-aware interactions without data leaving the user's machine. It targets power users and engineers seeking a private, free, and always-available AI assistant that integrates seamlessly into their workflow, even over fullscreen applications.

How It Works

Thuki utilizes a Tauri v2 architecture with a Rust backend and React/TypeScript frontend. It interfaces with a local Ollama instance for running AI models, ensuring all processing and data remain on the user's machine. Its key innovation is a floating overlay mode, summonable via a global hotkey, which can capture screen context or highlighted text, enabling context-aware queries across any application, including fullscreen ones.

Quick Start & Requirements

• Installation:
  • AI Engine (Choose one):
    • Local Ollama (Recommended): Install Ollama from ollama.com or via brew install ollama, then pull a model (e.g., ollama pull gemma4:e2b).
    • Docker Sandbox: Install Docker Desktop, then run bun run sandbox:start.
  • Thuki App: Download Thuki.dmg from releases and drag to Applications. Run xattr -rd com.apple.quarantine /Applications/Thuki.app in Terminal before first launch.
• Prerequisites: macOS, Ollama or Docker Desktop, Bun and Rust (for building from source).
• Resource Footprint: Default model (gemma4:e2b, 2B parameters) runs comfortably on Macs with 8GB RAM. Model files are typically 2–8 GB.
• Links: ollama.com, CONTRIBUTING.md (for build from source).

Highlighted Details

• Privacy-First & Offline: 100% local AI, zero data leaves the machine, no API keys, subscriptions, cloud, or telemetry. Works completely offline once models are downloaded.
• Seamless Overlay: Floats above all apps, including fullscreen, summonable via double-tap Control ⌃.
• Contextual Awareness: Captures highlighted text or screen content (/screen) for context-aware queries.
• Slash Commands: Built-in shortcuts (/translate, /tldr, /think, etc.) for common tasks.
• Secure Docker Sandbox: Optional hardened Docker container for maximum isolation, blocking internet access and filesystem writes.

Maintenance & Community

• Author: Logan Nguyen. Contact via X.
• Community Ports: Windows 10/11 (ThukiWin by @ayzekhdawy).
• Future: Roadmap includes internet search, tool integrations (Gmail, Slack, Discord), native settings panel, in-app model switching, multiple provider support, and voice input.

Licensing & Compatibility

• License: Apache License, Version 2.0.
• Compatibility: Permissive license suitable for commercial use and closed-source linking.

Limitations & Caveats

• Work in Progress (WIP): Explicitly stated as "WIP".
• macOS Only: The primary application is macOS-specific, though community ports exist.
• Gatekeeper Block: Requires a one-time command (xattr -rd com.apple.quarantine) to bypass Apple's Gatekeeper for non-App Store distribution.