trailblaze  by block

Natural-language UI automation for coding agents

Created 1 year ago
264 stars

Top 96.5% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

Trailblaze provides an AI-driven UI testing framework for natural-language device control across iOS, Android, and web. It enables coding agents to interact with applications, generating replayable "trails" that function as deterministic tests runnable in CI, simplifying cross-platform automation and regression testing.

How It Works

Trailblaze uses a CLI to bridge coding agents and devices. Sessions are recorded as trail.yaml files, capturing natural-language intent and platform actions for deterministic replay without runtime LLMs. It leverages native platform UI hierarchies (accessibility, semantics, DOM) for semantic control, allowing agents to use natural language while the CLI computes platform-specific selectors. Custom tools can be defined in TypeScript.

Quick Start & Requirements

Install via Homebrew: brew install block/tap/trailblaze (includes bun). Alternative: curl -fsSL https://raw.githubusercontent.com/block/trailblaze/main/install.sh | bash (requires Java 17+, installs bun). Optional: ffmpeg, esbuild (brew install ffmpeg esbuild). Docs: block.github.io/trailblaze. Device interaction possible within 60 seconds.

Highlighted Details

  • Cross-Platform Native Fidelity: Supports iOS, Android, web, exposing native UI surfaces for semantic control.
  • Deterministic Replay: trail.yaml files act as regression tests, runnable locally and in CI without runtime LLMs.
  • Self-Healing: Automatically patches minor UI drift (text changes, popups) against live screens.
  • Trace Viewer: Generates rich, cross-platform reports (screenshots, view hierarchy, video).
  • Agent Integration: Includes a portable SKILL.md for seamless integration with coding agents (Claude Code, Cursor, Codex, etc.).
  • Custom Tools: Define typed custom commands and screen waypoints in TypeScript.

Maintenance & Community

Hosted on GitHub. Specific contributor, sponsorship, or community channel details are not explicitly provided in the README.

Licensing & Compatibility

Apache 2.0 license, permitting commercial use and integration into closed-source projects. Trail artifacts are user-owned and stored within the repository.

Limitations & Caveats

Requires external coding agents for advanced authoring; not a standalone agent. Not a SaaS platform; test artifacts are repo-based. npm packaging for community distribution is in active development. "Waypoints" feature is an active prototype.

Health Check
Last Commit

6 days ago

Responsiveness

Inactive

Pull Requests (30d)
28
Issues (30d)
20
Star History
24 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.