shortest  by antiwork

AI-powered framework for natural language end-to-end testing

created 10 months ago
5,180 stars

Top 9.8% on sourcepulse

GitHubView on GitHub
Project Summary

Shortest is an AI-powered end-to-end testing framework designed for natural language test case creation and execution. It targets developers and QA engineers seeking to simplify test writing and leverage AI for test automation, offering a more intuitive approach to E2E testing.

How It Works

Shortest utilizes the Anthropic Claude API to interpret natural language descriptions and translate them into executable browser automation steps via Playwright. This approach allows users to define tests using plain English, abstracting away complex Playwright syntax. It supports chaining tests, using callback functions for custom assertions, and lifecycle hooks for setup and teardown.

Quick Start & Requirements

  • Install via npx @antiwork/shortest init.
  • Requires an Anthropic API key (ANTHROPIC_API_KEY).
  • GitHub 2FA requires GITHUB_TOTP_SECRET.
  • Mailosaur integration requires MAILOSAUR_API_KEY and MAILOSAUR_SERVER_ID.
  • Local development requires Node.js, pnpm, Clerk, Vercel Postgres, Anthropic, Stripe, and Mailosaur configurations.
  • Official documentation: https://github.com/antiwork/shortest

Highlighted Details

  • Natural language test case generation.
  • AI-powered test execution via Anthropic Claude.
  • Built on Playwright for browser automation.
  • GitHub integration with 2FA support.
  • Email validation capabilities with Mailosaur.
  • API testing support.

Maintenance & Community

The project is maintained by the antiwork organization. Community channels and roadmaps are not explicitly linked in the README.

Licensing & Compatibility

The README does not specify a license. Compatibility for commercial use or closed-source linking is not detailed.

Limitations & Caveats

The project is noted to have potential type conflicts with React 18 in Next.js 14+ projects when using Server Actions or useFormStatus. It's recommended to use React 19 to avoid these issues.

Health Check
Last commit

1 month ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
342 stars in the last 90 days

Explore Similar Projects

Starred by Jared Palmer Jared Palmer(Ex-VP of AI at Vercel; Founder of Turborepo; Author of Formik, TSDX) and Travis Fischer Travis Fischer(Founder of Agentic).

evalite by mattpocock

1.6%
770
TypeScript testing framework for LLM apps
created 8 months ago
updated 1 week ago
Feedback? Help us improve.