testsprite-cli  by TestSprite

AI-powered terminal CLI for automated software verification

Created 1 month ago
2,315 stars

Top 19.0% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

TestSprite provides an AI-powered testing layer for automated code verification against live applications. It enables coding agents to automatically test, identify regressions, and fix their own bugs by simulating real user interactions. The platform aims to improve code quality and reliability, allowing teams to ship correct software faster and more cost-effectively.

How It Works

TestSprite operates on a create -> run -> failure get -> fix -> rerun loop, executing tests against live applications in the cloud. Upon failure, testsprite test failure get provides a single, self-consistent bundle containing the failing step, relevant context (screenshots, DOM), and fixes. This structured output allows AI agents to efficiently diagnose and correct issues, with each successful pass contributing to a growing, durable test suite.

Quick Start & Requirements

Requires Node.js ≥ 20. Install globally via npm install -g @testsprite/testsprite-cli or use npx @testsprite/testsprite-cli. testsprite init handles API key authentication and installs agent skills (e.g., Claude, Cursor). For CI/onboarding: TESTSPRITE_API_KEY=sk-... testsprite init --from-env --yes --agent claude. See DOCUMENTATION.md and testsprite.com/docs.

Highlighted Details

  • Positions itself as the "verification layer for the agentic coding era."
  • Claims high correctness (89%) achieved by the cheapest model on the CoderCup leaderboard.
  • Delivers "agent-shaped output" via a single, self-consistent failure bundle.
  • Builds compounding test coverage through a durable suite of banked passes.
  • Simulates real user experiences against live applications.

Maintenance & Community

Contributions are welcomed in TypeScript/Node.js; details in CONTRIBUTING.md. Community support via Discord and contact@testsprite.com. Changelog at CHANGELOG.md.

Licensing & Compatibility

Licensed under Apache-2.0, permissive for commercial use, modification, and distribution.

Limitations & Caveats

The cloud testing environment is a "black box" to the agent, focusing on outcomes, which may limit deep debugging of the testing process itself. Full functionality requires an API key and cloud execution.

Health Check
Last Commit

1 day ago

Responsiveness

Inactive

Pull Requests (30d)
143
Issues (30d)
92
Star History
2,333 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.