Run
Pull Request Testing
PR Testing runs AI-powered tests against every preview deployment. It reads the PR context, generates a targeted test plan, executes it in a real browser, and posts results as a GitHub comment.
How it works
- A preview deployment completes (Vercel or Coolify).
- Our agent reads the PR title, description, and changed files.
- It generates a test plan targeting the affected areas.
- Tests run against the live preview URL.
- Results are posted as a comment on the pull request.
Supported providers
- Vercel - automatic via GitHub deployment status events. No webhook needed.
- Coolify - via webhook configured in Coolify notifications.
- Custom infrastructure - via group webhooks with
commitSha. See Testing Staging Environment.
Prerequisites
- GitHub App installed and connected to the repository.
- Deployment provider configured - see Vercel or Coolify setup guides.
What gets tested?
The agent builds a test plan tailored to each PR. It considers:
- PR title and description - understands intent.
- Changed files - focuses on affected areas.
- Application context - project memory, test accounts, uploaded files.
The plan covers functional checks, visual verification, and edge cases relevant to the changes.