TesterArmy
  • Customers
  • Pricing
Sign inGet started
HomeIntegrationsGitHub

Pull requests and deploy previews

GitHub integration

TesterArmy tests every GitHub pull request on its preview deployment and reports back as checks and comments.

START TESTING FOR FREEREAD THE SETUP DOCS
GitHub
[01] Reporting

Checks and one comment

The GitHub App posts one check per regression group and one for the exploration agent, plus a comment listing the planned steps that updates in place as the run finishes.

GitHub · Checks on the pull request
Add saved payment methods to checkoutPR 482 · feature/saved-cards into main
Vercel · PreviewReadyshop-git-saved-cards.vercel.app
All checks have passed
TesterArmy / Exploration TestPassedDetails
TesterArmy / CheckoutPassedDetails
TesterArmy · Exploration agent comment
TesterArmyBotcommented today · edited

TesterArmy is running exploration tests on this Pull Request.

Result
Status
Details
Passed
Open

Summary

All four steps passed. The saved card was offered at checkout and the order summary listed it as the payment method.

Planned Steps (4/4 completed)

#
Step
Result
1
Sign in with the saved test account
2
Add an item to the cart and open checkout
3
Choose the saved card as the payment method
4
Place the order and confirm the saved card is listed
Recording (1)
All Screenshots (4)
[02] Setup

How it works

Setup is two screens, the project's Integrations panel and its PR Testing tab. TesterArmy needs a preview URL its runners can reach, delivered by Vercel, Netlify, Coolify or any CI.

01

Install the GitHub App

Choose the organization or account and the repositories to test, then connect one repository to the project, optionally with a target branch such as main.

02

Choose PR coverage

In the PR Testing tab enable regression testing for saved groups, the exploration agent that plans from each pull request, or both.

03

Connect preview delivery

Pick how TesterArmy receives the deployed URL, through Vercel deployment events, a Netlify or Coolify webhook, or a call from any CI after deploy.

→Read the setup docsInstall the app, connect the repository, pick coverage and preview delivery, with troubleshooting for missing runs.
See it on your own app

Sign up and run the first test from the dashboard, or hand the setup to your coding agent.

START TESTING FOR FREE
[03] Related

Works with

GitHub sends the pull request events and shows the results. A hosting integration delivers the preview URL, and mobile builds tested from CI report through this same connection.

VercelVercelPreview deployments from one selected Vercel project are tested on every pull request.→NetlifyNetlifyA Deploy succeeded notification sends each Netlify Deploy Preview to the agents.→CoolifyCoolifyA Coolify deployment webhook sends every preview deployment to the agents for testing.→GitHub ActionsGitHub ActionsUpload an iOS Simulator or Android build and run a mobile test group.→
[04] FAQ

Questions

TesterArmy runs saved regression groups against every pull request preview through its GitHub App and posts one check and one comment per group. An exploration agent plans extra tests from the diff.
A failed test does not block the merge by default. The check concludes neutral, which GitHub counts as passing. Turn on Block merges on failed tests and mark the TesterArmy checks required.
The comment updates in place on later pushes, and the default three-minute quiet period waits for pushes to stop and tests only the newest commit.
The exploration agent needs no saved steps. It reads the pull request and writes a plan for that change, while regression groups cover known flows in plain language, and both run side by side.
[05] Start on GitHub

Test the next pull request

Install the GitHub App, connect one repository and a preview provider, and the first preview deployment comes back with a check and a comment.

Contact usStart testing for free
XLinkedInDiscord
TesterArmyTesterArmy

AI-powered QA testing for modern teams. Ship faster with confidence.

SOC 2 Type 2 badge
GDPR badge

© 2026 TesterArmy, Inc.

Platform
  • Web testingWeb testing
  • Mobile app testingMobile app testing
  • Pull request testingPull request testing
  • CI/CD testingCI/CD testing
  • Production monitoringProduction monitoring
  • Coding agentsCoding agents
By stack and product
  • AI app testingAI app testing
  • React Native testingReact Native testing
  • Expo app testingExpo app testing
  • WordPress testingWordPress testing
  • Ecommerce testingEcommerce testing
Quick links
  • HomeHome
  • DemoDemo
  • How it worksHow it works
  • FAQFAQ
  • PricingPricing
  • Get a demoGet a demo
  • About usAbout us
  • Contact usContact us
Resources
  • DocumentationDocumentation
  • IntegrationsIntegrations
  • Migrate to TesterArmyMigrate to TesterArmy
  • Compare toolsCompare tools
  • Recruit a friendRecruit a friend
  • Affiliate programAffiliate program
  • BlogBlog
  • CustomersCustomers
  • Open sourceOpen source
  • Brand assetsBrand assets
  • API referenceAPI reference
  • Getting startedGetting started
Legal
  • Privacy policyPrivacy policy
  • Terms of serviceTerms of service

We raised $1.2M in Pre-Seed FundingRead more

TesterArmy
  • Customers
  • Pricing
Sign inGet started
Quick links
  • HomeHome
  • DemoDemo
  • How it worksHow it works
  • FAQFAQ
  • PricingPricing
  • Get a demoGet a demo
  • About usAbout us
  • Contact usContact us