TesterArmy
  • Customers
  • Pricing
Sign inGet started
HomeIntegrationsCoolify

Pull requests and deploy previews

Coolify integration

TesterArmy tests every Coolify preview deployment announced by a deployment webhook and reports back on the pull request.

START TESTING FOR FREEREAD THE SETUP DOCS
Coolify
[01] Reporting

From webhook to comment

The Coolify webhook carries the preview URL, and the GitHub App answers with one check per regression group, one for the exploration agent, and a comment listing the planned steps.

Coolify · Webhook
Move onboarding to a three-step wizardPR 88 · feature/onboarding-wizard into main
Coolify · WebhookDeployment event88.myapp.com
All checks have passed
TesterArmy / Exploration TestPassedDetails
TesterArmy / OnboardingPassedDetails
TesterArmy · Exploration agent comment
TesterArmyBotcommented today · edited

TesterArmy is running exploration tests on this Pull Request.

Result
Status
Details
Passed
Open

Summary

All three steps passed. The wizard walked through workspace name, plan and invite in order and opened the dashboard once the last step was done.

Planned Steps (3/3 completed)

#
Step
Result
1
Sign up with a new account and start the wizard
2
Name the workspace, pick a plan and invite a teammate
3
Finish the wizard and confirm the dashboard opens
Recording (1)
All Screenshots (3)
[02] Setup

How it works

Setup is the Coolify card in the project's Integrations panel plus Coolify's Notifications settings. Connect GitHub and enable PR testing first so TesterArmy can match deployments to pull requests.

01

Connect GitHub first

Install the GitHub App, connect the repository and enable PR testing so TesterArmy can resolve each pull request and report results on it.

02

Add the Coolify webhook

In the project's Integrations panel open Coolify, click Add Webhook and copy the generated URL, which contains the secret and is shown only once.

03

Paste it into Coolify

In Coolify open Notifications, then Webhook, paste the URL and enable deployment events, after which TesterArmy matches each preview deployment to its pull request.

→Read the setup docsThe docs cover webhook setup, the Docker Compose preview URL pattern and troubleshooting missing URLs or comments.
See it on your own app

Sign up and run the first test from the dashboard, or hand the setup to your coding agent.

START TESTING FOR FREE
[03] Related

Works with

GitHub is required, since the pull request comes from the connected repository and results land there. Vercel, Netlify and any CI are other ways a preview URL reaches TesterArmy.

GitHubGitHubThe GitHub App posts checks and comments on every pull request preview.→VercelVercelPreview deployments from one selected Vercel project are tested on every pull request.→NetlifyNetlifyA Deploy succeeded notification sends each Netlify Deploy Preview to the agents.→CI/CDCI webhooksJenkins, Buildkite, CircleCI or a shell script triggers a group with one request.→
[04] FAQ

Questions

A webhook configured in Coolify's notification settings announces each deployment. TesterArmy matches the preview to its pull request automatically and runs the selected regression groups, the exploration agent, or both against that preview URL.
Docker Compose deployments omit the preview URL, a known Coolify issue. Set a Preview URL pattern with the pull request number placeholder when adding the webhook, and TesterArmy builds the URL from the payload.
The app needs a domain set in Coolify, otherwise the webhook payload does not contain a deployment URL. Automatic pull request testing also requires that URL to be reachable by TesterArmy's hosted runners.
Regression groups hold saved tests with steps written in plain language, and every selected group runs against each new preview deployment with its own GitHub check and comment. The exploration agent needs no saved steps.
[05] Start on Coolify

Test the next Coolify preview deployment

Connect GitHub, add the webhook in Coolify's notifications, and the next preview deployment comes back as a check and a comment on the pull request.

Contact usStart testing for free
XLinkedInDiscord
TesterArmyTesterArmy

AI-powered QA testing for modern teams. Ship faster with confidence.

SOC 2 Type 2 badge
GDPR badge

© 2026 TesterArmy, Inc.

Platform
  • Web testingWeb testing
  • Mobile app testingMobile app testing
  • Pull request testingPull request testing
  • CI/CD testingCI/CD testing
  • Production monitoringProduction monitoring
  • Coding agentsCoding agents
By stack and product
  • AI app testingAI app testing
  • React Native testingReact Native testing
  • Expo app testingExpo app testing
  • WordPress testingWordPress testing
  • Ecommerce testingEcommerce testing
Quick links
  • HomeHome
  • DemoDemo
  • How it worksHow it works
  • FAQFAQ
  • PricingPricing
  • Get a demoGet a demo
  • About usAbout us
  • Contact usContact us
Resources
  • DocumentationDocumentation
  • IntegrationsIntegrations
  • Migrate to TesterArmyMigrate to TesterArmy
  • Compare toolsCompare tools
  • Recruit a friendRecruit a friend
  • Affiliate programAffiliate program
  • BlogBlog
  • CustomersCustomers
  • Open sourceOpen source
  • Brand assetsBrand assets
  • API referenceAPI reference
  • Getting startedGetting started
Legal
  • Privacy policyPrivacy policy
  • Terms of serviceTerms of service
TesterArmy
  • Customers
  • Pricing
Sign inGet started
Quick links
  • HomeHome
  • DemoDemo
  • How it worksHow it works
  • FAQFAQ
  • PricingPricing
  • Get a demoGet a demo
  • About usAbout us
  • Contact usContact us