Writing Tests

Example app

For testing purposes we provide a built-in example app that you can use to test your tests. It is a simple Wikipedia app that you can use to test your tests. If no app is uploaded, the example app will be used.

Selecting an app

When you create a new test, you can select the app you want to test against from the list of uploaded apps. You can also change the app after the test is created in test "App Upload" tab.

Tips for mobile tests

When writing test for mobile apps it recommended to guide the agent like you would guide a human user. For example if you want to add a new article in your app, you should guide the agent what steps he need to do to navigate to article creation screen. It will decrease the chance of flaky tests and tests times.

Weak prompt example: "Create a new article"

Strong prompt example: "Go to feed screen, click on the + button, fill the article title and content, click on the publish button"

Both prompts are valid, but the second one is stronger and will result in more reliable tests.