XCTests are flaky when run through the command line or through jenkins

There is a group of 120 cases that works great when going through xcode

But when starting through Jenkins I get below errors

1) Failed to complete com.test.app1: 500 after 60.0s; the state is still Running Active (3), should be Not Running (1)

2) testApp3, the launch token from Xcode

3) testApp2, launch status response from Xcode

Why are they coming? What could be the reason? what's the solution to stabilize this

Tried to

1) Restart the device before starting the test (manually) 2) Reset the device before starting the test (manually) 3) Uninstall the application before each start

However, a problem exists; one or the other test case fails.

+5
source share

Source: https://habr.com/ru/post/1268326/


All Articles