Default Launch Performance Test Crashes Occasionally

Originator:herzberg.sven
Number:rdar://FB7723168 Date Originated:2020-06-03
Status:Open Resolved:
Product:XCTest Product Version:
Classification:Application Crash Reproducible:
 
Please describe the issue:
In our project, we use UI tests which include Xcode’s default test for launch performance. Occasionally that test crashes when being executed.

This problem seems to occur to other people too, see https://forums.developer.apple.com/thread/130576

Please list the steps you took to reproduce the issue:
1. Create a New Xcode project for iOS
2. Enable support for UI tests.
3. Run those tests over and over again.

What did you expect to happen?
4. The tests run: Over and over again.

What actually happened?
4. Sometimes the test crashes with the following error message:

2020-06-03 09:00:25.626838+0200 DemoUITests-Runner[2104:1212178] [Default] Bad date range to search archive. Start date is (null). Stop date is Wed Jun  3 09:00:26 2020.
2020-06-03 09:00:25.627205+0200 DemoUITests-Runner[2104:1212178] *** Assertion failure in -[MXMOSSignpostMetric _constructProbe], /Library/Caches/com.apple.xbs/Sources/MetricKit/MetricKit-60.60.1/MetricMeasurement/MetricMeasurement/metrics/MXMOSSignpostMetric.m:70
2020-06-03 09:01:19.201234+0200 DemoUITests-Runner[2104:1212178] *** Terminating app due to uncaught exception 'NSInternalInconsistencyException', reason: 'Invalid parameter not satisfying: _startDate'
*** First throw call stack:
(0x1a3c1d794 0x1a393fbcc 0x1a3b2082c 0x1a3f5816c 0x1d3bf1614 0x1d3be4904 0x1d3be5378 0x1d3bf1c84 0x1048b9c88 0x1d3bf3e28 0x1a38e29a8 0x1a38e3524 0x1a388bf50 0x1a388b6a8 0x1a3898438 0x1a3898bf8 0x1a3934b38 0x1a3937740)
libc++abi.dylib: terminating with uncaught exception of type NSException

Comments


Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!