extremely slow unit tests in Xcode 7

Originator:cfarrell
Number:rdar://22740166 Date Originated:17-Sep-2015 12:45 PM
Status:Open Resolved:No
Product:Developer Tools Product Version:7
Classification:Performance Reproducible:Yes
 
Summary:
Xcode 6.4 ran 3000 specta unit tests in about 40 seconds.
Xcode 7 runs about 500 specta unit tests in about 5 minutes.

Steps to Reproduce:
1. new project 
2. write substantial number of unit tests
3. run unit tests

Expected Results:
expect the unit tests to run as fast or faster in Xcode 7 as Xcode 6.5

Actual Results:
unit tests run much slower in Xcode 7 than they did in Xcode 6.4

Version:
Xcode 7, iOS 9 Simulator, OS X 10.10.5

Comments

Fixed

Hi,

Until now we have runnning test on iOS8.X. But with iOS Simulator 9.3 and Xcode 7.3 the bug is fixed.

Thanks Apple for having fixed this bug ! :)

Possible culprit: iOS 9 Simulator

Tests run in normal time on 8.4 simulator.

+1

I have the exact same problem, the difference between Xcode 6 and Xcode 7 is really huge.

Same issue

There is almost 4000 unit tests on my project and the resolving time is increasing after each test. It takes more than one hour to run all tests ...

By Thomas.Pintat at Sept. 25, 2015, 12:47 p.m. (reply...)

Same here

Xcode 7 execute 3500 tests in 1H43minutes. Xcode 6.4 execute 3500 tests in less than 5 minutes.

By masson.erwan1 at Sept. 25, 2015, 10:03 a.m. (reply...)

Noticed the same

Same here. I got a project with almost 3000 unit tests, on Xcode 6 most of them took 0.003 seconds, now I'm at 0.2 seconds. Increasing unit test runtime extremely

Same here

We are having the same issue in our project.

First tests are taking 0.02 seconds. After 1000 tests, each test takes 5 seconds.


Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!