Xcode reports that failed tests succeeded
| Originator: | david.starren | ||
| Number: | rdar://13583480 | Date Originated: | 04-Apr-2013 06:50 PM |
| Status: | Open | Resolved: | |
| Product: | Developer Tools | Product Version: | 4.5.2 |
| Classification: | Other Bug | Reproducible: | Sometimes |
Summary:
Xcode intermittently reports that unit tests have succeeded, even when failures occur.
Steps to Reproduce:
1) Create a new Cocoa Application project in Xcode with unit tests.
2) make the only test be the following:
- (void)testXcodeFailure
{
STAssertNotNil(nil, @"nil");
}
3) Keep running tests (via command-U).
Expected Results:
Xcode should always report failure.
Actual Results:
Around 10 to 20% of the time, Xcode will report success, even though the above test fails. This is fairly easy to catch by assigning a "Play sound" action to tests passing/failing.
Furthermore, continuing to press command-U results in this on-again, off-again behavior, even without changing or recompiling anything.
Regression:
Notes:
Comments
Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!