XCTest Notification Shows Test Failed on Successful Tests

Originator:random4444
Number:rdar://16113801 Date Originated:19-Feb-2014 04:56 PM
Status:Open Resolved:
Product:Developer Tools Product Version:Xcode Version 5.0 (5A1413) on OS X 10.8.5
Classification:Crash/Hang/Data Loss Reproducible:Always
 
This is a duplicate of rdar://15515678

Summary:
When executing a single XCTest the Notification will state the "Test Failed" despite the Xcode editor shows it succeeded.  Without changing any code upon the next execution the Notification will come in as "Test Succeeded." The failed notification is intermittent but repeatable upon the most basic of tests.

Steps to Reproduce:
1. Create a New File > Cocoa Touch > Objective-C test case class
2. Create a simple test. I used XCTAssertEqual(A, B, @"Equality"); on two of the same singleton objects.
3. Execute test to invoke notification.

Expected Results:
Expected "Test Succeeded" upon every execution.

Actual Results:
Within a set of four test executions a "Test Failed" notification is encountered at least once.

Version:
Xcode Version 5.0 (5A1413) on OS X 10.8.5

Notes:
If we have a test fail, then change it to pass, we can repeatably get this to happen across our entire development group.

Configuration:


Attachments:

Comments


Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!