instruments command-line tool will only run UIAutomation tests using the iphonesimulator6.1 SDK

Originator:jeff
Number:rdar://14136805 Date Originated:06.12.2013
Status:Duplicate/14117937 Resolved:
Product:Developer Tools Product Version:4.5 (46000)
Classification:Serious Bug Reproducible:Always
 
12-Jun-2013 06:15 PM Jeffrey Wear:
Summary:

The instruments command-line tool will only run using the iOS Simulator 6.1 SDK. This prevents testing an application against multiple versions of the SDK.

Steps to Reproduce:

1. Open the iOS Simulator. Set its device type to "iPhone" and its version to "5.1 (9B176)".
2. Execute `sh RunUIAutomationTests.sh` from the root directory of the attached project.

Expected Results:

instruments should run the `LogIn.js` script using the Automation trace template (as directed by `RunUIAutomationTests.sh` using the 5.1 Simulator.

Actual Results:

instruments switches the Simulator to 6.1, then runs the script.

Notes:

This bug is reproducible regardless of the SDK that the application is built with--even if it is built using the 5.1 SDK, instruments will still launch the 6.1 Simulator.

This bug is also reproducible even when instruments runs a template which has configured to run a particular executable using the 5.1 SDK--when that template is run using the Instruments GUI, the 5.1 Simulator will launch; but when the command-line tool runs the template, the 6.1 Simulator will launch.

Using the instruments command-line tool included with the Xcode 5 developer tools (build 5A11314m), the tool chooses the *oldest* SDK installed (and in fact will not even run tests using the iOS 6.1 SDK: http://openradar.appspot.com/radar?id=3115412).

Comments


Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!