instruments (CLI) always returns with exit status 0

Originator:brad
Number:rdar://10976031 Date Originated:02-Mar-2012 06:54 PM
Status:Open Resolved:
Product:Developer Tools Product Version:4.3.1
Classification: Reproducible:always
 
Summary:
In order to chain UIAutomation testing steps together
As a developer on the command line
I want instruments to return a non-zero exit status when the script fails

Steps to Reproduce:
from the command line, with a failing script.js:
$ instruments -t /path/to/Automation.tracetemplate /path/to/MyApp.app UIASCRIPT=/path/to/script.js UIARESULTSPATH=/path/to/results

Expected Results:
`echo $?` should be non-zero if script.js has a failing step

Actual Results:
`echo $?` is always 0

Regression:
N/A

Notes:
I'd like to be able to stitch multiple test runs together and programmatically determine the passing/failing of them. To do this now would require a lot of hackery with the /path/to/results plists.

Comments


Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!