RPScreenRecorder: let app access movie data

Originator:joachimb
Number:rdar://21312760 Date Originated:09-Jun-2015 05:31 PM
Status:Open Resolved:
Product:iOS SDK Product Version:iOS 9 beta 1
Classification:Enhancement Reproducible:Always
 
I'm the CTO at Lookback, a tool that records an iPhone's screen, camera, microphone and many other data sources, for doing video bug reports, user experience research studies, demo videos, and so on. In rdar://20262995, I requested a screen recording API, and RPScreenRecorder is really close to what we need. For this, I thank you profusely!

RPScreenRecorder requires you to present a RPPreviewViewController after recording. Lookback already has a PreviewViewController, to allow the user to discard the video in case they don't want to share it, which also plays back all the other recorded data (such as camera, touches, view names, and so on). Showing two preview screens after each other would be a terrible experience, and using the Activity UI to forward the video to Lookback is a very awkward interaction. In short: we would like to use the RPScreenRecorder without RPPreviewViewController and get the video data directly.

Getting an m4v file would be nice. Even better would be to get CVSampleBufferRefs for the individual frames as they are being recorded, either as h264 buffers, or raw YpCbCr pixel data. The reason for this is because Lookback can be used to record the user experience all the way up until a crash of the app, which means that muxing must be done as a post-processing step or you just end up with a broken m4v file.

Again, thank you for providing this API!

Comments

Yes, this feature would be really helpful for us as well. Having access to the individual frames would be perfect!


Please note: Reports posted here will not necessarily be seen by Apple. All problems should be submitted at bugreport.apple.com before they are posted here. Please only post information for Radars that you have filed yourself, and please do not include Apple confidential information in your posts. Thank you!