47065169: Caused GPU Timeout Error (IOAF code 2, 5)

[openradar-mirror]

Description

Area: Vision.framework

Summary:

While running an iOS app on current iOS (12.1.2) + iPhone XS, these errors (below) are sent to Xcode logs. The App uses Vision with ARKit. The purpose is to use Vision's VNDetectFaceRectanglesRequest along with ARKit's features.

Note: the error doesn't seem to occur on my iPhone 7, but always occurs on my iPhone XS.

These errors always occur:

2019-01-04 03:03:03.155867-0800 ARKit Vision Demo[12969:3307770] Execution of the command buffer was aborted due to an error during execution. Caused GPU Timeout Error (IOAF code 2) 2019-01-04 03:03:03.155786-0800 ARKit Vision Demo[12969:3307850] Execution of the command buffer was aborted due to an error during execution. Discarded (victim of GPU error/recovery) (IOAF code 5)

Sometimes this error shows up:

[SceneKit] Error: display link thread seems stuck

This prototype/concept code is based on the guide https://developer.apple.com/documentation/arkit/using_vision_in_real_time_with_arkit

Steps to Reproduce:

App is on Github https://github.com/xta/ARKit-Vision-Demo (App also attached as Xcode project ZIP)

• Run app on actual hardware, specifically iPhone XS.
• Allow camera permissions for AR app
• Point phone's camera at faces (or image of faces)
• App hangs/crashes/errors

Expected Results:

The app uses Vision to detect face rectangles in the camera's image. Or at a minimum, the app doesn't freeze/hang/crash/error when a face is detected by Vision.

Actual Results:

While using the app & looking around the user's environment with the camera, the app freezes/hangs/errors often. Either just looking around or looking at a JPG (on computer screen) of a face, the app will hang/freeze/crash error.

Version/Build:

1.0/Alpha

Configuration:

latest Xcode 10.1, latest iOS 12.1.2, iPhone XS

- Product Version: Created: 2019-01-05T08:11:15.387799 Originated: 2019-01-05T00:00:00 Open Radar Link: http://www.openradar.me/47065169

[zdavatz]

Same issue here: https://github.com/zdavatz/AmiKo-iOS/issues/102

[zdavatz]

setting the correct image size helped us a lot, see https://developer.apple.com/documentation/vision/recognizing_objects_in_live_capture?language=objc

[zdavatz]

If the image resolution is to high, it seems the vision framework gets confused. iPhone Xs obviously has a very good camera.