ARKit AR View on both screens

Question

MaxShining OP

Created 9h

Replies 4

Boosts 1

Participants 3

This post is from the Activity iPhone Duo Photos & Camera Q&A.

Hello everyone!

Does the ARKit ARSession qualify for an active camera session?

Reading through the documentation, I understand that showing content on both iPhone Duo screens at the same time is only possible by using CameraCaptureAccessory.

ARSession drives the camera but doesn't vend an AVCaptureSession that the app owns, so it isn't clear whether the availability check keys off app-owned AVCaptureSession state specifically, or off the camera actively streaming for the app.

If it is currently not possible, do you see any way or workaround to show the camera stream on the outside display while the inner display is displaying an AR view?

Best regards,

André N.

Answered by Media Engineer in 906382022

No that is not supported. Think of ARKit as a client holding its own AVCaptureSession. If you have a second AVCaptureSession of your own, the second one you start will steal from the first and interrupt it.

Answer 1

Media Engineer OP

Apple

9h

Recommended

No that is not supported. Think of ARKit as a client holding its own AVCaptureSession. If you have a second AVCaptureSession of your own, the second one you start will steal from the first and interrupt it.

Answer 2

Media Engineer OP

Apple

8h

Max Shining, Perhaps I misunderstood your question. Are you asking if ARKit is eligible to use as a CameraCaptureAccessory?

Answer 3

MaxShining OP

8h

Yes, that was the question. But from the initial response I got that this is not the case. So with an ARKit session running, it would not be possible to use both iPhone Duo screens at the same time. Correct?

Answer 4

Vision Pro Engineer OP

Apple

4h

Hi, not quite, sorry for the confusion. An ARSession counts as an active capture session, so you can use CameraCaptureAccessory, and with it both screens, while ARKit runs.

What this isn't is a full AR experience on two screens. An ARKit experience is meant for the person in front of the main display: the inner display when the device is open, the outer display when it's closed. With ARWorldTrackingConfiguration, that person looks through the device into the world. The outer display can then be an extra screen for a second person in front of the rear camera, rather than a second AR view.

With ARFaceTrackingConfiguration, it's a look-at-yourself experience for that same person, like a mirror. So when the device is open, it uses the front camera on the inner display.