Accessing pupil diameter in visionOS

Previously I had developed software using SMI eye trackers, both screen mounted and their mobile glasses, for unique therapeutic and physiology applications. Sadly, after SMI was bought by Apple, their hardware and software have been taken off the market and now it is very difficult to get secondhand-market systems. The Apple Vision Pro integrates the SMI hardware. While I can use ARKit to get gaze position, I do not see a way to access information that was previously made accessible on the SMI hardware, particularly: dwell time and pupil diameter information. I am hopeful (or asking) to see that if a user has a properly set up Optic ID and would opt-in if, either on the present or a future version of visionOS, it might be possible to get access to the data streams for dwell times and pupil diameter. Pupil diameter is particularly important as it is a very good physiological measure of how much stress a person is encountering, which is critical to some of the therapeutic applications that formerly we used SMI hardware. Any ideas, or, if this is not possible, proposing this to the visionOS team would be appreciated!

Answered by DTS Engineer in 850237022

Hello,

The data sought and use case(s) suggest exploring ResearchKit and/or CareKit via the Investigator Support Program.

Given the security risks Optic ID is unlikely to be viable.

Accepted Answer

Hello,

The data sought and use case(s) suggest exploring ResearchKit and/or CareKit via the Investigator Support Program.

Given the security risks Optic ID is unlikely to be viable.

Thanks, I have never heard of that program! The application area is pretty focused on trying to treat PTSD and doctors that work in trauma centers. The pupil diameter is a great stress measurement for seeing how they progress in training/therapy when presented with either a VR training environment or, what I think is a great angle I had only to start exploring with the SMI glasses, stress in real-world scenarios where the doctor can see a real world patient and the other doctors in the ER.

Accessing pupil diameter in visionOS
 
 
Q