Recent advances in deflectometric eye tracking: a novel concept for fast and accurate gaze estimation

Abstract

This contribution introduces a series of recently developed active eye-tracking techniques that exploit deflectometric information for fast and accurate gaze estimation. The reflection of a back-illuminated extended screen is observed over the eye surface, which yields a drastic increase in captured data points of factors of 3000X and higher compared to conventional glint tracking. The higher information content is used to infer the geometrical properties of the eye and estimate the gaze with high accuracy. In this contribution, we will introduce three different flavors of our approach, which are based on single-shot stereo deflectometry, differentiable rendering, and deep learning. We will show real world experiments that achieve gaze errors < 0.12° on realistic model eyes, and 0.45° ∼ 0.97° on real human eyes.

Publication
Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR) VI
Jiazhang Wang
Jiazhang Wang
Postdoctoral Researcher
Jiwon Choi
Jiwon Choi
Ph.D. Student in Optical Sciences
Tianfu Wang
Tianfu Wang
Ph.D Student in Computer Science
Florian Willomitzer
Florian Willomitzer
Associate Professor of Optical Sciences