Title: Eye-Hand Symbiosis for Extended Reality
 
Abstract: While mouse and touch controls for the flat world of 2D displays have matured over time, the next foray into 3D worlds that combine real-world and virtual experiences in the form of augmented (AR) and virtual reality (VR) presents many new challenges. Will holograms that float in the air allow us to access digital content? Will we interact by pressing conventional buttons, making wild hand gestures, or just by glancing at the content? I will present the concepts behind and current research on Eye-Hand Symbiosis in this talk, which fundamentally advances human-computer interaction (HCI) through novel capabilities based on multimodal fusion of 3D eye and hand information, adaptive systems that foresee user needs and streamline the UI, and interactive tools for control and creation of 3D content.