Interaction with(in) Extended Reality: Tangible, Dynamic, Simulated

Extended Reality (XR), which is an umbrella term for Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR), is poised to introduce new ways of interacting with people, education, entertainment, and training by employing new technological solutions. While many applications are focused on individual, indoor, and visual-auditory interactions for work and home entertainment, interactions outside living rooms, multimodal aspects, and simulations have a long way to go. In this talk, I will focus on three main aspects of interacting with and within XR: (1) tangible, (2) dynamic, and (3) simulated. I will present works that enable haptic feedback, ranging from facilitating a feeling of being touched, drawing in VR, and crafting for children; interaction with XR while moving, e.g., in cars, bicycles, e-scooters, and walking, and when interacting with participants in XR spaces; and lastly, I will talk about simulated environments and how to increase their realism and thus ecological validity of controlled experiments.