CHI 2019 Workshop on Mid-Air Haptics Interfaces for Interactive Digital Signage and Kiosks
CHI is the leading event in the field of current human-computer interaction and future technologies and we were pleased to be hosting one of its workshop tracks together with SoftServe, the Alibaba NHCI Lab, the HCI group at Brunel University, and University of Bayreuth.
The workshop took place on 5th of May and will be hosted by CHI 2019 at the Scottish Event Campus in Glasgow.
Mid-Air Haptics Interfaces for Interactive Digital Signage and Kiosks
Digital signage systems are transitioning from static displays to rich, dynamic interactive experiences while new enabling technologies that support these interactions are also evolving. For instance, advances in computer vision and face, gaze, facial expression, body and hand-gesture recognition have enabled new ways of distal interactivity with digital content.
Such possibilities are only just being adopted by advertisers and retailers, yet, they face important challenges e.g. the lack of a commonly accepted gesture, facial expressions or call-to action set.
Moreover, public displays that use touchscreen technology face issues with hygiene and cleaning requirements, robustness against extended use and potential damage, securing access to the display control panel, responsiveness, and finally reachability requirements that compromise viewability and location.
Workshop topics of interest
Of particular interest to this sector and to this workshop are mid-air haptic interfaces that couple computer vision and affective computing with haptic feedback through the use of focused ultrasound. Mid-air haptic interfaces have been shown to aid in defining a gesture set, affect the emotional state of users, significantly increases user engagement with the interactive content, increase brand engagement, dwell time and brand recall while also enhancing the overall user experience.
The goal of this industry/academic co-led one-day workshop was to bring together a group of experts in disciplines from haptic research, affective computing, pervasive displays and multi-modal interaction, in order to foster discussion about the challenges in the design and implementation associated with next generation of mid-air haptic interfaces for digital signage and kiosks. Through brainstorming break-out sessions, we designed concept prototypes and defined new research challenges in the field of digital signage which are enabled by mid-air haptics and affective computing.
Download all workshop sketchnotes created by Makayla Lewis.
Take a look at our 2018 workshop at CHI on Mid-Air Haptics for Control Interfaces.
WORKSHOP SCHEDULE | CHI 2019
|09:30||Welcome and summary of submitted papers|
|Orestis Georgiou to give a brief intro and everyone to introduce themselves|
|Mini-keynotes 1 & 2 (industry & academia)|
|10:00||User interaction around public interactive digital displays: five opportunities for haptic innovation||Mark Perry|
|10:15||Amplifying user engagement via mid-air haptic interactions||Hannah Limerick|
|3-minute madness (5 presentations)|
|10:45||3D mid-air audio-haptic navigation for digital signage||Tychonas Michailidis, Chritopher Barlow, Jaz Marshall-Porter|
|10:48||Using Mid-Air Haptics to Provoke Affective Personal Responses during Science Communication||Daniel Hajas|
|10:51||Accessible Kiosk||Cagatay Goncu|
|10:54||Touch my heart: make artificial feel real||Ted Romanus, Sam Frish, Mykola Maksymenko|
|10:57||Mindfulness Meditation Stimulated by Mid-Air Haptic Feedback||Ivan Kosarevych, Marian Petruk, Ted Romanus, Mykola Maksymenko, Volodymyr Budzan, Oleksandr Honchar|
|11:00||Group discussion on topic 1 (digital signage)|
|Moderator: Orestis Georgiou|
|Mini-keynote 3 & 4 (industry & academia)|
|13:30||Using Laser for Mid-air Haptic Rendering||Seungmoon Choi|
|13:45||Environmental sensing for mid-air consumer interactions||Mykola Maksymenko|
|3-minute madness (5 presentations)|
|14:00||Are Mid-Air Haptic Shapes a Suitable Way to Convey Information?||Isa Rutten, William Frier, Lawrence Van den Bogaert, David Geerts, Çisem Özkul|
|14:03||Interactive Experience through an Air and Touch Bar||Dimitra Anastasiou, Olivier Raulot, Laure Galopin, Eric Ras|
|14:06||Posture Guidance through Self-Contained Multimodal Coaching Mirror||Hesham Elsayed, Markus Funk, Max Mühlhäuser, Martin Weigel|
|14:09||Accessible interactive digital signage for visually impaired||Balandino Di Donato, Tychonas Michailidis|
|14:12||Physical ergonomics and mid-air gestures for interactive digital signage||Myroslav Bachynskyi|
|Group discussion on topic 2|
|14:15||Ergonomics, usability, user experience, and design principles for interactive digital signage in the context of mid-air haptics||Moderator: Myroslav Bachynskyi|
|15:15||Challenge: introduction to challenges|
|15:45||Response: breakout groups challenge response|
|Prepare for pitch|
|Presentations of breakout groups responses|
|17:40||Workshop close and thanks|
|18:00||Dinner nearby (optional)|
CHI 2019 Workshop organisers
- Orestis Georgiou is Director of Research at Ultrahaptics and is also the main link between Ultrahaptics and its academic partners. Dr. Georgiou has also published over 60 articles in leading journals and conferences of Mathematics, Physics, Engineering and Medicine.
- Hannah Limerick is User Research Lead in the user experience team at Ultrahaptics, and informs interaction design and explores how mid-air haptics add value to user experience. Dr. Limerick has several publications on the human computer interaction domain.
- Loïc Corenthy leads the “Creative Team” that creates demonstrators showcasing Ultrahaptics technology. Previously, he worked on the design of haptic rendering algorithms for volumetric datasets with applications in neuroscience. This work was published in the journal IEEE Transactions on Haptics.
- Jin Ryong Kim is Senior Research Scientist at Alibaba Natural Human-Computer Interaction lab. His research focuses on novel interactions with haptics technology to amplify human satisfaction through enriched user experiences. He has several publications in haptics and HCI conferences and journals including the IEEE World Haptics, IEEE Haptics Symposium, EuroHaptics, ACM CHI, and IEEE Transactions on Haptics.
- Mykola Maksymenko is Principal Scientist at SoftServe with a focus on AI, affective computing and human-computer interaction. He works on collaboration with multiple academic and technology partners and drives applied science projects in Healthcare, Retail, Media and Fintech domains.
- Sam Frish is Head of Interactive R&D lab at SoftServe. Being an experienced game developer with a portfolio of more than 20 games he now uses his background to drive research on novel AR/VR/MR applications, human-computer interaction and new generation of immersive tech.
- Mark Perry leads the HCI group at Brunel University. He and has worked on the design and evaluation of public and situated displays over the last 15 years, with a focus on understanding social interaction around them.
- Jörg Müller is Professor of Computer Science at the University of Bayreuth and is interested in modelling, simulation and optimisation of human-computer interaction using dynamical systems models, ultrasonic levitation interfaces, and augmented and virtual reality.
- Myroslav Bachynskyi is PostDoc Researcher at Computer Science Department at University of Bayreuth. He has several publications on human biomechanics, mid-air movement modeling and ultrasonic levitation at many international HCI conferences and journals.
Endorsed by the IEEE Technical Committee on Haptics