Asset 2productpagearrow_downarrow_downarrowsbasic-demo-iconAsset 6productpagecarcheckbox-iconclosecommunitycontrollercookingdjfooter_mailfooter_facebookfooter_linkedinfooter_mailfooter_mappinfooter_twitterhand_finger_circle_iconhand-globe-sparkle-iconAsset 5productpageintegrate-iconkitlayer-iconleft_arrow_greenleft_arrow_whiteleft_arrowmagic-demo-iconnews-facebooknews-linkedinnews-twitterphone_2pinplugandplayquick-iconright_arrow_greenright_arrow_whiteright_arrowscrollAsset 4productpagesupportAsset 3productpagewebcam

CHI 2019 Workshop on Mid-Air Haptics Interfaces for Interactive Digital Signage and Kiosks

CHI is the leading event in the field of current human-computer interaction and future technologies and we were pleased to be hosting one of its workshop tracks together with SoftServe, the Alibaba NHCI Lab, the HCI group at Brunel University, and University of Bayreuth.

The workshop took place on 5th of May and will be hosted by CHI 2019 at the Scottish Event Campus in Glasgow.

Mid-Air Haptics Interfaces for Interactive Digital Signage and Kiosks

Digital signage systems are transitioning from static displays to rich, dynamic interactive experiences while new enabling technologies that support these interactions are also evolving. For instance, advances in computer vision and face, gaze, facial expression, body and hand-gesture recognition have enabled new ways of distal interactivity with digital content.

Such possibilities are only just being adopted by advertisers and retailers, yet, they face important challenges e.g. the lack of a commonly accepted gesture, facial expressions or call-to action set.

Moreover, public displays that use touchscreen technology face issues with hygiene and cleaning requirements, robustness against extended use and potential damage, securing access to the display control panel, responsiveness, and finally reachability requirements that compromise viewability and location.

Workshop topics of interest

Of particular interest to this sector and to this workshop are mid-air haptic interfaces that couple computer vision and affective computing with haptic feedback through the use of focused ultrasound. Mid-air haptic interfaces have been shown to aid in defining a gesture set, affect the emotional state of users, significantly increases user engagement with the interactive content, increase brand engagement, dwell time and brand recall while also enhancing the overall user experience.

The goal of this industry/academic co-led one-day workshop was to bring together a group of experts in disciplines from haptic research, affective computing, pervasive displays and multi-modal interaction, in order to foster discussion about the challenges in the design and implementation associated with next generation of mid-air haptic interfaces for digital signage and kiosks. Through brainstorming break-out sessions, we designed concept prototypes and defined new research challenges in the field of digital signage which are enabled by mid-air haptics and affective computing.

Download all workshop sketchnotes created by Makayla Lewis.

Take a look at our 2018 workshop at CHI on Mid-Air Haptics for Control Interfaces.


09:30 Welcome and summary of submitted papers
Orestis Georgiou to give a brief intro and everyone to introduce themselves
Mini-keynotes 1 & 2 (industry & academia)
10:00 User interaction around public interactive digital displays: five opportunities for haptic innovation Mark Perry
10:15 Amplifying user engagement via mid-air haptic interactions Hannah Limerick
10:30 Coffee break
3-minute madness (5 presentations)
10:45 3D mid-air audio-haptic navigation for digital signage Tychonas Michailidis, Chritopher Barlow, Jaz Marshall-Porter
10:48 Using Mid-Air Haptics to Provoke Affective Personal Responses during Science Communication Daniel Hajas
10:51 Accessible Kiosk Cagatay Goncu
10:54 Touch my heart: make artificial feel real Ted Romanus, Sam Frish, Mykola Maksymenko
10:57 Mindfulness Meditation Stimulated by Mid-Air Haptic Feedback Ivan Kosarevych, Marian Petruk, Ted Romanus, Mykola Maksymenko, Volodymyr Budzan, Oleksandr Honchar
11:00 Group discussion on topic 1 (digital signage)
Moderator: Orestis Georgiou
12:00 Lunch nearby
13:00 Demo Session
Mini-keynote 3 & 4 (industry & academia)
13:30 Using Laser for Mid-air Haptic Rendering Seungmoon Choi
13:45 Environmental sensing for mid-air consumer interactions Mykola Maksymenko
3-minute madness (5 presentations)
14:00 Are Mid-Air Haptic Shapes a Suitable Way to Convey Information? Isa Rutten, William Frier, Lawrence Van den Bogaert, David Geerts, Çisem Özkul
14:03 Interactive Experience through an Air and Touch Bar Dimitra Anastasiou, Olivier Raulot, Laure Galopin, Eric Ras
14:06 Posture Guidance through Self-Contained Multimodal Coaching Mirror Hesham Elsayed, Markus Funk, Max Mühlhäuser, Martin Weigel
14:09 Accessible interactive digital signage for visually impaired Balandino Di Donato, Tychonas Michailidis
14:12 Physical ergonomics and mid-air gestures for interactive digital signage Myroslav Bachynskyi
Group discussion on topic 2
14:15 Ergonomics, usability, user experience, and design principles for interactive digital signage in the context of mid-air haptics Moderator: Myroslav Bachynskyi
15:15 Challenge: introduction to challenges
15:30 Coffee break
15:45 Response: breakout groups challenge response
Ideation process
Prepare for pitch
Presentations of breakout groups responses
17:00 Team 1
17:10 Team 2
17:20 Team 3
17:30 Team 4
17:40 Workshop close and thanks
18:00 Dinner nearby (optional)

CHI 2019 Workshop organisers

  • Orestis Georgiou is Director of Research at Ultrahaptics and is also the main link between Ultrahaptics and its academic partners. Dr. Georgiou has also published over 60 articles in leading journals and conferences of Mathematics, Physics, Engineering and Medicine.
  • Hannah Limerick is User Research Lead in the user experience team at Ultrahaptics, and informs interaction design and explores how mid-air haptics add value to user experience. Dr. Limerick has several publications on the human computer interaction domain.
  • Loïc Corenthy leads the “Creative Team” that creates demonstrators showcasing Ultrahaptics technology. Previously, he worked on the design of haptic rendering algorithms for volumetric datasets with applications in neuroscience. This work was published in the journal IEEE Transactions on Haptics.
  • Jin Ryong Kim is Senior Research Scientist at Alibaba Natural Human-Computer Interaction lab. His research focuses on novel interactions with haptics technology to amplify human satisfaction through enriched user experiences. He has several publications in haptics and HCI conferences and journals including the IEEE World Haptics, IEEE Haptics Symposium, EuroHaptics, ACM CHI, and IEEE Transactions on Haptics.
  • Mykola Maksymenko is Principal Scientist at SoftServe with a focus on AI, affective computing and human-computer interaction. He works on collaboration with multiple academic and technology partners and drives applied science projects in Healthcare, Retail, Media and Fintech domains.
  • Sam Frish is Head of Interactive R&D lab at SoftServe. Being an experienced game developer with a portfolio of more than 20 games he now uses his background to drive research on novel AR/VR/MR applications, human-computer interaction and new generation of immersive tech.
  • Mark Perry leads the HCI group at Brunel University. He and has worked on the design and evaluation of public and situated displays over the last 15 years, with a focus on understanding social interaction around them.
  • Jörg Müller is Professor of Computer Science at the University of Bayreuth and is interested in modelling, simulation and optimisation of human-computer interaction using dynamical systems models, ultrasonic levitation interfaces, and augmented and virtual reality.
  • Myroslav Bachynskyi is PostDoc Researcher at Computer Science Department at University of Bayreuth. He has several publications on human biomechanics, mid-air movement modeling and ultrasonic levitation at many international HCI conferences and journals.

CHI 2019 logos


Endorsed by the IEEE Technical Committee on Haptics

Get the latest curated news on spatial interaction and next-generation interfaces, straight to your inbox.

By clicking sign up, you agree to our privacy and cookie policy.

This is the team modal