top of page
Haptic Captions
This project examines the usability of haptics as a complementary channel to enhance and expand the information presented through captions. Using acoustic haptic feedback devices, we examine using haptics for speaker indication as well examine how haptics can be used to present characteristics of spoken content such as emotions.
Publications
Tactile Emotions: Multimodal Affective Captioning with Haptics Improves Narrative Engagement for d/Deaf and Hard-of-Hearing Viewers
Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
Caluã de Lacerda Pataca, Saad Hassan, Lloyd May, Michelle M Olson, Toni D'aurio, Roshan L Peiris, Matt Huenerfauth
Haptic-Captioning: Using Audio-Haptic Interfaces to Enhance Speaker Indication in Real-Time Captions for Deaf and Hard-of-Hearing Viewers
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Wang, Yiwen; Li, Ziming; Chelladurai, Pratheep Kumar; Dannels, Wendy; Oh, Tae; Peiris, Roshan L;
bottom of page