Synchronising Text and Speech: Optimal Timing for Enhanced Digital Communication for Individuals with Hearing Loss

A man is sitting in front of a television holding a remote control in his hand.
Photographer: GregorBister

The project investigates which time interval between text speech best supports language comprehension in speech-to-text technology for people with hearing loss. The goal is to provide recommendations for how this technology can be used effectively.

Digital communication is a significant part of modern society. Still, it can pose challenges for people with hearing loss, especially in noisy environments where speech perception becomes more difficult. These environments are common in daily life and can affect how people with hearing loss participate in society. The project examines how textual support, such as speech-to-text technology, can facilitate digital communication for this group. The aim is to identify the optimal time span between the display of text and speech to achieve the greatest possible benefit and to provide practical recommendations for the implementation of this technology.

Timing and its impact on speech comprehension

Earlier research has shown that both people with and without hearing loss can use textual support in noisy environments. When text is displayed before speech, the spoken words are perceived as clear and easy to understand. However, delays in text presentation are common in digital contexts: if the delay exceeds 500 milliseconds, the effectiveness of the textual support decreases.

The project is funded by The Swedish Association of Hard of Hearing People.

Publications

Cover of publication ''
Jerker Rönnberg, Carine Signoret, Josefine Andin, Emil Holmer (2022)

Frontiers in Psychology , Vol.13 Continue to DOI

Cover of publication ''
Carine Signoret, Mary Rudner (2019)

Ear and Hearing , Vol.40 , s.1140-1148 Continue to DOI

Cover of publication ''
Carine Signoret, Ingrid Johnsrude, Elisabet Classon, Mary Rudner (2018)

Journal of Experimental Psychology: Human Perception and Performance , Vol.44 , s.277-285 Continue to DOI

Contact

Organisation