Gaze Strategies and Audiovisual Speech Enhancement

Different techniques can be used to mitigate the effects of hearing loss. Such an example can be provided with the use of visual information to recover auditory information. Studies on audiovisual speech perception have shown that seeing a talker's face can improve speech intelligibility, with an equivalent gain of raising the acoustic signal-to-noise ratio by as much as 15 dB. In this dissertation, quantitative relationships are studied between speech intelligibility and gaze patterns for the case of normal hearing subjects in order to help devise techniques that enable hearing impaired individuals to improve their audiovisual speech perception.

Autorentext

Astrid Yi obtained her B.A.Sc. in Computer Engineering from the University of Waterloo and her M.A.Sc. in Electrical-Biomedical Engineering from the University of Toronto. Her research interests include gaze strategies in audiovisual speech perception.