Temporal co-registration of simultaneous electromagnetic articulography and electroencephalography for precise articulatory and neural data alignment

Friedrichs, Daniel and Lancheros, Monica and Kirkham, Sam and He, Lei and Clark, Andrew and Lutz, Clemens and Dellwo, Volker and Moran, Steven (2024) Temporal co-registration of simultaneous electromagnetic articulography and electroencephalography for precise articulatory and neural data alignment. In: Proceedings of INTERSPEECH 2024 :. International Speech Communication Association, Kos, Greece, pp. 3120-3124.

Text (Friedrichs_et_al_Interspeech_2024_Final_Version)
Friedrichs_et_al_Interspeech_2024_Final_Version.pdf - Accepted Version
Available under License Creative Commons Attribution.
Download (342kB)

Abstract

This study presents a temporal co-registration method combining electromagnetic articulography (EMA) and electroencephalography (EEG) to capture the neural planning and execution phases of speech with high precision. Traditional EEG alignment based on acoustic vocal onset is often inaccurate due to the variable lag between articulatory and acoustic onsets. Our approach synchronizes EMA-derived speech kinematics with EEG data, addressing these challenges. We also examined the interaction between EMA and EEG systems, focusing on the integrity of EMA signals in the presence of EEG equipment and the electromagnetic influence of EMA on EEG signal quality. The method achieved a mean alignment delay of 2.7 ms (SD = 0.4 ms), enabling detailed analysis of pre-articulatory brain activities. Additionally, our evaluations confirmed the robustness of EMA signals and EEG event-related potentials, supporting the method's precision, feasibility, and reliability for speech planning research.