Temporal co-registration of simultaneous electromagnetic articulography and electroencephalography for precise articulatory and neural data alignment

Friedrichs, Daniel and Lancheros, Monica and Kirkham, Sam and He, Lei and Clark, Andrew and Lutz, Clemens and Dellwo, Volker and Moran, Steven (2024) Temporal co-registration of simultaneous electromagnetic articulography and electroencephalography for precise articulatory and neural data alignment. In: Proceedings of INTERSPEECH 2024 :. International Speech Communication Association, Kos, Greece. (In Press)

[thumbnail of Friedrichs_et_al_Interspeech_2024_Final_Version]
Text (Friedrichs_et_al_Interspeech_2024_Final_Version) - Accepted Version
Restricted to Repository staff only until 1 September 2024.
Available under License Creative Commons Attribution.

Download (0B)
[thumbnail of Friedrichs_et_al_Interspeech_2024_Final_Version]
Text (Friedrichs_et_al_Interspeech_2024_Final_Version) - Accepted Version
Restricted to Repository staff only until 1 September 2024.
Available under License Creative Commons Attribution.

Download (0B)
[thumbnail of Friedrichs_et_al_Interspeech_2024_Final_Version]
Text (Friedrichs_et_al_Interspeech_2024_Final_Version)
Friedrichs_et_al_Interspeech_2024_Final_Version.pdf - Accepted Version
Restricted to Repository staff only until 1 September 2024.
Available under License Creative Commons Attribution.

Download (342kB)

Abstract

This study presents a temporal co-registration method combining electromagnetic articulography (EMA) and electroencephalography (EEG) to capture the neural planning and execution phases of speech with high precision. Traditional EEG alignment based on acoustic vocal onset is often inaccurate due to the variable lag between articulatory and acoustic onsets. Our approach synchronizes EMA-derived speech kinematics with EEG data, addressing these challenges. We also examined the interaction between EMA and EEG systems, focusing on the integrity of EMA signals in the presence of EEG equipment and the electromagnetic influence of EMA on EEG signal quality. The method achieved a mean alignment delay of 2.7 ms (SD = 0.4 ms), enabling detailed analysis of pre-articulatory brain activities. Additionally, our evaluations confirmed the robustness of EMA signals and EEG event-related potentials, supporting the method's precision, feasibility, and reliability for speech planning research.

Item Type:
Contribution in Book/Report/Proceedings
Uncontrolled Keywords:
Research Output Funding/no_not_funded
Subjects:
?? no - not fundedno ??
ID Code:
221301
Deposited By:
Deposited On:
13 Jun 2024 10:05
Refereed?:
Yes
Published?:
In Press
Last Modified:
16 Jul 2024 05:29