Discovering dynamical models of speech using physics-informed machine learning

Kirkham, Sam (2024) Discovering dynamical models of speech using physics-informed machine learning. In: Proceedings of the 13th International Seminar on Speech Production :. International Speech Communication Association, FRA, pp. 177-180.

[thumbnail of Kirkham2024.pdf]
Text (Kirkham2024.pdf) - Published Version
Available under License Creative Commons Attribution.

Download (0B)
[thumbnail of Kirkham2024]
Text (Kirkham2024) - Published Version
Available under License Creative Commons Attribution.

Download (0B)
[thumbnail of Kirkham2024]
Text (Kirkham2024)
kirkham24_issp.pdf - Published Version
Available under License Creative Commons Attribution.

Download (270kB)

Abstract

Spoken language is characterised by a high-dimensional and highly variable set of physical movements that unfold over time. What are the fundamental dynamical principles that underlie this signal? In this study, we demonstrate the use of physics- informed machine learning (sparse symbolic regression) for discovering new dynamical models of speech articulation. We first demonstrate the model discovery procedure on simulated data and show that the algorithm is able to discover the original model with near-perfect accuracy, even when the data contain extensive variation in duration, initial conditions and tar- get positions, as well as in the presence of added noise. We then demonstrate a proof-of-concept applying the same technique to empirical data, which reveals a small set of candidate dynamical models with increasing levels of complexity and accuracy.

Item Type:
Contribution in Book/Report/Proceedings
Uncontrolled Keywords:
Research Output Funding/yes_externally_funded
Subjects:
?? yes - externally fundedyes ??
ID Code:
220277
Deposited By:
Deposited On:
23 May 2024 13:05
Refereed?:
No
Published?:
Published
Last Modified:
26 Jul 2024 00:46