Can Deep Synthesis of EMG Overcome the Geometric Growth of Training Data Required to Recognize Multiarticulate Motions

Alexander E. Olsson, Nebojsa Malesevic, Anders Bjorkman, Christian Antfolk

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceedingpeer-review

Abstract

By being predicated on supervised machine learning, pattern recognition approaches to myoelectric prosthesis control require electromyography (EMG) training data collected concurrently with every detectable motion. Within this framework, calibration protocols for simultaneous control of multifunctional prosthetic hands rapidly become prohibitively long - the number of unique motions grows geometrically with the number of controllable degrees of freedom (DoFs). This paper proposes a technique intended to circumvent this combinatorial explosion. Using EMG windows from 1-DoF motions as input and EMG windows from 2-DoF motions as targets, we train generative deep learning models to synthesize EMG windows appertaining to multi-DoF motions. Once trained, such models can be used to complete datasets consisting of only 1-DoF motions, enabling simple calibration protocols with durations that scale linearly with the number of DoFs. We evaluated synthetic EMG produced in this way via a classification task using a database of forearm surface EMG collected during 1-DoF and 2-DoF motions. Multi-output classifiers were trained on either (I) real data from 1-DoF and 2-DoF motions, (II) real data from only 1-DoF motions, or (III) real data from 1-DoF motions appended with synthetic EMG from 2-DoF motions. When tested on data containing all possible motions, classifiers trained on synthetic-appended data (III) significantly outperformed classifiers trained on 1-DoF real data (II), although significantly underperformed classifiers trained on both 1- and 2-DoF real data (I) (I < 0.05). These findings suggest that it is feasible to model EMG concurrent with multiarticulate motions as nonlinear combinations of EMG from constituent 1-DoF motions, and that such modelling can be harnessed to synthesize realistic training data.

Original languageEnglish
Title of host publication43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
PublisherIEEE - Institute of Electrical and Electronics Engineers Inc.
Pages6380-6383
Number of pages4
ISBN (Electronic)9781728111797
DOIs
Publication statusPublished - 2021
Event43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021 - Virtual, Online, Mexico
Duration: 2021 Nov 12021 Nov 5

Conference

Conference43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2021
Country/TerritoryMexico
CityVirtual, Online
Period2021/11/012021/11/05

Bibliographical note

Funding Information:
Research supported by the Promobilia Foundation, the Crafoord Foundation, the European Commission under the DeTOP project (LEIT-ICT-24- 2015, GA #687905), and the Swedish Research Council (DNR 2019-05601).

Publisher Copyright:
© 2021 IEEE.

Subject classification (UKÄ)

  • Computer Vision and Robotics (Autonomous Systems)

Fingerprint

Dive into the research topics of 'Can Deep Synthesis of EMG Overcome the Geometric Growth of Training Data Required to Recognize Multiarticulate Motions'. Together they form a unique fingerprint.

Cite this