Motion capture-based animated characters for the study of speech-gesture integration

Forskningsoutput: TidskriftsbidragArtikel i vetenskaplig tidskriftPeer review

Sammanfattning

Digitally animated characters are promising tools in research studying how we integrate information from speech and visual sources such as gestures because they allow specific gesture features to be manipulated in isolation. We present an approach combining motion capture and 3D-animated characters that allows us to manipulate natural individual gesture strokes for experimental purposes, for example to temporally shift and present gestures in ecologically valid sequences. We exemplify how such stimuli can be used in an experiment investigating implicit detection of speech–gesture (a) synchrony, and discuss the general applicability of the workflow for research in this domain.
Originalspråkengelska
Sidor (från-till)1339-1354
Antal sidor16
TidskriftBehavior Research Methods
Volym52
Nummer3
Tidigt onlinedatum2019 dec. 10
DOI
StatusPublished - 2020 juni

Ämnesklassifikation (UKÄ)

  • Övrig annan samhällsvetenskap
  • Jämförande språkvetenskap och lingvistik

Fria nyckelord

  • Crossmodal information processing
  • Gesture
  • Speech-gesture integration
  • Motion Capture

Fingeravtryck

Utforska forskningsämnen för ”Motion capture-based animated characters for the study of speech-gesture integration”. Tillsammans bildar de ett unikt fingeravtryck.

Citera det här