Compensation for a large gesture-speech asynchrony in instructional videos

Forskningsoutput: Kapitel i bok/rapport/Conference proceedingKonferenspaper i proceeding

Abstract

We investigated the pragmatic effects of gesture-speech lag by asking participants to reconstruct formations of geometric shapes based on instructional films in four conditions: sync, video or audio lag (±1,500 ms), audio only. All three video groups rated the task as less difficult compared to the audio-only group and performed better. The scores were slightly lower when sound preceded gestures (video lag), but not when gestures preceded sound (audio lag). Participants thus compensated for delays of 1.5 seconds in either direction, apparently without making a conscious effort. This greatly exceeds the previously reported time window for automatic multimodal integration.

Detaljer

Författare
Enheter & grupper
Forskningsområden

Ämnesklassifikation (UKÄ) – OBLIGATORISK

  • Psykologi

Nyckelord

Originalspråkengelska
Titel på värdpublikationGesture and Speech in Interaction - 4th edition (GESPIN 4)
RedaktörerGaëlle Ferré, Mark Tutton
Sidor19-23
StatusPublished - 2015
PublikationskategoriForskning
Peer review utfördJa
EvenemangGesture and Speech in Interaction (GESPIN 4) - Nantes, Frankrike
Varaktighet: 2015 sep 22015 sep 4

Konferens

KonferensGesture and Speech in Interaction (GESPIN 4)
LandFrankrike
OrtNantes
Period2015/09/022015/09/04

Relaterade aktiviteter

Nirme, J. (presentatör)
2015 sep 2

Aktivitet: Deltagit i eller arrangerat evenemangDeltagit i konferens

Visa alla (1)