Attention to speech-accompanying gestures: Eye movements and information uptake

Research output: Contribution to journalArticle

Standard

Attention to speech-accompanying gestures: Eye movements and information uptake. / Gullberg, Marianne; Kita, Sotaro.

In: Journal of Nonverbal Behavior, Vol. 33, No. 4, 2009, p. 251-277.

Research output: Contribution to journalArticle

Harvard

APA

CBE

MLA

Vancouver

Author

RIS

TY - JOUR

T1 - Attention to speech-accompanying gestures: Eye movements and information uptake

AU - Gullberg, Marianne

AU - Kita, Sotaro

N1 - The information about affiliations in this record was updated in December 2015. The record was previously connected to the following departments: Linguistics and Phonetics (015010003)

PY - 2009

Y1 - 2009

N2 - There is growing evidence that addressees in interaction integrate the semantic information conveyed by speakers’ gestures. Little is known, however, about whether and how addressees’ attention to gestures and the integration of gestural information can be modulated. This study examines the influence of a social factor (speakers’ gaze to their own gestures), and two physical factors (the gesture’s location in gesture space and gestural holds) on addressees’ overt visual attention to gestures (direct fixations of gestures) and their uptake of gestural information. It also examines the relationship between gaze and uptake. The results indicate that addressees’ overt visual attention to gestures is affected both by speakers’ gaze and holds but for different reasons, whereas location in space plays no role. Addressees’ uptake of gesture information is only influenced by speakers’ gaze. There is little evidence of a direct relationship between addressees’ direct fixations of gestures and their uptake.

AB - There is growing evidence that addressees in interaction integrate the semantic information conveyed by speakers’ gestures. Little is known, however, about whether and how addressees’ attention to gestures and the integration of gestural information can be modulated. This study examines the influence of a social factor (speakers’ gaze to their own gestures), and two physical factors (the gesture’s location in gesture space and gestural holds) on addressees’ overt visual attention to gestures (direct fixations of gestures) and their uptake of gestural information. It also examines the relationship between gaze and uptake. The results indicate that addressees’ overt visual attention to gestures is affected both by speakers’ gaze and holds but for different reasons, whereas location in space plays no role. Addressees’ uptake of gesture information is only influenced by speakers’ gaze. There is little evidence of a direct relationship between addressees’ direct fixations of gestures and their uptake.

KW - interaction

KW - eye gaze

KW - fixation

KW - gesture

KW - multimodal information processing

U2 - 10.1007/s10919-009-0073-2

DO - 10.1007/s10919-009-0073-2

M3 - Article

VL - 33

SP - 251

EP - 277

JO - Journal of Nonverbal Behavior

JF - Journal of Nonverbal Behavior

SN - 1573-3653

IS - 4

ER -