Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements

Gilbert Ambrazaitis; Johan Frid; David House

doi:10.21437/SpeechProsody.2022-72

Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements

Gilbert Ambrazaitis, Johan Frid, David House

Lund University Humanities Lab

Research output: Chapter in Book/Report/Conference proceeding › Paper in conference proceeding › peer-review

Abstract

Visual information can be integrated in prominence perception, but most available evidence stems from controlled experimental settings, often involving synthetic stimuli. The present study provides evidence from spontaneously produced head gestures that occurred in Swedish television news readings. Sixteen short clips (containing 218 words in total) were rated for word prominence by 85 adult volunteers in a between-subjects design (44 in an audio-visual vs. 41 in an audio-only condition) using a web-based rating task. As an initial test of overall rating behavior, average prominence across all 218 words was compared between the two conditions, revealing no significant difference. In a second step, we compared normalized prominence ratings between the two conditions for all 218 words individually. These results displayed significant (or near significant, p

Original language	English
Title of host publication	Proceedings of the 11th International Conference on Speech Prosody
Subtitle of host publication	Speech Prosody 2022
Editors	Sónia Frota, Marisa Cruz, Marina Vigário
Publisher	ISCA
Pages	352-356
Number of pages	5
DOIs	https://doi.org/10.21437/SpeechProsody.2022-72
Publication status	Published - 2022
Event	11th International Conference on Speech Prosody: Speech Prosody 2022 - Lisbon, Portugal Duration: 2022 May 23 → 2022 May 26 Conference number: 11 http://labfon.letras.ulisboa.pt/sp2022/program.html

Publication series

Name	Proceedings of the International Conference on Speech Prosody
ISSN (Print)	2333-2042

Conference

Conference	11th International Conference on Speech Prosody
Country/Territory	Portugal
City	Lisbon
Period	2022/05/23 → 2022/05/26
Internet address	http://labfon.letras.ulisboa.pt/sp2022/program.html

Subject classification (UKÄ)

Comparative Language Studies and Linguistics

Free keywords

prominence perception
multimodality
beat gesture
pitch accent
visual prosody

Access to Document

10.21437/SpeechProsody.2022-72Licence: Unspecified

Cite this

Ambrazaitis, G., Frid, J., & House, D. (2022). Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements. In S. Frota, M. Cruz, & M. Vigário (Eds.), Proceedings of the 11th International Conference on Speech Prosody: Speech Prosody 2022 (pp. 352-356). (Proceedings of the International Conference on Speech Prosody). ISCA. https://doi.org/10.21437/SpeechProsody.2022-72

Ambrazaitis, Gilbert ; Frid, Johan ; House, David. / Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements. Proceedings of the 11th International Conference on Speech Prosody: Speech Prosody 2022. editor / Sónia Frota ; Marisa Cruz ; Marina Vigário. ISCA, 2022. pp. 352-356 (Proceedings of the International Conference on Speech Prosody).

@inproceedings{97c3b52a175c45cfac8f6ebc81157c80,

title = "Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements",

abstract = "Visual information can be integrated in prominence perception, but most available evidence stems from controlled experimental settings, often involving synthetic stimuli. The present study provides evidence from spontaneously produced head gestures that occurred in Swedish television news readings. Sixteen short clips (containing 218 words in total) were rated for word prominence by 85 adult volunteers in a between-subjects design (44 in an audio-visual vs. 41 in an audio-only condition) using a web-based rating task. As an initial test of overall rating behavior, average prominence across all 218 words was compared between the two conditions, revealing no significant difference. In a second step, we compared normalized prominence ratings between the two conditions for all 218 words individually. These results displayed significant (or near significant, p",

keywords = "prominence perception, multimodality, beat gesture, pitch accent, visual prosody",

author = "Gilbert Ambrazaitis and Johan Frid and David House",

year = "2022",

doi = "10.21437/SpeechProsody.2022-72",

language = "English",

series = "Proceedings of the International Conference on Speech Prosody",

publisher = "ISCA",

pages = "352--356",

editor = "S{\'o}nia Frota and Marisa Cruz and Marina Vig{\'a}rio",

booktitle = "Proceedings of the 11th International Conference on Speech Prosody",

note = "11th International Conference on Speech Prosody ; Conference date: 23-05-2022 Through 26-05-2022",

url = "http://labfon.letras.ulisboa.pt/sp2022/program.html",

}

Ambrazaitis, G, Frid, J & House, D 2022, Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements. in S Frota, M Cruz & M Vigário (eds), Proceedings of the 11th International Conference on Speech Prosody: Speech Prosody 2022. Proceedings of the International Conference on Speech Prosody, ISCA, pp. 352-356, 11th International Conference on Speech Prosody, Lisbon, Portugal, 2022/05/23. https://doi.org/10.21437/SpeechProsody.2022-72

Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements. / Ambrazaitis, Gilbert; Frid, Johan; House, David.
Proceedings of the 11th International Conference on Speech Prosody: Speech Prosody 2022. ed. / Sónia Frota; Marisa Cruz; Marina Vigário. ISCA, 2022. p. 352-356 (Proceedings of the International Conference on Speech Prosody).

Research output: Chapter in Book/Report/Conference proceeding › Paper in conference proceeding › peer-review

TY - GEN

T1 - Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements

AU - Ambrazaitis, Gilbert

AU - Frid, Johan

AU - House, David

N1 - Conference code: 11

PY - 2022

Y1 - 2022

N2 - Visual information can be integrated in prominence perception, but most available evidence stems from controlled experimental settings, often involving synthetic stimuli. The present study provides evidence from spontaneously produced head gestures that occurred in Swedish television news readings. Sixteen short clips (containing 218 words in total) were rated for word prominence by 85 adult volunteers in a between-subjects design (44 in an audio-visual vs. 41 in an audio-only condition) using a web-based rating task. As an initial test of overall rating behavior, average prominence across all 218 words was compared between the two conditions, revealing no significant difference. In a second step, we compared normalized prominence ratings between the two conditions for all 218 words individually. These results displayed significant (or near significant, p

AB - Visual information can be integrated in prominence perception, but most available evidence stems from controlled experimental settings, often involving synthetic stimuli. The present study provides evidence from spontaneously produced head gestures that occurred in Swedish television news readings. Sixteen short clips (containing 218 words in total) were rated for word prominence by 85 adult volunteers in a between-subjects design (44 in an audio-visual vs. 41 in an audio-only condition) using a web-based rating task. As an initial test of overall rating behavior, average prominence across all 218 words was compared between the two conditions, revealing no significant difference. In a second step, we compared normalized prominence ratings between the two conditions for all 218 words individually. These results displayed significant (or near significant, p

KW - prominence perception

KW - multimodality

KW - beat gesture

KW - pitch accent

KW - visual prosody

UR - https://lnu.diva-portal.org/smash/record.jsf?dswid=-6157&pid=diva2%3A1740018

U2 - 10.21437/SpeechProsody.2022-72

DO - 10.21437/SpeechProsody.2022-72

M3 - Paper in conference proceeding

T3 - Proceedings of the International Conference on Speech Prosody

SP - 352

EP - 356

BT - Proceedings of the 11th International Conference on Speech Prosody

A2 - Frota, Sónia

A2 - Cruz, Marisa

A2 - Vigário, Marina

PB - ISCA

T2 - 11th International Conference on Speech Prosody

Y2 - 23 May 2022 through 26 May 2022

ER -

Ambrazaitis G, Frid J, House D. Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements. In Frota S, Cruz M, Vigário M, editors, Proceedings of the 11th International Conference on Speech Prosody: Speech Prosody 2022. ISCA. 2022. p. 352-356. (Proceedings of the International Conference on Speech Prosody). doi: 10.21437/SpeechProsody.2022-72

Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements

Abstract

Publication series

Conference

Subject classification (UKÄ)

Free keywords

Access to Document

Other files and links

Fingerprint

Språkbanken & Swe-Clarin

Lund University Humanities Lab

Cite this

Auditory vs. audiovisual prominence ratings of speech involving spontaneously produced head movements

Abstract

Publication series

Conference

Subject classification (UKÄ)

Free keywords

Access to Document

Other files and links

Fingerprint

Projects

Språkbanken & Swe-Clarin

Equipment

Lund University Humanities Lab

Cite this