The production of prosodic prominence: integrating bodily and articulatory gestures

Project: Research

Research areas and keywords

UKÄ subject classification

  • General Language Studies and Linguistics

Keywords

  • visual prosody, multimodality, articulography

Description

An essential function of prosody in spoken interaction is to highlight important words and phrases and make them more prominent. In recent years, we have begun to understand prosodic prominence as a multimodal phenomenon, composed of verbal and visual prominence markers. Verbal prominence markers are typically identified as sentence-level pitch accents. Bodily gestures such as hand strokes, head nods and eyebrow movements are often aligned with a pitch accent and function as visual markers of prominence. The prominent word itself is often given stronger articulatory gestural movements resulting in both acoustic prominence (louder and longer) and visual prominence (greater movements of the lips and jaw). This project aims at investigating whether and how these different types of prominence markers interact and possibly influence each other. Three types of speech data will be analysed: read television news, unrestricted spontaneous speech and controlled experimental recordings in which motion capture and electromagnetic articulography will be used for recording movements of the hands, head, the eyebrows, and the articulators (lips, tongue, jaw). The results will be formulated in terms of a model of multimodal speech production, which will have implications for our general understanding of how speech and gestures are planned and coordinated by the speaker. It will also enable better modeling of speech and gestures in such speech applications as robots and avatars.

Short titlePROGEST
StatusActive
Effective start/end date2018/01/012021/12/31

Collaborative partners

Participants

Related projects

(Predecessor)

Johan Frid & Marianne Gullberg

2014/01/012018/12/31

Project: NetworkNational collaboration

View all (1)

Related research output

Johan Frid, Malin Svensson Lundmark, Ambrazaitis, G., Susanne Schötz & House, D. 2018 p. 17-20

Research output: Contribution to conferencePaper, not in proceeding

View all (1)

Related activities

Johan Frid (Presenter)
2018 Jun 8

Activity: Talk or presentationPresentation

View all (1)