Investigating visual prosody using articulography

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceeding

Abstract

In this paper we describe present work on multimodal prosody by
means of simultaneous recordings of articulation and head movements. Earlier
work has explored patterning, usage and machine-learning based detection of
focal pitch accents, head beats and eyebrow beats through audiovisual recordings.
Kinematic data obtained through articulography allows for more comparable
and accurate measurements, as well as three-dimensional data. Therefore,
our current approach involves examining speech and body movements concurrently,
using electromagnetic articulography (EMA). We have recorded large
amounts of this kind of data previously, but for other purposes. In this paper, we
present results from a study on the interplay between head movements and
phrasing and find tendencies for upward movements occuring before and
downward movements occuring after prosodic boundaries.

Details

Authors
Organisations
External organisations
  • Linnaeus University
  • KTH Royal Institute of Technology
Research areas and keywords

Subject classification (UKÄ) – MANDATORY

  • Language Technology (Computational Linguistics)
  • General Language Studies and Linguistics
Original languageEnglish
Title of host publicationProceedings of4th Conference of The Association Digital Humanities in the Nordic Countries
Subtitle of host publicationCopenhagen, March 6-8 2019
PublisherCEUR
Publication statusPublished - 2019
Publication categoryResearch
Peer-reviewedYes
EventDHN 2019 Digital Humanities in the Nordic Countries 4th Conference - University of Copenhagen, Copenhagen, Denmark
Duration: 2019 Mar 62019 Mar 8
Conference number: 4
https://cst.dk/DHN2019/DHN2019.html

Conference

ConferenceDHN 2019 Digital Humanities in the Nordic Countries 4th Conference
CountryDenmark
CityCopenhagen
Period2019/03/062019/03/08
Internet address

Total downloads

No data available

Related research output

Johan Frid, Malin Svensson Lundmark, Ambrazaitis, G., Susanne Schötz & House, D., 2018, p. 17-20.

Research output: Contribution to conferencePaper, not in proceeding

View all (1)

Related projects

Johan Frid & Marianne Gullberg

2018/01/012024/12/31

Project: NetworkNational collaboration

David House, Gilbert Ambrazaitis, Johan Frid & Malin Svensson Lundmark

2018/01/012021/12/31

Project: Research

View all (2)

Related activities

Frid, J. (Presenter)
2019 Mar 7

Activity: Talk or presentationPresentation

View all (1)

Related infrastructure

View all (1)