Investigating visual prosody using articulography

Johan Frid; Malin Svensson Lundmark; Ambrazaitis Gilbert; Susanne Schötz; David House

Investigating visual prosody using articulography

Johan Frid, Malin Svensson Lundmark, Ambrazaitis Gilbert, Susanne Schötz, David House

Research output: Chapter in Book/Report/Conference proceeding › Paper in conference proceeding › peer-review

175 Downloads (Pure)

Abstract

In this paper we describe present work on multimodal prosody by
means of simultaneous recordings of articulation and head movements. Earlier
work has explored patterning, usage and machine-learning based detection of
focal pitch accents, head beats and eyebrow beats through audiovisual recordings.
Kinematic data obtained through articulography allows for more comparable
and accurate measurements, as well as three-dimensional data. Therefore,
our current approach involves examining speech and body movements concurrently,
using electromagnetic articulography (EMA). We have recorded large
amounts of this kind of data previously, but for other purposes. In this paper, we
present results from a study on the interplay between head movements and
phrasing and find tendencies for upward movements occuring before and
downward movements occuring after prosodic boundaries.

Original language	English
Title of host publication	Proceedings of4th Conference of The Association Digital Humanities in the Nordic Countries
Subtitle of host publication	Copenhagen, March 6-8 2019
Publisher	CEUR-WS
Publication status	Published - 2019
Event	DHN 2019 Digital Humanities in the Nordic Countries 4th Conference - University of Copenhagen, Copenhagen, Denmark Duration: 2019 Mar 6 → 2019 Mar 8 Conference number: 4 https://cst.dk/DHN2019/DHN2019.html

Conference

Conference	DHN 2019 Digital Humanities in the Nordic Countries 4th Conference
Country/Territory	Denmark
City	Copenhagen
Period	2019/03/06 → 2019/03/08
Internet address	https://cst.dk/DHN2019/DHN2019.html

Subject classification (UKÄ)

Language Technology (Computational Linguistics)
General Language Studies and Linguistics

Access to Document

Contribution_133Final published version, 355 KBLicence: Unspecified

http://ceur-ws.org/Vol-2364/12_paper.pdf

1 Paper, not in proceeding

EMA-based head movements and phrasing: a preliminary study
Frid, J., Svensson Lundmark, M., Ambrazaitis, G., Schötz, S. & House, D., 2018, p. 17-20.
Research output: Contribution to conference › Paper, not in proceeding

Open Access
File

2 Finished

The production of prosodic prominence: integrating bodily and articulatory gestures
House, D. (PI), Ambrazaitis, G. (Researcher), Frid, J. (Researcher) & Svensson Lundmark, M. (Researcher)
2018/01/01 → 2021/12/31
Project: Research
Språkbanken & Swe-Clarin
Frid, J. (CoI) & Gullberg, M. (CoI)
2018/01/01 → 2024/12/31
Project: Network

Lund University Humanities Lab
Gullberg, M. (Manager)
Lund University Humanities Lab
Infrastructure

1 Presentation

Investigating visual prosody using articulography
Frid, J. (Presenter)
2019 Mar 7
Activity: Talk or presentation › Presentation

File

Cite this

@inproceedings{a6338acfa9354c5e8e5fb6cff0e03c08,

title = "Investigating visual prosody using articulography",

abstract = "In this paper we describe present work on multimodal prosody bymeans of simultaneous recordings of articulation and head movements. Earlierwork has explored patterning, usage and machine-learning based detection offocal pitch accents, head beats and eyebrow beats through audiovisual recordings.Kinematic data obtained through articulography allows for more comparableand accurate measurements, as well as three-dimensional data. Therefore,our current approach involves examining speech and body movements concurrently,using electromagnetic articulography (EMA). We have recorded largeamounts of this kind of data previously, but for other purposes. In this paper, wepresent results from a study on the interplay between head movements andphrasing and find tendencies for upward movements occuring before anddownward movements occuring after prosodic boundaries.",

author = "Johan Frid and {Svensson Lundmark}, Malin and Ambrazaitis Gilbert and Susanne Sch{\"o}tz and David House",

year = "2019",

language = "English",

booktitle = "Proceedings of4th Conference of The Association Digital Humanities in the Nordic Countries",

publisher = "CEUR-WS",

note = "DHN 2019 Digital Humanities in the Nordic Countries 4th Conference ; Conference date: 06-03-2019 Through 08-03-2019",

url = "https://cst.dk/DHN2019/DHN2019.html",

}

Frid, J , Svensson Lundmark, M, Gilbert, A, Schötz, S & House, D 2019, Investigating visual prosody using articulography. in Proceedings of4th Conference of The Association Digital Humanities in the Nordic Countries: Copenhagen, March 6-8 2019. CEUR-WS, DHN 2019 Digital Humanities in the Nordic Countries 4th Conference, Copenhagen, Denmark, 2019/03/06. <http://ceur-ws.org/Vol-2364/12_paper.pdf>

TY - GEN

T1 - Investigating visual prosody using articulography

AU - Frid, Johan

AU - Svensson Lundmark, Malin

AU - Gilbert, Ambrazaitis

AU - Schötz, Susanne

AU - House, David

N1 - Conference code: 4

PY - 2019

Y1 - 2019

N2 - In this paper we describe present work on multimodal prosody bymeans of simultaneous recordings of articulation and head movements. Earlierwork has explored patterning, usage and machine-learning based detection offocal pitch accents, head beats and eyebrow beats through audiovisual recordings.Kinematic data obtained through articulography allows for more comparableand accurate measurements, as well as three-dimensional data. Therefore,our current approach involves examining speech and body movements concurrently,using electromagnetic articulography (EMA). We have recorded largeamounts of this kind of data previously, but for other purposes. In this paper, wepresent results from a study on the interplay between head movements andphrasing and find tendencies for upward movements occuring before anddownward movements occuring after prosodic boundaries.

AB - In this paper we describe present work on multimodal prosody bymeans of simultaneous recordings of articulation and head movements. Earlierwork has explored patterning, usage and machine-learning based detection offocal pitch accents, head beats and eyebrow beats through audiovisual recordings.Kinematic data obtained through articulography allows for more comparableand accurate measurements, as well as three-dimensional data. Therefore,our current approach involves examining speech and body movements concurrently,using electromagnetic articulography (EMA). We have recorded largeamounts of this kind of data previously, but for other purposes. In this paper, wepresent results from a study on the interplay between head movements andphrasing and find tendencies for upward movements occuring before anddownward movements occuring after prosodic boundaries.

M3 - Paper in conference proceeding

BT - Proceedings of4th Conference of The Association Digital Humanities in the Nordic Countries

PB - CEUR-WS

T2 - DHN 2019 Digital Humanities in the Nordic Countries 4th Conference

Y2 - 6 March 2019 through 8 March 2019

ER -

Investigating visual prosody using articulography

Abstract

Conference

Subject classification (UKÄ)

Access to Document

Fingerprint

Research output

EMA-based head movements and phrasing: a preliminary study

Projects

The production of prosodic prominence: integrating bodily and articulatory gestures

Språkbanken & Swe-Clarin

Equipment

Lund University Humanities Lab

Activities

Investigating visual prosody using articulography

Cite this