Towards classification of head movements in audiovisual recordings of read news

Research output: Chapter in Book/Report/Conference proceedingPaper in conference proceeding

Abstract

In this paper we develop a system for detection of word-related head movements in audiovisu-al recordings of read news. Our materials consist of Swedish television news broadcasts and comprise audiovisual recordings of five news readers (two female, three male). The corpus was manually labelled for head movement, applying a simplistic annotation scheme consisting of a binary decision about absence/presence of a movement in relation to a word. We use OpenCV for frontal face detection and based on this we calculate velocity and acceleration features. Then we train a machine learning system to predict absence or presence of head movement and achieve an accuracy of 0.892, which is better than the baseline. The system may thus be helpful for head movement labelling.

Details

Authors
Organisations
External organisations
  • KTH Royal Institute of Technology
Research areas and keywords

Subject classification (UKÄ) – MANDATORY

  • Language Technology (Computational Linguistics)
  • General Language Studies and Linguistics
Original languageEnglish
Title of host publicationProceedings of the 4th European and 7th Nordic Symposium on Multimodal Communication (MMSYM 2016)
EditorsPatrizia Paggio, Costanza Navarretta
PublisherLinköping University Electronic Press
Pages4-9
Number of pages6
ISBN (Electronic)978-91-7685-423-5
Publication statusPublished - 2017 Sep 25
Publication categoryResearch
Peer-reviewedYes
Event4th European and 7th Nordic Symposium on Multimodal Communication - University of Copenhagen, Copenhagen, Denmark
Duration: 2016 Sep 292016 Sep 30
Conference number: 4
http://mmsym.org/?page_id=412

Publication series

NameLinköping Electronic Conference Proceedings
PublisherLinköping University Electronic Press
ISSN (Print)1650-3686
ISSN (Electronic)1650-3740

Conference

Conference4th European and 7th Nordic Symposium on Multimodal Communication
Abbreviated titleMMSYM 2016
CountryDenmark
CityCopenhagen
Period2016/09/292016/09/30
Internet address

Related research output

Johan Frid, Malin Svensson Lundmark, Ambrazaitis, G., Susanne Schötz & House, D., 2018, p. 17-20.

Research output: Contribution to conferencePaper, not in proceeding

View all (1)

Related projects

Johan Frid & Marianne Gullberg

2014/01/012018/12/31

Project: NetworkNational collaboration

View all (2)

Related infrastructure

View all (1)