Embodied bilingualism (a Wallenberg Scholar project)

Project: Research

Layman's description

Most people speak several languages and coordinate speech and gestures in language-specific ways. Yet we know very little about the processes that drive multimodal language use and learning. This project explores experimentally how adults manage the interaction between their languages - seen e.g. in foreign accent - using techniques such as motion capture, electrophysiology, and virtual reality.

Most people in the world speak several languages and often learn new languages in adulthood. All speakers also coordinate speech and gestures in language-specific ways. The world is thus multilingual and communication is multimodal. Yet we know very little about the processes underlying the multimodal production, comprehension and learning of languages and even less about how learning and processing can be improved.

This program examines experimentally how adult multilingual speakers handle the interaction between their new and existing languages, reflected e.g. in foreign accent. We examine how the interaction between languages affect the multimodal production and comprehension of speech and gesture, changes during learning, and the role of gestures for learning. One part targets production to establish profiles of speech and gesture repertoires in mono- and multilingual speakers using sensor technology (articulography for speech, motion capture for gestures). Another part investigates whether recipients are sensitive to gestural accent using electrophysiological measures of brain activity. A third part focuses on learning using sensor data from part one to develop virtual speakers to be used in teaching.

The project breaks new ground and challenges the monolingual, unimodal and static theories of human language in favour of a multilingual, bimodal and dynamic perspective. It develops new measurements and experimental tools that can also be implemented in teaching.
StatusFinished
Effective start/end date2013/01/012017/12/31

Participants

Related projects

(Associated with)

Chloe Marshall, Vikki Janke, Marianne Gullberg, Julia Hofweber & Lizzy Aumonier

2019/04/012022/03/31

Project: ResearchInternational collaboration

Marianne Gullberg & Emanuel Bylund

2017/03/222020/06/30

Project: NetworkInternational collaboration

View all (3)

Related research output

Marianne Gullberg, 2020, (Submitted) The blossoming of gesture in language. Morgenstern, A. & Goldin-Meadow, S. (eds.). Mouton de Gruyter

Research output: Chapter in Book/Report/Conference proceedingBook chapter

Marianne Gullberg, 2020, (Submitted) The Cambridge handbook of gesture studies. Cienki, A. (ed.). Cambridge University Press

Research output: Chapter in Book/Report/Conference proceedingBook chapter

Marianne Gullberg, 2020, (Submitted) The Routledge handbook of second language acquisition and psycholinguistics. Godfroid, A. & Hopp, H. (eds.). Routledge

Research output: Chapter in Book/Report/Conference proceedingBook chapter

View all (8)

Related activities

Annika Andersson (Presenter), Gullberg, M. (Presenter)
2021 Aug 152021 Aug 21

Activity: Participating in or organising an eventParticipation in conference

Gullberg, M. (Invited speaker)
2021 Aug 152021 Aug 21

Activity: Talk or presentationInvited talk

Robyn Berghoff (Presenter), Gullberg, M. (Presenter), Gerrit Jan Kootstra (Presenter)
2021 Jun 302021 Jul 3

Activity: Participating in or organising an eventParticipation in conference

View all (91)

Related prizes

Marianne Gullberg (Recipient), 2019 May 14

Prizes and Distinctions: National/international honour

View all (1)