Embodied bilingualism (a Wallenberg Scholar project)

Project: Research

Layman's description

Most people speak several languages and coordinate speech and gestures in language-specific ways. Yet we know very little about the processes that drive multimodal language use and learning. This project explores experimentally how adults manage the interaction between their languages - seen e.g. in foreign accent - using techniques such as motion capture, electrophysiology, and virtual reality.

Most people in the world speak several languages and often learn new languages in adulthood. All speakers also coordinate speech and gestures in language-specific ways. The world is thus multilingual and communication is multimodal. Yet we know very little about the processes underlying the multimodal production, comprehension and learning of languages and even less about how learning and processing can be improved.

This program examines experimentally how adult multilingual speakers handle the interaction between their new and existing languages, reflected e.g. in foreign accent. We examine how the interaction between languages affect the multimodal production and comprehension of speech and gesture, changes during learning, and the role of gestures for learning. One part targets production to establish profiles of speech and gesture repertoires in mono- and multilingual speakers using sensor technology (articulography for speech, motion capture for gestures). Another part investigates whether recipients are sensitive to gestural accent using electrophysiological measures of brain activity. A third part focuses on learning using sensor data from part one to develop virtual speakers to be used in teaching.

The project breaks new ground and challenges the monolingual, unimodal and static theories of human language in favour of a multilingual, bimodal and dynamic perspective. It develops new measurements and experimental tools that can also be implemented in teaching.
StatusFinished
Effective start/end date2013/01/012017/12/31

Participants

Related projects

(Associated with)

Chloe Marshall, Vikki Janke & Marianne Gullberg

2019/04/012022/03/31

Project: Network

Marianne Gullberg & Emanuel Bylund

2017/03/222020/06/30

Project: Network

View all (3)

Related research output

Sandler, W., Marianne Gullberg & Padden, C., 2019 Aug 2, In : Frontiers in Psychology. 10, 1765.

Research output: Contribution to journalDebate/Note/Editorial

Parafita Couto, M. C. & Marianne Gullberg, 2019, In : International Journal of Bilingualism. 23, 2, p. 695-714 20 p.

Research output: Contribution to journalArticle

Wendy, S. (ed.), Marianne Gullberg (ed.) & Padden, C. (ed.), 2019, (Accepted/In press) Lausanne: Frontiers Media.

Research output: Book/ReportAnthology (editor)

View all (4)

Related activities

Gullberg, M. (Invited speaker)
2019 Nov 5

Activity: Talk or presentationInvited talk

Gullberg, M. (Invited speaker)
2019 Oct 8

Activity: Talk or presentationPublic lecture/debate/seminar

View all (66)

Related prizes

Marianne Gullberg (Recipient), 2019 May 14

Prizes and Distinctions: National/international honour

View all (1)