Eye Tracking and Multimodality

Aktivitet: Föredrag eller presentationInbjuden talare

Detaljer

Titel Eye Tracking and Multimodality
Person och roll
Beskrivning Workshop: Eye tracking and Multimodality
In our everyday life, we encounter complex multimodal messages consisting of still and moving images, texts and graphical elements that are orchestrated in specific ways. These messages are designed to serve a certain purpose: to inform, explain, instruct, persuade, educate, sell and entertain. However, the knowledge about how we actually interact with these messages is rare. What catches our attention and what does not? How do we extract and integrate information from various sources during meaning–making? How do we navigate in order to find relevant information?
The aim of the workshop is to give an overview of different ways in which eye-tracking methodology can be used in research on multimodality. In particular, we will explore reception of multimodality, i.e. the way multimodal messages are perceived by actual users. Various application areas associated with the use of eye-tracking methodology will be illustrated and will include:
• newspaper design
• teaching materials
• information graphics
• advertisement
• medical information
• web design
The workshop will explore theoretical concepts and methods in the area of social semiotics, multimedia learning theory and cognitive science. There will be opportunities to view demonstrations from various projects and reflect on, question and discuss participants’ experiences. In particular, we will discuss the relation between design intent and actual reception of a multimodal message to see to what extent the design supports and guides the effect for a group of users. A general debate on methodological approaches will be invited: Why to study multimodality from a reception perspective? How can we use eye tracking in multimodal research and in visual communication? What are the possibilities and limitations of eye tracking methodology?
Dato/periode

2018 nov 8

Relaterade organisationer
Workshop: Eye tracking and Multimodality
In our everyday life, we encounter complex multimodal messages consisting of still and moving images, texts and graphical elements that are orchestrated in specific ways. These messages are designed to serve a certain purpose: to inform, explain, instruct, persuade, educate, sell and entertain. However, the knowledge about how we actually interact with these messages is rare. What catches our attention and what does not? How do we extract and integrate information from various sources during meaning–making? How do we navigate in order to find relevant information?
The aim of the workshop is to give an overview of different ways in which eye-tracking methodology can be used in research on multimodality. In particular, we will explore reception of multimodality, i.e. the way multimodal messages are perceived by actual users. Various application areas associated with the use of eye-tracking methodology will be illustrated and will include:
• newspaper design
• teaching materials
• information graphics
• advertisement
• medical information
• web design
The workshop will explore theoretical concepts and methods in the area of social semiotics, multimedia learning theory and cognitive science. There will be opportunities to view demonstrations from various projects and reflect on, question and discuss participants’ experiences. In particular, we will discuss the relation between design intent and actual reception of a multimodal message to see to what extent the design supports and guides the effect for a group of users. A general debate on methodological approaches will be invited: Why to study multimodality from a reception perspective? How can we use eye tracking in multimodal research and in visual communication? What are the possibilities and limitations of eye tracking methodology?
2018 nov 8

Evenemang (Konferens)

TitelDiscourse, multimodality and experimental methods
Förkortning TitelDMEM
Period2018/11/062018/11/09
OrtVina del Mar
LandChile
IgenkänningsgradInternationellt evenemang

Related projects

Jana Holsanova & Cecilia Wadensjö

2010/01/15 → …

Projekt: NätverkTvärvetenskaplig forskning

Visa alla (2)

Relaterad forskningsoutput

Peter Gärdenfors & Jana Holsanova, 2015 dec, Cognition, Meaning, and Action: Lodz-Lund Studies in Cognitive Science. Lukowski, P., Gemel, A. & Zukowski, B. (red.). Łódź-Krakow: Jagiellonian University Press, s. 109-122

Forskningsoutput: Kapitel i bok/rapport/Conference proceedingKapitel samlingsverk

Jana Holsanova, 2014, Visual communication. Handbooks of Communication Science. Machin, D. (red.). De Gruyter, Vol. 4. s. 331-355

Forskningsoutput: Kapitel i bok/rapport/Conference proceedingKapitel samlingsverk

Jana Holsanova, 2014, Routledge Handbook of Multimodal Analysis. Jewitt, C. (red.). Routledge, s. 285-296

Forskningsoutput: Kapitel i bok/rapport/Conference proceedingKapitel samlingsverk

Visa alla (9)

Relaterade aktiviteter

Holsanova, J. (Huvudtalare)
2018 nov 7

Aktivitet: Föredrag eller presentationInbjuden talare

Visa alla (1)