Methodologies for visual communication and multimodal research

Project: Research

Project Details

Layman's description

Contemporary media messages are characterised by a high degree of semiotic complexity and combine various modes that are orchestrated in various ways. However, there is still a lack of empirical studies on how recipients interact with visuals and media messages.

The edited volume “Methodologies for multimodal research”, edited by Jana Holsanova, (Visual communication, 2012: 11 (3), Sage) is focusing on novel methods and tools for the analysis of visual communication and multimodality. It comprises a set of six papers and a book review and brings together international researchers from Germany, Sweden, Denmark, United States and Singapore representing various disciplines: communication and media studies, social semiotics, cognitive science, educational psychology, health studies and visual communication. The papers cover and integrate a wide range of theoretical and methodological approaches to visual communication and multimodality and use an interdisciplinary framework and triangulation of methods. The methods include content analysis, social semiotic analysis, eye tracking measurements – in combination with think aloud protocols and retrospective interviews –, as well as iconology and psychophysiological real time measurements. The respective approaches are exemplified through detailed analyses of a variety of materials, including press photography, art, multimodal health education materials, Power Point presentations, Internet advertisements and TV media discussions.

Table of contents:
Effective start/end date2011/01/012012/12/31