Project "Multimodal Interaction"

Project leader: Prof Dr. Axel Schmidt,

Team: Prof. Dr. Arnulf Deppermann, Prof. Dr. Axel Schmidt, Isabell Neise

An adequate understanding of the use of language in social interaction requires an analysis of language in its interplay with other modalities of meaning construction (gestures, facial expressions, gaze etc.). Using the methodology of video-based multimodal interaction analysis, we examine the linguistic-communicative and material actions of people with each other and with objects. One main focus of the project is how spatial affordances influence interaction and, in turn, how interactants make use of space as an interactional resource. A second focus lies on the analysis ofinteractions in the context of media production.Of interest here is, with which practices media products are accomplished interactively within production contexts. Furthermore, differences between mediated interaction and everyday interaction are examined.

The project is divided in three sub-projects:

a) "Language and other physical modalities of communication"  Prof. Dr. Arnulf Deppermann, Prof. Dr. Axel Schmidt)

b) "Language and Space" (Dr. Reinhold Schmitt) (until 2019)

c) "Language, Multimodality and Mediality" (Prof. Dr. Axel Schmidt)

Kontakt: Prof. Dr. Arnulf Deppermann, deppermann(at); Prof. Dr. Axel Schmidt,; Dr. Reinhold Schmitt, reinhold.schmitt(at)