Intentionality in Multimodal Interaction

Intentionality and Joint Attention in Multimodal Interaction

The project studies how intentionality and joint attention are indicated by verbal, gestural, and other bodily markers. We create a typology of these markers. Together with project C01, we test the correlation of eye gaze with categories of intentionality on different levels of abstraction and complexity. Jointly with projects D04 and B01, a pilot study for such markers and different levels in human-machine interaction is conducted. The project sets the ground for their formal description and further implementation in application scenarios. To achieve these goals, the project combines empirical and experimental studies with methods and concepts from empirical gesture studies, linguistics, semiotics, and intentional logic.