Towards Multimodal Analysis of Dialogic Moments in Storytelling-based Discourse

  • Ngoc Doan Tilburg University
  • Andrius Penkauskas Tilburg University
  • Ecaterina Grigoriev Tilburg University


The key to an effective communication method arguably lies in its ability to facilitate moments of high mutual understanding (dialogic moments). It would, therefore, be useful to identify these moments and perhaps facilitate them. In this pilot study, we present a multimodal analysis of dialogic moments in storytelling-based discussions. We collected skin conductance, heartrate, speaking turns, relative body position, conversation transcripts, and subjective experience. This multimodal data corpus enables the computational study of these highly subjective moments and the potential creation of digital communication aids. Preliminary results show that there might be subcategories of dialogic moments that were previously unidentified.

How to Cite
DOAN, Ngoc; PENKAUSKAS, Andrius; GRIGORIEV, Ecaterina. Towards Multimodal Analysis of Dialogic Moments in Storytelling-based Discourse. Student Undergraduate Research E-journal!, [S.l.], v. 5, p. 1-4, dec. 2019. ISSN 2468-0443. Available at: <>. Date accessed: 18 jan. 2021. doi: