The Temporal Structure of Multimodal Communication

The general focus of this book is on multimodal communication, which captures the temporal patterns of behavior in various dialogue settings. After an overview of current theoretical models of verbal and nonverbal communication cues, it presents studies on a range of related topics: paraverbal behavior patterns in the classroom setting; a proposed optimal methodology for conversational analysis; a study of time and mood at work; an experiment on the dynamics of multimodal interaction from the observer's perspective; formal cues of uncertainty in conversation; how machines can know we understand them; and detecting topic changes using neural network techniques. A joint work bringing together psychologists, communication scientists, information scientists and linguists, the book will be of interest to those working on a wide range of applications from industry to home, and from health to security, with the main goals of revealing, embedding and implementing a rich spectrum of information on human behavior.

Offers a comprehensive analysis of multimodal communication, based in part on the most extensively annotated corpus of dialogues (HuComTech) Captures the temporal patterns of behavior using the T-pattern analysis extended to a broad variety of communicative data Gathers contributions from psychologists, communication scientists, information scientists and linguists, with all the benefits of interdisciplinarity

Inhalt
Linguistic and Contextual Clues of Intentions and Perspectives in Human Communication.- The Teacher's Body Communicates. Detection of Paraverbal Behaviour Patterns.- Is it Possible to Perform Liquefying Actions in Conversational Analysis? The Detection of Structures in Indirect Observations.- Research Methods for Studying Daily Life: Experience Sampling and a Multilevel Approach to Study Time and Mood at Work.