Multimodal Processing and Interaction

This volume presents high quality, state-of-the-art research ideas and results from theoretic, algorithmic and application viewpoints. It contains contributions by leading experts in the obsequious scientific and technological field of multimedia. The volume was developed from a four-year collaboration among research groups participating in the European network of Excellence on Multimedia Understanding, Semantics, Computation and learning (MUSCLE). The book specifically focuses on interaction with multimedia content with special emphasis on multimodal interfaces for accessing multimedia information. Designed for a professional audience composed of practitioners and researchers in industry, the book is also suitable for advanced-level students in computer science.

Emphasis on multimodal information processing aspects of multimedia and cross-interaction of multiple modalities Broad spectrum of novel perspectives, analytic tools, algorithms, design practices and applications in multimedia science and engineering

Klappentext

Multimodal Processing and Interaction: Audio, Video and Text presents high quality, state-of-the-art research ideas and results from theoretic, algorithmic and application viewpoints. This edited volume contains both state-of-the-art reviews and original contributions by leading experts in the scientific and technological field of multimedia. It grew out of a four-year collaboration among research groups participating in the European network of Excellence on Multimedia Understanding, Semantics, Computation and Learning (MUSCLE).

Multimodal Processing and Interaction: Audio, Video and Text covers a broad spectrum of novel perspectives, analytic tools, algorithms, design practices and applications in multimedia science and engineering with emphasis on multimodal integration and modality fusion. This volume also contains contributions in the area of interaction with multimedia, especially multimodal interfaces for accessing multimedia content.

Multimodal Processing and Interaction: Audio, Video and Text is designed for a professional audience composed of practitioners and researchers in industry and academia. This book is suitable for advanced-level students in computer science and engineering as well.

Inhalt
Review of the State of the Art.- Cross-Modal Integration for Performance Improving in Multimedia: A Review.- Human-Computer Interfaces to Multimedia Content a Review.- Integrated Multimedia Analysis And Recognition.- Stochastic Models for Multimodal Video Analysis.- Adaptive Multimodal Fusion by Uncertainty Compensation with Application to Audio-Visual Speech Recognition.- Action Recognition in Multimedia Streams.- Surveillance Using Both Video and Audio.- Movie Analysis with Emphasis to Dialogue and Action Scene Detection.- Audiovisual Attention Modeling and Salient Event Detection.- Toward the Integration of Natural Language Processing and Automatic Speech Recognition: Using Morpho-Syntax and Pragmatics for Transcription.- Searching Multimedia Content.- Interactive Image Retrieval Using a Hybrid Visual and Conceptual Content Representation.- Multimodal Analysis of Text and Audio Features for Music Information Retrieval.- Intelligent Search for Image Information on the Web through Text and Link Structure Analysis.- Interfaces to Multimedia Content.- IDesign Principles for Multimodal Spoken Dialogue Systems.- Eye Tracking: A New Interface for Visual Exploration.- User Interaction for Mobile Devices.