Exploiting Multimodal Interaction Techniques for Video-Surveillance

Marc Castelló, Jordi Gonzàlez, Ariel Amato, Pau Baiget, Carles Fernández, Josep M. Gonfaus, Ramón A. Mollineda, Marco Pedersoli, Nicolás Pérez de la Blanca, F. Xavier Roca

Research output: Contribution to journalArticleResearchpeer-review


In this paper we present an example of a video surveillance application that exploits Multimodal Interactive (MI) technologies. The main objective of the so-called VID-Hum prototype was to develop a cognitive artificial system for both the detection and description of a particular set of human behaviours arising from real-world events. The main procedure of the prototype described in this chapter entails: (i) adaptation, since the system adapts itself to the most common behaviours (qualitative data) inferred from tracking (quantitative data) thus being able to recognize abnormal behaviors; (ii) feedback, since an advanced interface based on Natural Language understanding allows end-users the communicationwith the prototype by means of conceptual sentences; and (iii) multimodality, since a virtual avatar has been designed to describe what is happening in the scene, based on those textual interpretations generated by the prototype. Thus, the MI methodology has provided an adequate framework for all these cooperating processes. © Springer-Verlag Berlin Heidelberg 2013.
Original languageEnglish
Pages (from-to)135-151
JournalIntelligent Systems Reference Library
Publication statusPublished - 21 Oct 2013

Fingerprint Dive into the research topics of 'Exploiting Multimodal Interaction Techniques for Video-Surveillance'. Together they form a unique fingerprint.

Cite this