Generation of augmented video sequences combining behavioral animation and multi-object tracking

Pau Baiget, Carles Fernández, Xavier Roca, Jordi Gonzàlez

Research output: Contribution to journalArticleResearchpeer-review

3 Citations (Scopus)


In this paper we present a novel approach to generate augmented video sequences in real-time, involving interactions between virtual and real agents in real scenarios. On the one hand, real agent motion is estimated by means of a multi-object tracking algorithm, which determines real objects' position over the scenario for each time step. On the other hand, virtual agents are provided with behavior models considering their interaction with the environment and with other agents. The resulting framework allows to generate video sequences involving behavior-based virtual agents that react to real agent behavior and has applications in education, simulation, and in the game and movie industries. We show the performance of the proposed approach in an indoor and outdoor scenario simulating human and vehicle agents. ©2009 John Wiley & Sons, Ltd.
Original languageEnglish
Pages (from-to)473-489
JournalComputer Animation and Virtual Worlds
Publication statusPublished - 1 Jul 2009


  • Augmented reality
  • Behavioral animation
  • Virtual human agents


Dive into the research topics of 'Generation of augmented video sequences combining behavioral animation and multi-object tracking'. Together they form a unique fingerprint.

Cite this