Augmented songbook: an augmented reality educational application for raising music awareness

Marçal Rusiñol, Joseph Chazalon, Katerine Diaz-Chito

Research output: Contribution to journalArticleResearchpeer-review

19 Citations (Scopus)


© 2017, Springer Science+Business Media, LLC. This paper presents the development of an Augmented Reality mobile application which aims at sensibilizing young children to abstract concepts of music. Such concepts are, for instance, the musical notation or the idea of rhythm. Recent studies in Augmented Reality for education suggest that such technologies have multiple benefits for students, including younger ones. As mobile document image acquisition and processing gains maturity on mobile platforms, we explore how it is possible to build a markerless and real-time application to augment the physical documents with didactic animations and interactive virtual content. Given a standard image processing pipeline, we compare the performance of different local descriptors at two key stages of the process. Results suggest alternatives to the SIFT local descriptors, regarding result quality and computational efficiency, both for document model identification and perspective transform estimation. All experiments are performed on an original and public dataset we introduce here.
Original languageEnglish
Pages (from-to)13773-13798
JournalMultimedia Tools and Applications
Publication statusPublished - 1 Jun 2018


  • Augmented reality
  • Document image matching
  • Educational applications


Dive into the research topics of 'Augmented songbook: an augmented reality educational application for raising music awareness'. Together they form a unique fingerprint.

Cite this