Meta-MMFNet: Meta-Learning Based Multi-Model Fusion Network for Micro-Expression Recognition

Gong Wenjuan*, Yue Zhang, Wei Wang, Peng Cheng, Jordi Gonzalez Sabate

*Autor corresponent d’aquest treball

Producció científica: Contribució a revistaArticleRecercaAvaluat per experts

9 Cites (Scopus)

Resum

<jats:p>Despite its wide applications in criminal investigations and clinical communications with patients suffering from autism, automatic micro-expression recognition remains a challenging problem because of the lack of training data and imbalanced classes problems. In this study, we proposed a meta-learning based multi-model fusion network (Meta-MMFNet) to solve the existing problems. The proposed method is based on the metric-based meta-learning pipeline, which is specifically designed for few-shot learning and is suitable for model-level fusion. The frame difference and optical flow features were fused, deep features were extracted from the fused feature, and finally in the meta-learning-based framework, weighted sum model fusion method was applied for micro-expression classification. Meta-MMFNet achieved better results than state-of-the-art methods on four datasets. The code is available at https://github.com/wenjgong/meta-fusion-based-method.</jats:p>
Idioma originalAnglès
RevistaACM Transactions on Multimedia Computing, Communications and Applications
DOIs
Estat de la publicacióPublicada - 2 de juny 2022

Fingerprint

Navegar pels temes de recerca de 'Meta-MMFNet: Meta-Learning Based Multi-Model Fusion Network for Micro-Expression Recognition'. Junts formen un fingerprint únic.

Com citar-ho