Skip to content

A Github repository about micro-expression recognition, micro-expression detection, and micro-expression analysis

Notifications You must be signed in to change notification settings

Vision-Intelligence-and-Robots-Group/awesome-micro-expression-recognition

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

42 Commits
 
 

Repository files navigation

Awesome Micro-Expression Recognition

A Github repository and collection of documents, papers, source code, and talks for Micro-Expression Recognition.

Keywords: Micro-expression Recognition, Micro-expression Detection, Micro-expression analysis

CATALOGUE

1 Survey

1.1 Surveys

  • Understanding Deep Learning Techniques for Recognition of Human Emotions Using Facial Expressions: A Comprehensive Survey (IEEE Transactions on Instrumentation and Measurement 23) [paper]
  • Facial Micro-Expressions: An Overview (Proceedings of the IEEE 23) [paper]
  • Unlocking the Emotional World of Visual Media: An Overview of the Science, Research, and Impact of Understanding Emotion (IEEE Proceedings 23) [paper]
  • An overview of facial micro-expression analysis: Data, methodology and challenge. (TAFFC 22) [paper]
  • An overview of research development of affective computing and understanding. (JIG 22, most in Chinese) [paper]
  • Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms. (TPAMI 21) [paper]
  • Review of automatic microexpression recognition in the past decade. (Machine Learning and Knowledge Extraction 21)[paper]
  • Deep Learning for Micro-expression Recognition: A Survey. (arXiv 21) [paper]
  • A survey of micro-expression recognition. (IVC 21) [paper]
  • Review of micro-expression spotting and recognition in video sequences. (Virtual Reality & Intelligent Hardware 21) [paper]
  • Micro-expression recognition: an updated review of current trends, challenges and solutions. (The Visual Computer 20) [paper]
  • A survey: facial micro-expression recognition. (MTA 18) [paper]
  • A Survey of Automatic Facial Micro-Expression Analysis: Databases, Methods, and Challenges. (Frontiers in Psychology 18) [paper]

1.2 Analysis & Study

  • Data Leakage and Evaluation Issues in Micro-Expression Analysis (TAC 24) [paper]
  • Integrating VideoMAE based model and Optical Flow for Micro- and Macro-expression Spotting (ACM MM 23) [paper]
  • Deep Learning Pipeline for Spotting Macro- and Micro-expressions in Long Video Sequences Based on Action Units and Optical Flow (Pattern Recognition Letters 23) [paper]
  • Temporal Augmented Contrastive Learning for Micro-Expression Recognition (Pattern Recognition Letters 23) [paper]
  • Temporal-Informative Adapters in VideoMAE V2 and Multi-Scale Feature Fusion for Micro-Expression Spotting-then-Recognize (ACM MM 24) [paper]
  • Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-expression Spotting and Recognition Methods (TAFFC 18) [paper]
  • Micro-expression spotting: A new benchmark (Neurocomputing 21) [paper]
  • Cross-Database Micro-Expression Recognition: A Benchmark (TKDE 21) [paper]

1.3 Datasets

  • [DFME] DFME: A New Benchmark for Dynamic Facial Micro-Expression Recognition (TAC 24) [paper]
  • [SMG] SMG: A Micro-gesture Dataset Towards Spontaneous Body Gestures for Emotional Stress State Analysis (IJCV 23) [paper]
  • [CAS(ME)^3] CAS(ME)^3: A Third Generation Facial Spontaneous Micro-Expression Database with Depth Information and High Ecological Validity (TPAMI 22) [paper] [link]
  • [4DME] 4DME: A Spontaneous 4D Micro-Expression Dataset With Multimodalities (TAFFC 22) [paper]
  • [MMEW] Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms (TPAMI 21) [paper]
  • [SAMM-LV] Samm long videos: A spontaneous facial micro-and macro-expressions dataset. (FG 20) [paper]
  • [SAMM] SAMM: A Spontaneous Micro-Facial Movement Dataset (TAFFC 18) [paper] [link]
  • [CAS(ME)^2] CAS(ME)^2: A database for spontaneous macro-expression and micro-expression spotting and recognition (TAFFC 18) [paper] [link]
  • [CASME2] CASME II: An improved spontaneous micro-expression database and the baseline evaluation (PLoS ONE) [paper] [link]
  • [MEVIEW] Spotting facial micro-expressions “In the Wild” (CVWW 17) [paper] [Link]
  • [CASME] CASME database: a dataset of spontaneous micro-expressions collected from neutralized faces (FG 13) [paper] [link]
  • [SMIC] A spontaneous micro facial expression database: inducement, collection and baseline (FG 13) [paper] [link]

1.4 FME/MEGC report

  • [FME] FME '23: 3rd Facial Micro-Expression Workshop (ACM MM 23) [paper]
  • [MEGC23] MEGC2023: ACM Multimedia 2023 Micro-Expression Grand Challenge (MM 23) [paper]
  • [FME] 1st Workshop on Facial Micro-Expression: Advanced Techniques for Facial Expressions Generation and Spotting (MM 21) [paper]
  • [MEGC20] The Third Facial Micro-Expression Grand Challenge (FG 20) [paper]
  • [MEGC19] The Second Facial Micro-Expressions Grand Challenge (FG 19) [paper]
  • [MEGC18] Facial micro-expressions grand challenge 2018 summary (FG 18) [paper]

1.5 Psychological Foudations

  • Ekman P, Friesen W V. (1969). Nonverbal leakage and clues to deception. Psychiatry, 32(1): 88-106. [paper]
  • Rinn, W.E., (1984). The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expressions. Psychological bulletin, 95(1), p.52. [paper]
  • P. Ekman, (2003). Darwin, deception, and facial expression, Annals of the New York Academy of Sciences, vol. 1000, no. 1, pp. 205–221. [paper]
  • Haggard, E., and Isaacs, K. (1966). Micromomentary facial expressions as indicators of ego mechanisms in psychotherapy, in Methods of Research in Psychotherapy, eds L. A. Gottschalk and A. H. Auerbach (New York, NY: Appleton-Century-Crofts, 154–165. [paper]

1.6 Talk

  • CSIG Lecture Series [link] (Chinese)
  • Intelligent Emotion Perception and Emotional Interface (Zhao Guoying ,Oulu University, Finland) [link] (Chinese)
  • Face-based Human Understanding: beyond Face Recognition (Han Hu, Hong Xiaopeng) [link] (Chinese)

2 Papers

2024

  • DFME: A New Benchmark for Dynamic Facial Micro-Expression Recognition (TAC 24) [paper]
  • Facial Prior Guided Micro-Expression Generation (TIP 24) [paper]
  • Temporal-Informative Adapters in VideoMAE V2 and Multi-Scale Feature Fusion for Micro-Expression Spotting-then-Recognize (ACM MM 24) [paper]
  • Data Leakage and Evaluation Issues in Micro-Expression Analysis (TAC 24) [paper]

2023

  • [Micron-BERT] Micron-BERT: BERT-Based Facial Micro-Expression Recognition (CVPR 23) [paper]
  • Feature Representation Learning with Adaptive Displacement Generation and Transformer Fusion for Micro-Expression Recognition (CVPR 23) [paper]
  • Integrating VideoMAE based model and Optical Flow for Micro- and Macro-expression Spotting (ACM MM 23) [paper]
  • Temporal Augmented Contrastive Learning for Micro-Expression Recognition (Pattern Recognition Letters 23) [paper]
  • AVES: An Audio-Visual Emotion Stream Dataset for Temporal Emotion Detection (TAC 23) [paper]
  • Facial Micro-Expressions: An Overview (Proceedings of the IEEE 23) [paper]
  • Deep Learning Pipeline for Spotting Macro- and Micro-expressions in Long Video Sequences Based on Action Units and Optical Flow (Pattern Recognition Letters 23) [paper]

2022

  • Short and Long Range Relation Based Spatio-Temporal Transformer for Micro-Expression Recognition (TAFFC) [paper]
  • [CAS(ME)^3] CAS(ME)^3: A Third Generation Facial Spontaneous Micro-Expression Database with Depth Information and High Ecological Validity (TPAMI 22) [paper]
  • A Sparse-Based Transformer Network with Associated Spatiotemporal Feature for Micro-Expression Recognition (SPL) [paper]
  • [4DME] 4DME: A Spontaneous 4D Micro-Expression Dataset With Multimodalities (TAFFC 22) [paper]
  • Facial Micro-Expression Recognition Based on Deep Local-Holistic Network (Applied Sciences) [paper]
  • Mimicking the Annotation Process for Recognizing the Micro Expressions (MM 22) [paper]
  • [MMNet] MMNet: Muscle motion-guided network for micro-expression recognition (IJCAI-22) [paper]
  • Objective Class-Based Micro-Expression Recognition Under Partial Occlusion Via Region-Inspired Relation Reasoning Network (TAC 22) [paper]

2021

  • [FME] 1st Workshop on Facial Micro-Expression: Advanced Techniques for Facial Expressions Generation and Spotting (MM 21) [paper]

  • Deep Learning for Micro-expression Recognition: A Survey (arXiv) [paper]

  • Review of Automatic Microexpression Recognition in the Past Decade (MAKE 21) [paper]

  • A survey of micro-expression recognition (IMAVIS 21) [paper]

  • [MMST] Micro-Expression Recognition Enhanced by Macro-Expression from Spatial-Temporal Domain (IJCAI 21) [paper]

  • [GEME] GEME: Dual-stream multi-task GEnder-based micro-expression recognition (Neurocomputing 21) [paper]

  • [FGM] Key Facial Components Guided Micro-Expression Recognition Based on First & Second-Order Motion (ICME 21) [paper]

  • [MRAU] Micro-Expression Recognition Based on Facial Graph Representation Learning and Facial Action Unit Fusion (CVPRW 21) [paper]

  • [GACN] Micro-Expression Classification Based on Landmark Relations With Graph Attention Convolutional Network (CVPR 21) [paper]

  • [MDMO] Sparse MDMO: Learning a Discriminative Feature for Micro-Expression Recognition (TAFFC 21) [paper]

  • [CDMB] Cross-Database Micro-Expression Recognition: A Benchmark (TKDE 21) [paper]

  • [CDCN] Cross-database Micro-Expression Recognition with Deep Convolutional Networks (TKDE 21) [paper]

  • [AUMC] Facial Action Unit Detection with Local Key Facial Sub-region based Multi-label Classification for Micro-expression Analysis (MM 21) [paper]

  • [LGA] Joint Local and Global Information Learning With Single Apex Frame Detection for Micro-Expression Recognition (TIP 21) [paper]

  • [MAOF] A magnitude and angle combined optical flow feature for micro-expression spotting (IEEE MultiMedia Mag) [paper]

  • [MSOF] Research on Micro-Expression Spotting Method Based on Optical Flow Features (MM 21) [paper]

  • [TDMS] Local Temporal Pattern and Data Augmentation for Micro-Expression Spotting (TAFFC 21) [paper]

  • [SCA] Micro-expression action unit detection with spatial and channel attention (Neurocomputing) [paper]

  • [MSNB] Micro-expression spotting: A new benchmark (Neurocomputing) [paper]

  • Video-based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms (TPAMI 21) [paper]

  • [MESNet] MESNet: A Convolutional Neural Network for Spotting Multi-Scale Micro-Expression Intervals in Long Videos (TIP) [paper]

  • Identity-free facial expression recognition using conditional generative adversarial network (ICIP 21) [paper]

2020

  • [MEGC] The Third Facial Micro-Expression Grand Challenge (FG 20) [paper]
  • [MMRF] Learning from Macro-expression: a Micro-expression Recognition Framework (MM 20) [paper]
  • [RIWM] Revealing the Invisible With Model and Data Shrinking for Composite-Database Micro-Expression Recognition (TIP 20) [paper]
  • Cross-database micro-expression recognition: A benchmark (TKDE 20) [paper]
  • [AU-GACN] Au-assisted graph attention convolutional network for micro-expression recognition (MM 20) [paper]
  • [ESGS] Evaluation of the spatio-temporal features and GAN for micro-expression recognition system (Journal of Signal Processing Systems) [paper]
  • [GSMR] A novel graph-tcn with a graph structured representation for micro-expression recognition (MM 20) [paper]
  • [FRCD] Automatic 4D Facial Expression Recognition via Collaborative Cross-domain Dynamic Image Network (arxiv) [paper]
  • [MER-GCN] MER-GCN: Micro-Expression Recognition Based on Relation Modeling with Graph Convolutional Networks (MIPR) [paper]
  • [Micro-attention] Micro-attention for micro-expression recognition (Neurocomputing) [paper]
  • [Dynamic] Dynamic Micro-Expression Recognition Using Knowledge Distillation (TAFFC) [paper]
  • [RCN] Revealing the Invisible With Model and Data Shrinking for Composite-Database Micro-Expression Recognition (TIP) [paper]
  • [ExprGAN] Exprgan: Facial expression editing with controllable expression intensity (Journal of Signal Processing Systems)[paper]
  • [EF-GAN] Cascade EF-GAN: Progressive Facial Expression Editing With Local Focuses (CVPR 20) [paper]
  • Au-assisted graph attention convolutional network for micro-expression recognition (MM 20) [paper]

2019

  • [MEGC19] The Second Facial Micro-Expressions Grand Challenge (FG 19) [paper]

  • [SRCN] Spatiotemporal recurrent convolutional networks for recognizing spontaneous micro-expressions (TMM 19) [paper]

  • [FHOF] Fuzzy Histogram of Optical Flow Orientations for Micro-Expression Recognition (TAFFC 19) [paper]

  • [DLBP] Discriminative Spatiotemporal Local Binary Pattern with Revisited Integral Projection for Spontaneous Facial Micro-Expression Recognition (TAFFC 19) [paper]

  • [OMRS] Off-ApexNet on Micro-Expression Recognition System (Signal Processing: Image Communication) [paper]

  • [CSRM] Characterizing Subtle Facial Movements via Riemannian Manifold (ACM Transactions on Multimedia Computing, Communications, and Applications) [paper][code]

  • [BREF] A boost in revealing subtle facial expressions: A consolidated eulerian framework (FG 19) [paper][code]

  • [AMA] Automatic Micro-Expression Analysis: Open Challenges (Frontiers in Psychology) [paper]

  • [DSSN] Dual-stream Shallow Networks for Facial Micro-expression Recognition (ICIV) [paper]

  • [CapsuleNet] CapsuleNet for microexpression recognition (FG) [paper]

  • [Dual-Inception] Dual-inception network for crossdatabase micro-expression recognition (FG) [paper]

  • [STSTNet] Shallow triple stream three-dimensional CNN (STSTNet) for micro-expression recognition (FG) [paper]

  • [EMR] A neural microexpression recognizer (FG) [paper]

  • [ATNET] A novel apex-time network for cross-dataset micro-expression recognition (ACII) [paper]

  • Analyzing and reducing the damage of dataset bias to face recognition with synthetic data (CVPR 19) [paper]

  • Spontaneous Facial Micro-Expression Recognition using 3D Spatiotemporal Convolutional Neural Networks (IJCNN) [paper] [Github]

2018

  • [MEGC18] Facial micro-expressions grand challenge 2018 summary (FG 18) [paper]

  • [MAG] [HIGO-TOP] Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-expression Spotting and Recognition Methods (TAFFC 18) [paper]

  • [HSTLBP-IP] Learning from hierarchical spatiotemporal descriptors for micro-expression recognition (TMM 18) [paper]

  • [DRCD] Domain regeneration for cross-database micro-expression recognition (TIP 18) [paper]

  • [CFD] Cfd: A collaborative feature difference method for spontaneous micro-expression spotting (ICIP 18) [paper]

  • [LVMM] Learning-based video motion magnification (ECCV 18) [paper]

  • [GLLE] Micro-expression motion magnification: Global lagrangian vs. local eulerian approaches (FG 18) [paper]

  • [SAMM] SAMM: A Spontaneous Micro-Facial Movement Dataset (TAFFC 18) [paper]

  • [CAS(ME)^2] CAS(ME)^2: A database for spontaneous macro-expression and micro-expression spotting and recognition (TAFFC 18) [paper]

  • [MSAF] Can Micro-Expression be Recognized Based on Single Apex Frame? (ICIP 18) [paper]

  • Micro-expression recognition with small sample size by transferring long-term convolutional neural network (Neurocomputing) paper

  • Joint pose and expression modeling for facial expression recognition (CVPR 18) [paper]

2017

  • [ICDM] Microexpression identification and categorization using a facial dynamics map (TAFFC 18) [paper]

  • [DMSF] A main directional maximal difference analysis for spotting facial movements from long-term videos (Neurocomputing) [paper]

  • [MEVIEW] Spotting facial micro-expressions “In the Wild” (CVWW 17) [paper]

2016

  • Micro-Expression Recognition with Expression-State Constrained Spatio-Temporal Feature Representations (MM 16) [paper]

  • [DFMR] Selective deep features for micro-expression recognition (ICPR 16) [paper]

  • [MDOF] A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition (TAFFC 16) [paper]

  • [CCLF] Capturing correlations of local features for image representation (Neurocomputing) [paper]

  • [LBP-TOP] LBP-TOP: a Tensor Unfolding Revisit (ACCV 16) [paper]

  • [SFMS] Spontaneous facial micro-expression analysis using spatiotemporal completed local quantized patterns (Neurocomputing) [paper]

2015

  • [MRCS] Micro-Expression Recognition Using Color Spaces (TIP 15) [paper]

  • Towards Reading Hidden Emotions: A Comparative Study of Spontaneous Micro-Expression Spotting and Recognition Methods (TAFFC 15) [paper]

  • [STLBP-IP] Facial micro-expression recognition using spatiotemporal local binary pattern with integral projection (ICCV 15) [paper]

  • [AFS] Automatic apex frame spotting in micro-expression database (ACPR 15) [paper]

  • [SIOF] Spatiotemporal integration of optical flow vectors for micro-expression detection (ACIVS 15) [paper]

2014

  • [QLBP] Quantifying micro-expressions with constraint local model and local binary pattern (ECCV 14) [paper]

  • [AFDA] Spotting rapid facial movements from videos using appearance-based feature difference analysis (ICPR 14) [paper]

  • [CRLV] A compact representation of visual speech data using latent variables (TPAMI 14) [paper]

  • [CASME2] CASME II: An improved spontaneous micro-expression database and the baseline evaluation (PLoS ONE) [paper]

2013

  • [CASME] CASME database: a dataset of spontaneous micro-expressions collected from neutralized faces (FG 13) [paper]

  • [SMIC] A spontaneous micro facial expression database: inducement, collection and baseline (FG 13) [paper]

2011

  • [RSFM] Recognising spontaneous facial micro-expressions (ICCV 11) [paper]

8 Contact Us

Should there be any concerns on this page, please don't hesitate to let us know via hongxiaopeng@ieee.org or xxx@126.com.

About

A Github repository about micro-expression recognition, micro-expression detection, and micro-expression analysis

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •