RhythmMamba

RhythmMamba: Fast, Lightweight, and Accurate Remote Physiological Measurement [AAAI 2025]

🔧 Setup

STEP1: bash setup.sh

STEP2: conda activate RhythmMamba

STEP3: pip install -r requirements.txt

💻 Example of Using Pre-trained Models

Please use config files under ./configs/infer_configs

For example, if you want to run the pre-trained model for intra-dataset on MMPD, use python main.py --config_file ./configs/infer_configs/MMPD_RHYTHMMAMBA.yaml

💻 Examples of Neural Network Training

Please use config files under ./configs/train_configs

Intra-dataset on MMPD With RhythmMamba

STEP 1: Download the MMPD raw data by asking the paper authors

STEP 2: Modify ./configs/train_configs/intra/0MMPD_RHYTHMMAMBA.yaml

STEP 3: Run python main.py --config_file ./configs/train_configs/intra/0MMPD_RHYTHMMAMBA.yaml

Cross-dataset - Training on PURE and testing on UBFC-rPPG With RhythmMamba

STEP 1: Download the PURE raw data by asking the paper authors.

STEP 2: Download the UBFC-rPPG raw data via link

STEP 3: Modify ./configs/train_configs/cross/PURE_UBFC-rPPG_RHYTHMMAMBA.yaml

STEP 4: Run python main.py --config_file ./configs/train_configs/cross/PURE_UBFC-rPPG_RHYTHMMAMBA.yaml

✅ Todos

• Computational Cost: Code + Documentation

• Mamba-2: Update setup and support

• COHFACE: code + pretrained checkpoints

• VIPL-HR: code+ pretrained checkpoints

🎓 Acknowledgement

We would like to express sincere thanks to the authors of rPPG-Toolbox, Liu et al., 2023, building upon which, we developed this repo. For detailed usage related instructions, please refer the GitHub repo of the rPPG-Toolbox.

@article{liu2024rppg,
  title={rppg-toolbox: Deep remote ppg toolbox},
  author={Liu, Xin and Narayanswamy, Girish and Paruchuri, Akshay and Zhang, Xiaoyu and Tang, Jiankai and Zhang, Yuzhe and Sengupta, Roni and Patel, Shwetak and Wang, Yuntao and McDuff, Daniel},
  journal={Advances in Neural Information Processing Systems},
  volume={36},
  year={2024}
}

📜 Citation

If you find this repository helpful, please consider citing:

@article{zou2024rhythmmamba,
  title={Rhythmmamba: Fast remote physiological measurement with arbitrary length videos},
  author={Zou, Bochao and Guo, Zizheng and Hu, Xiaocheng and Ma, Huimin},
  journal={arXiv preprint arXiv:2404.06483},
  year={2024}
}