Deep learning (neural network) based remote photoplethysmography: how to extract pulse signal from video using deep learning tools
Chen, Weixuan, and Daniel McDuff. "Deepphys: Video-based physiological measurement using convolutional attention networks." Proceedings of the European Conference on Computer Vision (ECCV). 2018.
Yu, Zitong, Xiaobai Li, and Guoying Zhao. "Remote photoplethysmograph signal measurement from facial videos using spatio-temporal networks." Proc. BMVC. 2019.
A custom YOLO network is used to crop the baby as a preprocessing step. This network was created based on this repo: https://github.com/eriklindernoren/PyTorch-YOLOv3
Our modified version: https://github.com/terbed/PyTorch-YOLOv3
The running speed of the networks are tested on NVIDIA Jetson Nano. Results and the installation steps of PyTorch
and OpenCV
are in the nano
folder.