Fatigue Driving Detection Method Based on IPPG Technology

Authors

  • Jiuju Bi Hubei Key Laboratory of Advanced Technology of Automotive Components, Wuhan University of Technology
  • Xunpeng Qin Hubei Key Laboratory of Advanced Technology of Automotive Components, Wuhan University of Technology
  • Dongjin Hu Hubei Key Laboratory of Advanced Technology of Automotive Components, Wuhan University of Technology
  • Chenyang Xu Hubei Key Laboratory of Advanced Technology of Automotive Components, Wuhan University of Technology

DOI:

https://doi.org/10.7307/ptt.v35i4.134

Keywords:

vehicle safety system, active safety system, intelligent vehicle, fatigue detection, imaging photoplethysmography

Abstract

Physiological signal index can accurately reflect the degree of fatigue, but the contact detection method will greatly affect the driver's driving. This paper presents a non-contact method for detecting tired driving. It uses cameras and other devices to collect information about the driver's face. By recording facial changes over a period and processing the captured video, pulse waves are extracted. Then the frequency domain index and nonlinear index of heart rate variability were extracted by pulse wave characteristics. Finally, the experiment proves that the method can clearly judge whether the driver is tired. In this study, the Imaging Photoplethysmography (IPPG) technology was used to realise non-contact driver fatigue detection. Compared with the non-contact detection method through identifying drivers' blinking and yawning, the physiological signal adopted in this paper is more convincing. Compared with other methods that detect physiological signals to judge driver fatigue, the method in this paper has the advantages of being non-contact, fast, convenient and available for the cockpit environment.

References

Mao Zhe. Research on recognition method of motor vehicle fatigue driving behavior. PhD Thesis. Wuhan University of Technology, China; 2009. DOI: 10.7666/d.y1653097.

Shen KQ, Li XP, Ong CJ, et al. EEG-based mental fatigue measurement using multi-class support vector machines with confidence estimate. Clinical Neurophysiology. 2008;119(7):1524-1533. DOI: 10.1016/j.clinph.2008.03.012.

Hostens I, Ramon H. Assessment of muscle fatigue in low level monotonous task performance during car driving. Journal of Electromyography and Kinesiology. 2005;15(3):266-274. DOI: 10.1016/j.jelekin.2004.08.002.

Calcagnini G, et al. Spectral analysis of heart rate variability signal during sleep stages. Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol. 2. 1994. DOI: 10.1109/IEMBS.1994.415418.

Ohsuga M, et al. Classification of blink waveforms toward the assessment of driver’s arousal levels-an EOG approach and the correlation with physiological measures. Engineering Psychology and Cognitive Ergonomics: 7th International Conference, EPCE 2007, Held as Part of HCI International 2007, Beijing, China, July 22-27, 2007. Proceedings 7. 2007. DOI: 10.1007/978-3-540-73331-7_86.

Lal SKL, Craig A. Electroencephalography activity associated with driver fatigue: Implications for a fatigue countermeasure device. Journal of Psychophysiology. 2001;15(3):183. DOI: 10.1027/0269-8803.15.3.183.

Lal SKL, et al. Development of an algorithm for an EEG-based driver fatigue countermeasure. Journal of safety Research. 2003;34(3):321-328. DOI: 10.1016/S0022-4375(03)00027-6.

Ulyanov SS, Tuchin VV. Pulse-wave monitoring by means of focused laser beams scattered by skin surface and membranes. Static and Dynamic Light Scattering in Medicine and Biology. 1993;1884:160-167. DOI: 10.1117/12.148363.

Greneker EF. Radar sensing of heartbeat and respiration at a distance with applications of the technology. Radar 97 (Conf. Publ. No. 449). 1997. p. 150-154. DOI: 10.1049/cp:19971650.

Hafner N, Drazen JC, Lubecke VM. Fish heart rate monitoring by body-contact Doppler radar. IEEE Sensors Journal. 2012;13(1):408-414. DOI: 10.1109/JSEN.2012.2210400.

Rabben SI, et al. An ultrasound-based method for determining pulse wave velocity in superficial arteries. Journal of Biomechanics. 2004;37(10):1615-1622. DOI: 10.1016/j.jbiomech.2003.12.031.

Garbey M, et al. Contact-free measurement of cardiac pulse based on the analysis of thermal imagery. IEEE Transactions on Biomedical Engineering. 2007;54(8):1418-1426. DOI: 10.1109/TBME.2007.891930.

Fei J, Pavlidis I. Thermistor at a distance: Unobtrusive measurement of breathing. IEEE Transactions on Biomedical Engineering. 2009;57(4):988-998. DOI: 10.1109/TBME.2009.2032415.

Torres JCC, Abderrahim M. Measuring heart and breath rates by image photoplethysmography using wavelets technique. IEEE Latin America Transactions. 2017;15(10):1864-1868. DOI: 10.1109/TLA.2017.8071228.

Hertzman AB. The blood supply of various skin areas as estimated by the photoelectric plethysmograph. American Journal of Physiology-Legacy Content. 1938;124(2):328-340. DOI: 10.1152/ajplegacy.1938.124.2.328.

Sinex JE. Pulse oximetry: Principles and limitations. The American Journal of Emergency Medicine. 1999;17(1):59-66. DOI: 10.1016/S0735-6757(99)90019-0.

Wei B, Zhang C, Wu X. Comprehensive comparison study on different ICA/BSS methods in IPPG techniques for obtaining high-quality BVP signal. Proceedings of the 2016 International Conference on Intelligent Information Processing. 2016. p. 1-6. DOI: 10.1145/3028842.3028890.

Li S, Guo H, Li D. Vibration signal processing method review. Journal of Instruments and Meters. 2013;(8):1907-1915. DOI: 10.19650/j.cnki.cjsi.2013.08.031.

Yang Z, Li Y, Hu D. Review of independent component analysis methods. Acta Automatica Sinica. 2002;(05):762-772. DOI: 10.16383/j.aas.2002.05.012.

James CJ, Hesse CW. Independent component analysis for biomedical signals. Physiological Measurement. 2004;26(1):R15. DOI: 10.1088/0967-3334/26/1/R02.

Hyvarinen A. Fast and robust fixed-point algorithms for independent component analysis. IEEE Transactions on Neural Networks. 1999;10(3):626-634. DOI: 10.1109/72.761722.

Pinheiro N, et al. Can PPG be used for HRV analysis?. 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). 2016. p. 2945-2949. DOI: 10.1109/EMBC.2016.7591347.

Heart rate variability: Standards of measurement, physiological interpretation, and clinical use. Circulation. 1996;93(5):1043-1065. DOI: 10.1161/01.CIR.93.5.1043.

Shaffer F, Ginsberg JP. An overview of heart rate variability metrics and norms. Frontiers in Public Health. 2017;5:258. DOI: 10.3389/fpubh.2017.00258.

De Godoy MF. Nonlinear analysis of heart rate variability: A comprehensive review. Journal of Cardiology and Therapy. 2016;3(3):528-533. DOI: 10.17554/j.issn.2309-6861.2016.03.101-4.

Tarvainen MP, et al. Kubios HRV–heart rate variability analysis software. Computer Methods and Programs in Biomedicine. 2014;113(1):210-220. DOI: 10.1016/j.cmpb.2013.07.024.

Brennan M, Palaniswami M, Kamen P. Do existing measures of Poincare plot geometry reflect nonlinear features of heart rate variability?. IEEE Transactions on Biomedical Engineering. 2001;48(11):1342-1347. DOI: 10.1109/10.959330.

Xu C. Design of a pulse wave based mental fatigue detection system. PhD Thesis. Chongqing University of Technology, China; 2021. DOI: 10.27753/d.cnki.gcqgx.2021.000833.

Wang CY, et al. Fatigue detection system based on indirect-contact ECG measurement. 2016 International Conference on Advanced Robotics and Intelligent Systems (ARIS). 2016. DOI: 10.1109/ARIS.2016.7886623.

Zeng C, et al. Sex differences in time-domain and frequency-domain heart rate variability measures of fatigued drivers. International Journal of Environmental Research and Public Health. 2020;17(22):8499. DOI: 10.3390/ijerph17228499.

Mourot L, et al. Quantitative Poincare plot analysis of heart rate variability: Effect of endurance training. European Journal of Applied Physiology. 2004;91(1):79-87. DOI: 10.1007/s00421-003-0917-0.

Downloads

Published

31-08-2023

How to Cite

Bi, J., Qin, X., Hu, D., & Xu, C. (2023). Fatigue Driving Detection Method Based on IPPG Technology. Promet - Traffic&Transportation, 35(4), 540–551. https://doi.org/10.7307/ptt.v35i4.134

Issue

Section

Articles