A Study on Tiredness Measurement using Computer Vision


In this paper, we studied tiredness measurement based on several different detection methods in real time. We know that the driver tiredness is one of the major causes of traffic accidents. So tiredness detection can play a vital role for preventing road accidents. By developing an automatic solution for alerting drivers of tiredness before an accident occurs, this could reduce the number of traffic accidents. The Haar-cascade classifier is exploited based on Haar-like features to find the eyes. The main purpose of the Haar-cascade classifier is to classify closed or open state of the eyes. If we can notice that the eyes are closed for a predefined span of time, we consider the state of the eyes can be closed. Based on this closed-state of the eye, a notification (like alarm) is initiated to alert. We have detected only right eye for saving processing load on the system. The reason is that when a person closes his eyes he usually does not close one eye, but both eyes at the same time. Several steps are taken into account for this system; we first capture the frame from the webcam. Then we need to detect face as well as eye. To detect blinks, we process ROI (region of image) of pupil area. Our result is found to be satisfactory.

Author Biography

Md Atiqur Rahman Ahad, University of Dhaka
<p><strong>Md. Atiqur Rahman Ahad, PhD, Senior Member IEEE,</strong></p><p><em>Associate Professor,</em></p><p>Dept. of Electrical and Electronic Engineering,</p><p>University of Dhaka, Bangladesh</p>


Q. Wang, J. Yang, M. Ren, and Y. Zheng, “Driver tiredness detection: A survey ”, Proc. 6th World Congress on Intelligent Control and Automation (WCICA), vol. 2, pp. 8587-8591, 2006.

W. Horng, C. Chen, Y. Chang, and C.H. Fan., “Driver tiredness detection based on eye tracking and dynamic template matching”, Proc. of the IEEE International Conference on Networking, Sensing & Control, pp. 7-12, 2004.

Md Atiqur Rahman Ahad, Computer Vision and Action Recognition: A Guide for Image Processing and Computer Vision Community for Action Understanding, ISBN: 978-94-91216-20-6, Springer, 2011.

Md Atiqur Rahman Ahad, Motion History Images for Action Recognition and Understanding, ISBN: 978-1-4471-4730-5, Springer, 2012.

Z. Zhang and J. Zhang, “A new real-time eye tracking based on nonlinear unscented Kalman filter for monitoring driver tiredness”, Journal of Control Theory and Applications, 8(2), pp. 181-188, 2010. DOI 10.1007/s11768-010-8043-0

Md. Talal Bin Noman and Md Atiqur Rahman Ahad, “Mobile-based Eye-Blink Detection Performance Analysis on Android Platform”, Frontiers ICT - Human-Media Interaction, 5(4), 2018. DOI: 10.3389/fict.2018.00004

U.H. Syeda, Ziaul Zafar, Zishan Zahidul Islam, Syed Mahir Tazwar, Miftahul Jannat Rasna, Koichi Kise, and Md Atiqur Rahman Ahad, “Visual face scanning and emotion perception analysis between Autistic and Typically Developing children”, ACM UbiComp Workshop on Mental Health and Well-being: Sensing and Intervention, Hawaii, USA, 2017.

M.K. Galab, H.M. Abdalkader, and H.H. Zayed, “Adaptive Real Time Eye-Blink Detection System”, International Journal of Computer Applications, 99(5), pp. 29-36, 2014.

Nafis Irtija, Mahsius Sami, and Md Atiqur Rahman Ahad, “Fatigue Detection Using Facial Landmarks”, 4th Int. Symposium on Affective Science and Engineering, and the 29th Modern Artificial Intelligence and Cognitive Science Conference (ISASE-MAICS), 2018.

MehmetTurkan,MontsePardas,A.EnisCetin,“Humaneye localization using edge projections”, Proc. of 2nd International Conference on Computer Vision Theory and Applications, 2007.

J. Wisniewska, M. Rezaei, and R. Klette, “Robust Eye Gaze Estimation”, Computer Vision and Graphics, vol. 2, pp. 8587-859, 2006.

Y. Nishina, Md. Atiqur Rahman Ahad, JK Tan, H Kim and S Ishikawa, “A Robust Face Tracking Method Employing Color-based Particle Filter”, Int. J. of Biomedical Soft Computing and Human Sciences, Vol. 16, No. 1, pp. 127-134, 2010.

F.P.Mahdi,M.M.Habib,MdAtiqurRahmanAhad,S.Mckeever, ASM Moslehuddin, and P. Vasant, “Face Recognition-based Real Time System for Surveillance”, Intelligent Decision Technologies, IOS Press, 11(1), pp. 79-92, 2017.

Michael Chau and Margrit Betke, “Real Time Eye Tracking and Blink Detection with USB Cameras”, Computer Science Department, Boston University, Boston, MA 02215, USA.

Paul Viola and Michael J. Jones, “Robust Real-Time Face Detection”, Proc. of 18th International Conference on Computer Vision, 2, p. 747, 2001.

Tanmoy Paul, Ummul Afia Shammi, Mosabber Uddin Ahmed, Rashedur Rahman, Syoji Kobashi, and Md Atiqur Rahman Ahad, “A Study on Face Detection Using ViolaJones Algorithm in Various Backgrounds, Angles and Distances”, Biomedical Soft Computing and Human Sciences, 23(1), pp. 1-13, 2018.

Paul Viola and Michael J. Jones, “Robust Real-Time Face Detection”, Proc. of 18th International Conference on Computer Vision, 57(2), pp. 137-154, 2004.

C.H. Morimoto and M. Flickner, “Real time multiple face detection using active illumination”, 4th IEEE Int’l. Conf. on Automatic Face and Gesture Recognition (AFGR), pp. 8-13, 2000.

M. Betke, W. Mullally, and J. Magge, “Active detection of eye scleras in real time”, IEEE CVPR Workshop on Human Modeling, Analysis and Synthesis, 2000.

H.M. Elahi, D. Islam, I. Ahmed, S. Kobashi and M.A.R. Ahad, ‘Webcam-based Accurate Eye-central localization”, Proc. of 2nd International Conference on Robot, Vision and Signal Processing, Japan, pp. 47-50, 2013.

A.A. Mohammed and S.A. Anwar, “Efficient Eye Blink Detection Method for disabled helping domain”, International Journal of Advanced Computer Science and Applications, 5(5), pp. 202-206, 2014.

T. Morris, P. Blenkhron, and F. Zaidi, “Blink Detection for Real-Time Eye Tracking”, Journal of Network and Computer Applications, 25(22), pp. 129-143, 2002.

Zishan Zahidul Islam, Syed Mahir Tazwar, Md. Zahidul Islam, Seiichi Serikawa, and Md. Atiqur Rahman Ahad, “Automatic Fall Detection System of Unsupervised Elderly People Using Smartphone”, Proc. of 5th IIAE International Conference on Intelligent Systems and Image Processing, 2017.

Md. Atiqur Rahman Ahad, “Gait analysis: an energy image-based approach”, International Journal of Intelligent Computing in Medical Sciences Image Processing, Taylor & Francis, TSI Press, 5(1), pp. 81-91, 2013.

K.Grauman,M.Betke,J.Lombardi,J.Gips,andG.R.Bradski, “Communication via eye, blinks and eyebrow raises: Video-Based human-computer interfaces”, Universal Access Information Society, 2(4), pp. 359-373, 2003.

J.J. Magee, M.R. Scott, B.N. Waber, and M. Betke, “Eye-keys: A real-time vision interface based on gaze detection from a low grade video camera”, IEEE Workshop on Real-Time Vision for Human-Computer Interaction (RTV4HCI), 2004.

D.W.HansenandQ.Ji,“Intheeyeofthebeholder:Asurvey of models for eyes and gaze”, IEEE Trans. on PAMI, 32(3), pp. 478-500, 2010.

https://www.youtube.com/watch?v=p4KXAMKvy1E, (Accessed in June. 2017).

A. Frigerio, P. Cavallari, M. frigeri, “Surface Electromyo-graphic mapping of the orbicularis Oculi Muscle for Real-Time Blink Detection”, JAMA Facial Plast Surg, 16(5), pp. 335-342, 2014.

https://www.youtube.com/watch?v=2q9DarPET0o, (Accessed in June. 2017).

https://www.youtube.com/watch?v=gAAXTbv-J8E, (Accessed in June. 2017).

http://docs.opencv.org/2.4/doc/tutorials/ imgproc/threshold/threshold.html.

F. Baronti, F. Lenzi, R. Roncella, and R. Saletti, “Distributed sensor for steering wheel grip force measurement in driver tiredness detection”, Proc. of Conference on Design, Automation and Test in Europe, pp. 894-897, 2009.

T. Chieh, M. Mustafa, A. Hussain, E. Zahedi, and B. Majlis, “Driver tiredness detection using steering grip force”, IEEE Student Conference on Research and Development, pp. 45-48, 2003.

M. Devi and P. Bajaj, “Driver tiredness detection based on eye tracking”, Proc. of 1st International Conference on Emerging Trends in Engineering and Technology, pp. 649-652, 2008.

W. Wierwille, L. Ellsworth, S. Wreggit, R. Fairbanks, and C. Kirn, “Research on Vehicle-Based Driver Status/Performance Monitoring Development, Validation, and Refinement of Algorithms for Detection of Driver Drowsiness”, Technical Report: DOT HS 808 247, National Highway Traffic Safety Administration, USA, Dec. 1994.

How to Cite
Hussein, M. A., Noman, M. T. B., & Ahad, M. A. R. (2019). A Study on Tiredness Measurement using Computer Vision. Journal of the Institute of Industrial Applications Engineers, 7(4), 110. https://doi.org/10.12792/jiiae.7.110