Driver cellphone usage detection using wavelet scattering and convolutional neural networks

[1] Y. Abouelnaga, Real-time distracted driver posture classification, in 32nd Conference on Neural Information Processing Systems (NIPS 2018), Workshop on Machine Learning for Intelligent Transportation Systems, 2017.

[2] S. Agrawal, A. M. Schuster, N. Britt, E. A. Mack, M. L. Tidwell, and S. R. Cotten, Building on the past to help prepare the workforce for the future with automated vehicles: A systematic review of automated passenger vehicle deployment timelines, Technology in Society, 72 (2023), p. 102186.

[3] M. Andreux, T. Angles, G. Exarchakis, R. Leonarduzzi, G. Rochette, L. Thiry, J. Zarka, S. Mallat, J. Anden, E. Belilovsky, J. Bruna, V. Lostanlen, M. Chaudhary, M. J. Hirn, E. Oy- ´ allon, S. Zhang, C. Cella, and M. Eickenberg, Kymatio: Scattering transforms in python, Journal of Machine Learning Research, 21 (2020), pp. 1–6.

[4] B. Baheti, S. Gajre, and S. Talbar, Detection of distracted driver using convolutional neural network, in IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2018, pp. 1145– 1151.

[5] A. B. Balbinot, M. A. Zaro, and M. I. Timm, Fun¸c˜oes psicol´ogicas e cognitivas presentes no ato de dirigir e sua importˆancia para os motoristas no trˆansito, Ciˆencias & Cogni¸c˜ao, 16 (2011), pp. 13–29.

[6] R. Berri, F. Osorio, R. Parpinelli, and A. Silva ´ , A hybrid vision system for detecting use of mobile phones while driving, in 2016 International Joint Conference on Neural Networks (IJCNN), 2016, pp. 4601– 4610.

[7] S. Box, Transportation institute releases findings on driver behavior and crash factors. https://vtechworks. lib.vt.edu/bitstream/handle/10919/59404/2006-237.html, 2006. Last accessed 2022/11/23.

[8] D. J. Carragher, A. Towler, V. R. Mileva, D. White, and P. J. B. Hancock, Masked face identification is improved by diagnostic feature training, Cognitive Research: Principles and Implications, 7 (2022), pp. 1–12.

[9] F. Chollet, Xception: Deep learning with depthwise separable convolutions, in Proceedings - 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR, Honolulu, HI, USA, 2016, Institute of Electrical and Electronics Engineers Inc, pp. 1800–1807.

[10] J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, Imagenet: A large-scale hierarchical image database, in 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 248–255.

[11] S. Ebrahimian, A. Nahvi, M. Tashakori, H. Salmanzadeh, O. Mohseni, and T. Leppanen ¨ , Multilevel classification of driver drowsiness by simultaneous analysis of ecg and respiration signal networks, International Journal of Environmental Research and Public Health, 19 (2022).

[12] A. Eckert, A. Hohm, and S. Lueke, An integrated adas solution for pedestrian collision avoidance, in Proceedings of the 23rd International Conference on the Enhanced Safety of Vehicles, Seoul, Republic of Korea, 2013, pp. 13–298.

[13] Y. Elqattan, M. N. Moustafa, and M. H. El-Shafey, System for detecting and reporting cell phone distracted drivers, in 11th International Symposium on Image and Signal Processing and Analysis (ISPA), Dubrovnik, Croatia, 2019, IEEE, pp. 215–221.

[14] H. M. Eraqi, Y. Abouelnaga, M. H. Saad, and M. N. Moustafa, Driver distraction identification with an ensemble of convolutional neural networks, Journal of advanced transportation, 2019 (2019), p. 4125865.

[15] Franc¸ois Chollet, Keras. https://github.com/fchollet/keras, 2022. Last accessed 2022/12/19.

[16] Free Report: National Safety Council, Understanding the distracted brain, April 2012. WHY DRIVING WHILE USING HANDS-FREE CELL PHONES IS RISKY BEHAVIOR.

[17] C. Groger ¨ , There is no ai without data, Commun. ACM, 64 (2021), pp. 98–108.

[18] D. Gruyer, S. Choi, C. Boussard, and B. d’Andrea Novel ´ , From virtual to reality, how to prototype, test and evaluate new adas: Application to automatic car parking, in 2014 IEEE Intelligent Vehicles Symposium Proceedings, 2014, pp. 261–267.

[19] S. Hakak, T. R. Gadekallu, P. K. R. Maddikunta, S. P. Ramu, P. M, C. De Alwis, and M. Liyan[1]age, Autonomous vehicles in 5g and beyond: A survey, Vehicular Communications, 39 (2023), p. 100551.

[20] A. He, G. Chen, W. Zheng, Z. Ni, Q. Zhang, and Z. Zhu, Driver cell-phone use detection based on cornernet-lite network, in IOP Conference Series: Earth and Environmental Science, vol. 632, IOP Publishing Ltd, 2021.

[21] K. He, X. Zhang, S. Ren, and J. Sun, Deep residual learning for image recognition, in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 770–778.

[22] V. Ilkova and A. Ilka ´ , Legal aspects of autonomous vehicles — an overview, in 2017 21st International Conference on Process Control (PC), 2017, pp. 428–433.

[23] I. Isaksson-Hellman and M. Lindman, Real-world evaluation of driver assistance systems for vulnerable road users based on insurance crash data in sweden, in 26th International Technical Conference on the Enhanced Safety of Vehicles (ESV): Enabling a Safer Tomorrow, NHTSA Washington, DC, 2019.

[24] P. Lassmann, M. S. Fischer, H.-J. Bieg, M. Jenke, F. Reichelt, G.-J. Tuezuen, and T. Maier, Keeping the balance between overload and underload during partly automated driving: relevant secondary tasks, in Automatisiertes Fahren 2019, T. Bertram, ed., Springer Fachmedien Wiesbaden, Wiesbaden, 2020, pp. 233– 250.

[25] T. H. N. Le, Y. Zheng, C. Zhu, K. Luu, and M. Savvides, Multiple scale faster-rcnn approach to driver’s cell-phone usage and hands on steering wheel detection, in 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2016, pp. 46–53.

[26] S. Manimala and C. Kumar, Anticipating hand and facial features of human body using golden ratio, International Journal of Graphics & Image Processing (IJGIP), 4 (2014), p. 15.

[27] A. Montoya, D. Holman, SF-Data-Science, T. Smith, and W. Kan, State farm distracted driver detection. https://kaggle.com/competitions/state-farm-distracted-driver-detection, 2016. Last accessed 2022/12/17.

[28] I. Morawski, Y.-A. Chen, Y.-S. Lin, and W. H. Hsu, Nod: Taking a closer look at detection under extreme low-light conditions with night object detection dataset, 2021.

[29] R. Mukherjee, M. Bessa, P. Melo-Pinto, and A. Chalmers, Object detection under challenging lighting conditions using high dynamic range imagery, IEEE Access, 9 (2021), pp. 77771–77783.

[30] E. Oyallon, S. Mallat, and L. Sifre, Generic deep networks with wavelet scattering, in International Conference on Learning Representations (ICLR), 2014.

[31] M. Peissner, V. Doebler, and F. Metze, Can voice interaction help reducing the level of distraction and prevent accidents?, tech. rep., Fraunhofer IAO, 2011.

[32] PyTorch documentation, Illustration of transforms – torchvision main documentation. https: //pytorch.org/vision/main/auto_examples/transforms/plot_transforms_illustrations.html# sphx-glr-auto-examples-transforms-plot-transforms-illustrations-py, 2022. Last accessed 2022/10/30.

[33] H. Qiu, D. Gong, Z. Li, W. Liu, and D. Tao, End2end occluded face recognition by masking corrupted features, IEEE Transactions on Pattern Analysis and Machine Intelligence, 44 (2022), pp. 6939–6952.

[34] P. Rajput, S. Nag, and S. Mittal, Detecting usage of mobile phones using deep learning technique, in Proceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good, GoodTechs ’20, New York, NY, USA, 2020, Association for Computing Machinery, pp. 96–101.

[35] J. Redmon and A. Farhadi, Yolov3: An incremental improvement, 2018.

[36] M. Regan, T. Victor, J. Lee, and K. Young, Driver distraction injury prevention countermeasures—part 3: vehicle, technology, and road design, in Driver Distraction: Theory, Effects, and Mitigation, CRC Press, 2009, pp. 579–601.

[37] J. M. Rodr´ıguez-Ascariz, L. Boquete, J. Cantos, and S. Ortega, Automatic system for detecting driver use of mobile phones, Transportation Research Part C: Emerging Technologies, 19 (2011), pp. 673–681.

[38] T. U. Saeed, Road infrastructure readiness for autonomous vehicles, PhD thesis, Purdue University, 2019.

[39] V. Saini and R. Saini, Driver drowsiness detection system and techniques: A review, International Journal of Computer Science and Information Technologies, 5 (2014), pp. 4245–4249.

[40] A. Salvador, A culpa foi do celular, Revista Veja, 21 (2011), p. 2011.

[41] K. Sandeep, P. Ravikumar, and S. Ranjith, Novel drunken driving detection and prevention models using internet of things, in 2017 International Conference on Recent Trends in Electrical, Electronics and Computing Technologies (ICRTEECT), 2017, pp. 145–149.

[42] K. Seshadri, F. Juefei-Xu, D. K. Pal, M. Savvides, and C. P. Thor, Driver cell phone usage detection on strategic highway research program (shrp2) face view videos, in 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2015, pp. 35–43.

[43] X. Shi, S. Shan, M. Kan, S. Wu, and X. Chen, Real-time rotation-invariant face detection with progressive calibration networks, in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2018, pp. 2295–2303.

[44] K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, Computational and Biological Learning Society, 2015, pp. 1–14.

[45] A. Stevens and R. Minton, In-vehicle distraction and fatal accidents in england and wales, Accident Analysis & Prevention, 33 (2001), pp. 539–545.

[46] J. P. Stimpson, Fatalities of pedestrians, bicycle riders, and motorists due to distracted driving motor vehicle crashes in the u.s., 2005–2010, Public Health Reports, 128 (2013), pp. 436–442.

[47] H. B. Sundfør, F. Sagberg, and A. Høye, Inattention and distraction in fatal road crashes–results from in-depth crash investigations in norway, Accident Analysis & Prevention, 125 (2019), pp. 152–157.

[48] P. Taunk, G. Jayasri, J. Priya, and N. S. Kumar, Face detection using viola jones with haar cascade, Test Engineering and Management, 83 (2020), pp. 19146–19149.

[49] R. Torres, O. Ohashi, E. Carvalho, and G. Pessin, A deep learning approach to detect distracted drivers using a mobile phone, in Artificial Neural Networks and Machine Learning – ICANN 2017, Bel´em, PA, Brazil, 2017, Springer Science, Springer International Publishing, pp. 72–79.

[50] A. Validi, T. Ludwig, A. Hussein, and C. Olaverri-Monreal, Examining the impact on road safety of different penetration rates of vehicle-to-vehicle communication and adaptive cruise control, IEEE Intelligent Transportation Systems Magazine, 10 (2018), pp. 24–34.

[51] B. Wagner, F. Taffner, S. Karaca, and L. Karge, Vision based detection of driver cell phone usage and food consumption, IEEE Transactions on Intelligent Transportation Systems, 23 (2022), pp. 4257–4266.

[52] Q. Xiong, J. Lin, W. Yue, S. Liu, Y. Liu, and C. Ding, A deep learning approach to driver distraction detection of using mobile phone, in 2019 IEEE Vehicle Power and Propulsion Conference (VPPC), 2019, pp. 1–5.

[53] B. Xu and R. P. Loce, A machine learning approach for detecting cell phone usage, in Video Surveillance and Transportation Imaging Applications 2015, R. P. Loce and E. Saber, eds., vol. 9407, International Society for Optics and Photonics, SPIE, 2015, p. 94070A.

[54] B. Xu, P. Paul, Y. Artan, and F. Perronnin, A machine learning approach to vehicle occupancy detection, in 17th IEEE International Conference on Intelligent Transportation Systems (ITSC), Qingdao, China, 2014, Institute of Electrical and Electronics Engineers Inc, pp. 1232–1237.

[55] J. Yang, S. Sidhom, G. Chandrasekaran, T. Vu, H. Liu, N. Cecan, Y. Chen, M. Gruteser, and R. P. Martin, Detecting driver phone use leveraging car speakers, in Proceedings of the 17th Annual International Conference on Mobile Computing and Networking, MobiCom ’11, New York, NY, USA, 2011, Association for Computing Machinery, pp. 97–108.

[56] H. Yasar, Detection of driver’s mobile phone usage, in 2017 IEEE 9th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management (HNICEM), 2017, pp. 1–4.

[57] Y. Zhang, C. Fu, and S. Cheng, Exploring driver injury severity at intersection: An ordered probit analysis, Advances in Mechanical Engineering, 7 (2015), p. 567124.

[58] R. Zhou, Y. Zhang, and Y. Shi, Driver’s distracted behavior: The contribution of compensatory beliefs increases with higher perceived risk, International Journal of Industrial Ergonomics, 80 (2020), p. 103009.