Gesture Control Revolution: Enhancing Automotive Infotainment through Advanced Hand Gesture Recognition

Authors

  • Ravindra Vijay Eshi Student, Department of E&TC, Sandip Foundation's, Sandip Institute of Technology & Research Centre, Nashik, Maharashtra, India
  • Gayatri Phade H.O.D, Department of E&TC, Sandip Foundation's, Sandip Institute of Technology & Research Centre, Nashik, Maharashtra, India
  • Sushant Pawar Assistant Professor, Department of E&TC, Sandip Foundation's, Sandip Institute of Technology & Research Centre, Nashik, Maharashtra, India

DOI:

https://doi.org/10.5281/zenodo.15118126

Keywords:

gesture, knn, cnn, deep learning

Abstract

In the ever-developing industry of automobiles, a focus should be made on the innovation of the car’s user experience while keeping the driver safe. The following paper therefore aims at proposing a new hand gesture recognition system to be implemented in car infotainment, which employs a modified CNN model enhanced with KNN for enhanced gesture mapping. The efficiency of the system was tested on a data of samples consisting of 10000 images of 10 different gestures performed by different users under different lighting conditions. The results obtained for the experimental evaluation proved that the used CNN reached the accuracy of 92,5% with the validation set and the further use of KNN for post-processing increased the classification accuracy up to 95,2%. Resource consumption was low, the CNN occupied roughly 50 MB of memory, that is why it is possible to use it for the in-vehicle system. A similar survey that targeted users showed that 85% of them were comfortable with the system as it was easy to learn and did not interfere with the control of infotainment functions. This research discusses the possibility of using gesture recognition technology to improve the user experience in vehicles making infotainment systems safer and more efficient.

Downloads

Download data is not yet available.

References

D’Eusanio, Andrea, et al. (2020). Multimodal hand gesture classification for the human–car interaction. Informatics, 7(3).

Wang, Yong, et al. (2022). Multi-hand gesture recognition using automotive FMCW radar sensor. Remote Sensing, 14(10), 2374.

Zheng, Lianqing, et al. (2021). Dynamic hand gesture recognition in in-vehicle environment based on FMCW radar and transformer. Sensors, 21(19), 6368.

Murali, Prajval Kumar, Mohsen Kaboli, & Ravinder Dahiya. (2022). Intelligent in‐vehicle interaction technologies. Advanced Intelligent Systems, 4(2), 2100122.

Benitez-Garcia, Gibran, et al. (2021). Improving real-time hand gesture recognition with semantic segmentation. Sensors, 21(2), 356.

Prabhakar, Gowdham, & Pradipta Biswas. (2021). A brief survey on interactive automotive UI. Transportation Engineering, 6, 100089.

Charissis, Vassilis, et al. (2021). Employing emerging technologies to develop and evaluate in-vehicle intelligent systems for driver support: infotainment AR HUD case study. Applied Sciences, 11(4), 1397.

Sarma, Debajit, & Manas Kamal Bhuyan. (2021). Methods, databases and recent advancement of vision-based hand gesture recognition for HCI systems: A review. SN Computer Science, 2(6), 436.

Lee, Sang Hun, & Se-One Yoon. (2020). User interface for in-vehicle systems with on-wheel finger spreading gestures and head-up displays. Journal of Computational Design and Engineering, 7(6), 700-721.

Bilius, Laura-Bianca, & Radu-Daniel Vatavu. (2020). A synopsis of input modalities for in-vehicle infotainment and consumption of interactive media. Proceedings of the 2020 ACM International Conference on Interactive Media Experiences.

Guo, Lin, Zongxing Lu, & Ligang Yao. (2021). Human-machine interaction sensing technology based on hand gesture recognition: A review. IEEE Transactions on Human-Machine Systems, 51(4), pp. 300-309.

Tan, Zhengyu, et al. (2021). Human–machine interaction in intelligent and connected vehicles: A review of status quo, issues, and opportunities. IEEE Transactions on Intelligent Transportation Systems, 23(9), 13954-13975.

Zhu, Yancong, et al. (2022). How post 90’s gesture interact with automobile skylight. International Journal of Human–Computer Interaction, 38(5), 395-405.

Alabdullah, Bayan Ibrahimm, et al. (2023). Smart home automation-based hand gesture recognition using feature fusion and recurrent neural network. Sensors, 23(17), 7523.

Reshma, S., & Chetanaprakash Chetanaprakash. (2020). Advancement in infotainment system in automotive sector with vehicular cloud network and current state of art. International Journal of Electrical and Computer Engineering, 10(2), 2077.

Downloads

Published

2025-03-29

How to Cite

Eshi, R. V., Phade, G., & Pawar, S. (2025). Gesture Control Revolution: Enhancing Automotive Infotainment through Advanced Hand Gesture Recognition. Applied Science and Engineering Journal for Advanced Research, 4(2), 15–21. https://doi.org/10.5281/zenodo.15118126

Issue

Vol. 4 No. 2 (2025): March Issue

Section

Articles

ARK

https://n2t.net/ark:/88926/ASEJAR.v4i2.137

License

Copyright (c) 2025 Ravindra Vijay Eshi, Gayatri Phade, Sushant Pawar

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Research Articles in 'Applied Science and Engineering Journal for Advanced Research' are Open Access articles published under the Creative Commons CC BY License Creative Commons Attribution 4.0 International License http://creativecommons.org/licenses/by/4.0/. This license allows you to share – copy and redistribute the material in any medium or format. Adapt – remix, transform, and build upon the material for any purpose, even commercially.