A Comprehensive Review on Gesture-Controlled Smart Home Systems for Elderly and Disabled Individuals

Authors

  • Pradeep Rao KB Dept. of CSE, SDM Institute of Technology, Ujire-574240, India
  • Sharanabasava Biradar Dept. of CSE, SDM Institute of Technology, Ujire-574240, India
  • Shreyas Devadiga Dept. of CSE, SDM Institute of Technology, Ujire-574240, India
  • Vishal T Dalabanjan Dept. of CSE, SDM Institute of Technology, Ujire-574240, India
  • Vijay MM Dept. of CSE, SDM Institute of Technology, Ujire-574240, India

DOI:

https://doi.org/10.26438/ijcse/v13i9.1622

Keywords:

Gesture recognition, Home automation, Elderly and disabled, Deep learning

Abstract

The increasing global population of elderly and physically disabled individuals has highlighted the urgent need for accessible and inclusive smart home technologies. Gesture-controlled systems offer a promising, non-verbal interface for home automation, enabling greater independence and reducing reliance on caregivers. This survey presents a comprehensive review of gesture-based smart home systems specifically designed for elderly and physically impaired users, focusing on technological advancements, usability, and system-level challenges. The study systematically examines literature from the past decade, analyzing key dimensions including gesture recognition methods, sensor modalities, system integration, user accessibility and security. Deep learning techniques such as convolutional neural networks (CNNs) and sensor fusion approaches have led to improved gesture recognition accuracy. However, issues such as environmental sensitivity, limited real-world validation, and lack of standardized benchmarks persist. A chronological review traces the evolution of these systems—from early infrared and wearable technologies to current AI-enhanced, IoT-integrated, multimodal platforms. Despite technical progress, challenges remain in terms of user fatigue, gesture variability, hardware intrusiveness, and inconsistent evaluation methodologies. Moreover, critical aspects such as security, scalability, and personalized interaction are often underexplored. This review identifies major research gaps and proposes future directions including the development of adaptive gesture sets, robust multimodal frameworks, ergonomic sensor designs, and privacy-aware authentication mechanisms. Emphasis is placed on user- centered design and longitudinal field testing to enhance practical applicability. By consolidating current knowledge and highlighting future opportunities, this review aims to guide researchers and developers toward creating inclusive, reliable, and scalable gesture-controlled smart home systems that better support the needs of elderly and disabled individuals

References

[1] G.G. Mwangi, J.M. Kerosi, B.A. Moywaywa, “Gesture-driven home automation system,” IOSR Journal of Electrical and Electronics Engineering, Vol.19, Issue.6, pp.10-15, 2024.

[2] U. Besenk, T.T.M.A. Selver, A. Özkurt, O. Ocal, “Increasing the accessibility of disabled individuals with AI integrated smart home systems,” Proceedings of the Medical Technologies Congress (TIPTEKNO), IEEE, Turkey, pp.1-4, 2024.

[3] C. Hu, D.S. Hernandez, C. Wu, W. Tu, Y. Lai, “Prototyping a gesture-controlled smart home assistant - an IoT integration approach,” Proceedings of the International Conference on Information Technology (INCIT), IEEE, pp.284-288, 2024.

[4] E. Ding, G. Xiao-hu, “An intelligent computer vision system for gesture based home automation and detection of Parkinson`s tremors,” Proceedings of the IEEE Global Humanitarian Technology Conference (GHTC), IEEE, USA, pp.461-467, 2024.

[5] C. Panagiotou, E. Faliagka, C. Antonopoulos, N. Voros, “Multidisciplinary ML techniques on gesture recognition for people with disabilities in a smart home environment,” AI Journal, Vol.6, Issue.1, pp.1-18, 2025.

[6] N. Elsayed, C.L. Zekios, N. Asadizanjani, Z. ElSayed, “Adapted contrastive predictive coding framework for accessible smart home control system based on hand gestures recognition,” Proceedings of the 37th International FLAIRS Conference, USA, pp.1-3, 2024.

[7] N. Bg, S. S, T. R, T. Bk, V. Y, “Wheelchair control and home automation using hand gestures,” Proceedings of the EAI Endorsed Transactions on Smart Cities, pp.1-6, 2020.

[8] S. SusilaSakthy, B. Devi, T. Rani, P. Niveditha, D. Pooja, “Enhancing accessibility and inclusivity for people with disabilities using hand gesture recognition,” Proceedings of the International Conference on Communication and Signal Processing (ICCSP), IEEE, India, pp.231-235, 2024.

[9] M.A.J.P. R, “Hand gesture recognition for home automation using machine learning and ESP8266 server,” International Journal of Innovative Research in Information Security, Vol.10, Issue.3, pp.273-277, 2024.

[10] D. Tomar, D. Nauni, A.M. Zaidi, M. Kaur, “Gesture-controlled home automation for the differently abled: Enhanced accessibility and independence,” Proceedings of the International Conference on Technological Advancements in Computational Sciences (ICTACS), IEEE, pp.1560-1564, 2023.

[11] P. Anuradha, K. Vasanth, G. Renuka, A.R. Rao, “IoT based enabling home automation system for individuals with diverse disabilities,” e-Prime: Advances in Electrical Engineering, Electronics and Energy, Vol.6, pp.1-5, 2023.

[12] O.P. Mishra, P. Suryawanshi, Y. Singh, S. Deokar, “A Mediapipe-based hand gesture recognition home automation system,” Proceedings of the International Conference on Futuristic Technologies (INCOFT), IEEE, pp.1-6, 2023.

[13] B. Kurian, J. Regi, D. John, P. Hari, T.Y. Mahesh, “Visual gesture-based home automation,” Proceedings of the International Conference on Advances in Computing, Communication, Embedded and Secure Systems (ACCESS) IEEE Access, pp.286-290, 2023.

[14] H. Rustam, A.S.A. Jalal, “Automate appliances via gestures recognition for elderly living assistance,” Proceedings of the International Conference on Advancements in Computational Sciences (ICACS), IEEE, pp.1-6, 2023.

[15] S. Avadut, S.K. Udgata, “A deep learning based IoT framework for assistive healthcare using gesture based interface,” Proceedings of the International Conference on Internet of Things and Intelligent Systems (IoTaIS), IEEE, pp.6-12, 2022.

[16] N. Jayaweera, B. Gamage, M. Samaraweera, S. Liyanage, S. Lokuliyana, T. Kuruppu, “Gesture driven smart home solution for bedridden people,” Proceedings of the ACM International Conference on Automated Software Engineering, ACM, pp.152-158, 2020.

[17] H. A, H. P, P. Asha, “Gesture based home appliance control system for disabled people,” Proceedings of the International Conference on Electronics and Sustainable Communication Systems (ICESC), Coimbatore, India, pp.1501-1505, 2021.

[18] Anbarasan, J.S. Lee, “Speech and gestures for smart-home control and interaction for older adults,” Proceedings of the 3rd International Workshop on Multimedia for Personal Health and Health Care, pp.49-57, 2018.

[19] S. Kshirsagar, S. Sachdev, N. Singh, A. Tiwari, S. Sahu, “IoT enabled gesture-controlled home automation for disabled and elderly,” Proceedings of the International Conference on Computing, methodologies and communication (ICCMC), IEEE, pp.821-826, 2020.

[20] A. Purushothaman, S. Palaniswamy, “Development of smart home using gesture recognition for elderly and disabled,” Proceedings of the International Conference on Intelligent Computing, India, 2018.

[21] R. Martinez, “Home automation system for people with limited upper limb capabilities using artificial intelligence,” Proceedings of the International Conference on Computer Science, Electronics and Industrial Engineering (CSEI), Springer, Switzerland, pp.214-231, 2022.

[22] H.W. Guesgen, D. Kessell, “Gestural control of household appliances for the physically impaired,” In FLAIRS, 2012.

[23] G. Singh, A. Nelson, R. Robucci, C. Patel, N. Banerjee, “Inviz: Low-power personalized gesture recognition using wearable textile capacitive sensor arrays,” Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom), IEEE, USA, pp.198-206, 2015.

[24] R. Holonec, S. Vlad, N. Roman, L. Rapolti, “Smart house control using hand gestures recognition LabVIEW applications,” International Conference on Advancements of Medicine and Health Care through Technology, Springer, Switzerland, pp.240-249, 2020.

[25] Y. Vasylkiv, A. Neshati, Y. Sakamoto, R. Gomez, K. Nakamura, P. Irani, “Smart home interactions for people with reduced hand mobility using subtle EMG-signal gestures,” In Improving Usability, Safety and Patient Outcomes with Health Information Technology, pp.436-443, 2019

[26] K. Nguyen-Trong, H.N. Vu, N.N. Trung, C. Pham, “Gesture recognition using wearable sensors with bi-long short-term memory convolutional neural networks,” IEEE Sensors Journal, Vol.21, Issue.13, pp.15065-15079, 2021.

[27] G. Kai, “Smart home control system capable of carrying out operation through gestures”, 2015.

[28] M.A. Rahman, M.S. Hossain, “A gesture-based smart home-oriented health monitoring service for people with physical impairments,” In International Conference on Smart Homes and Health Telematics, Springer, Switzerland, pp.464-476, 2016.

[29] M. Malhotra, R. Mittal, M. Jain, “A gesture controlled and cost effective - home automation system,” International Journal of Scientific Research in Computer Science, Engineering and Information Technology , Vol.5, Issue.2, pp.1-6, 2019.

[30] N. Sharma, M. Mangla, S.N. Mohanty, S. Satpathy, “A gesture based remote control for home appliances,” Proceedings of the IEEE International Conference on Computing for Sustainable Global Development (INDIACom), IEEE, India, pp.42-47, 2021.

[31] C. Langensiepen, A. Lotfi, S. Higgins, “Use of gesture recognition to control household devices for older people,” Journal of Assistive Technologies, Vol.4, Issue.4, pp.4-10, 2010.

[32] Qin, C., A. Song, L. Wei, and Y. Zhao, “A multimodal domestic service robot interaction system for people with declined abilities to express themselves,” Intelligent Service Robotics, Vol.16, Issue.3, pp.373–392,2023

Downloads

Published

2025-09-30
CITATION
DOI: 10.26438/ijcse/v13i9.1622
Published: 2025-09-30

How to Cite

[1]
P. R. KB, S. Biradar, S. Devadiga, V. T. Dalabanjan, and V. MM, “A Comprehensive Review on Gesture-Controlled Smart Home Systems for Elderly and Disabled Individuals”, Int. J. Comp. Sci. Eng., vol. 13, no. 9, pp. 16–22, Sep. 2025.