Real-Time Detection of Autistic Children's Activities Using YOLOv8 on Social Monitoring Robots

Ekawati Prihatini; Selamat Muslimin; Kurnia Hadi

doi:10.24014/ijaidm.v8i2.37380

Real-Time Detection of Autistic Children's Activities Using YOLOv8 on Social Monitoring Robots

Ekawati Prihatini, Selamat Muslimin, Kurnia Hadi

Abstract

Children with autism spectrum disorder require special attention in both therapy and daily activity monitoring. One approach that can assist is the utilization of a Social Monitoring Robot (SMR) with the capability of automatic activity monitoring. This study aims to develop a real-time activity detection system for children with autism using the You Only Look Once version 8 (YOLOv8) algorithm on the SAR platform. The system is designed to recognize key activities such as eating, studying, and walking, through video input from a webcam processed by a Raspberry Pi. The recognition process is carried out by detecting bounding boxes and confidence scores for the child and their activities. The detection results are then visualized through a Human Machine Interface (HMI). Based on the testing, the system is capable of detecting and classifying children's activities with a fairly high level of reliability under real-world environmental conditions. These results indicate that the implementation of YOLOv8 in an SMR-based monitoring system has the potential to enhance supervision and intervention for children with autism in a more responsive and personalized manner.

Keywords

Autistic Children Activity; Human Machine Interface; Object detection; Socially Monitoring Robot; YOLOv8

References

S. Cano, C. S. González, R. M. Gil-Iranzo, and S. Albiol-Pérez, “Affective communication for socially assistive robots (SARs) for children with autism spectrum disorder: A systematic review,” Sensors, vol. 21, no. 15, Aug. 2021, doi: 10.3390/s21155166.

A. Kouroupa, K. R. Laws, K. Irvine, S. E. Mengoni, A. Baird, and S. Sharma, “The use of social robots with children and young people on the autism spectrum: A systematic review and meta-analysis,” Jun. 01, 2022, Public Library of Science. doi: 10.1371/journal.pone.0269800.

P. Wei, D. Ahmedt-Aristizabal, H. Gammulle, S. Denman, and M. A. Armin, “Vision-based activity recognition in children with autism-related behaviors,” Heliyon, vol. 9, no. 6, Jun. 2023, doi: 10.1016/j.heliyon.2023.e16763.

R. Hosney, F. M. Talaat, E. M. El-Gendy, and M. M. Saafan, “AutYOLO-ATT: an attention-based YOLOv8 algorithm for early autism diagnosis through facial expression recognition,” Neural Comput Appl, vol. 36, no. 27, pp. 17199–17219, Sep. 2024, doi: 10.1007/s00521-024-09966-7.

Y. Gu et al., “Micro-expression detection in ASD movies: a YOLOv8-SMART approach,” Biomedical Informatics, Feb. 2025, doi: 10.55092/bi20250002.

C. K. Syriopoulou-Delli and E. Gkiolnta, “Review of assistive technology in the training of children with autism spectrum disorders,” 2022, Taylor and Francis Ltd. doi: 10.1080/20473869.2019.1706333.

R. Vagnetti, A. Di Nuovo, M. Mazza, and M. Valenti, “Social Robots: A Promising Tool to Support People with Autism. A Systematic Review of Recent Research and Critical Analysis from the Clinical Perspective,” 2024, Springer. doi: 10.1007/s40489-024-00434-5.

R. Kalidoss, S. Umapathy, and U. Rani Thirunavukkarasu, “A breathalyzer for the assessment of chronic kidney disease patients’ breathprint: Breath flow dynamic simulation on the measurement chamber and experimental investigation,” Biomed Signal Process Control, vol. 70, Sep. 2021, doi: 10.1016/j.bspc.2021.103060.

A. Amirova, N. Rakhymbayeva, A. Zhanatkyzy, Z. Telisheva, and A. Sandygulova, “Effects of Parental Involvement in Robot-Assisted Autism Therapy,” J Autism Dev Disord, vol. 53, no. 1, pp. 438–455, Jan. 2023, doi: 10.1007/s10803-022-05429-x.

Z. Ye, “Elderly Fall Detection Based on YOLO and Pose Estimation,” INSTICC, Jul. 2025, pp. 10–17. doi: 10.5220/0013486500004619.

Q. Riyadh Khawam, M. Al-Hashimi, and S. Khalid Abdulateef, “Real-Time Fall Detection for the Elderly in Home Settings Using a Vision-Based YOLOv8-Pose Model,” Journal of Al-Qadisiyah for Computer Science and Mathematics, vol. 17, no. 3, Sep. 2025, doi: 10.29304/jqcsm.2025.17.32425.

N. D. Hendrawan, R. Kolandaisamy, and A. History, “Jurnal Teknologi dan Manajemen Informatika A Comparative Study of YOLOv8 and YOLO-NAS Performance in Human Detection Image Article Info ABSTRACT,” vol. 9, no. 2, pp. 191–201, 2023, [Online]. Available: http://http://jurnal.unmer.ac.id/index.php/jtmi

M. Passalacqua et al., “Human-centred AI in industry 5.0: a systematic review,” 2024, Taylor and Francis Ltd. doi: 10.1080/00207543.2024.2406021.

R. Machucho and D. Ortiz, “The Impacts of Artificial Intelligence on Business Innovation: A Comprehensive Review of Applications, Organizational Challenges, and Ethical Considerations,” Apr. 01, 2025, Multidisciplinary Digital Publishing Institute (MDPI). doi: 10.3390/systems13040264.

Rishi Kumar Sharma, “Ethics in AI: Balancing innovation and responsibility,” International Journal of Science and Research Archive, vol. 14, no. 1, pp. 544–551, Jan. 2025, doi: 10.30574/ijsra.2025.14.1.0122.

H. Han et al., “Hyperspectral Unmixing Via Nonconvex Sparse and Low-Rank Constraint,” IEEE J Sel Top Appl Earth Obs Remote Sens, vol. 13, pp. 5704–5718, 2020, doi: 10.1109/JSTARS.2020.3021520.

M. Yaseen, “What is YOLOv8: An In-Depth Exploration of the Internal Features of the Next-Generation Object Detector,” Aug. 2024, [Online]. Available: http://arxiv.org/abs/2408.15857

S. Haque, Z. Eberhart, A. Bansal, and C. McMillan, “Semantic Similarity Metrics for Evaluating Source Code Summarization,” in IEEE International Conference on Program Comprehension, IEEE Computer Society, 2022, pp. 36–47.

M. Bakirci, “Real-Time Vehicle Detection Using YOLOv8-Nano for Intelligent Transportation Systems,” Traitement du Signal, vol. 41, no. 04, pp. 1727–1740, Aug. 2024, doi: 10.18280/ts.410407.

H. Guo, Y. Zhang, L. Chen, and A. A. Khan, “Research on vehicle detection based on improved YOLOv8 network.”

B. Ibrahim and Z. Kui, “Enhancing Traffic Sign Recognition On The Performance Based On Yolov8.”

B. Yilmaz and U. Kutbay, “YOLOv8-Based Drone Detection: Performance Analysis and Optimization,” Computers, vol. 13, no. 9, Sep. 2024, doi: 10.3390/computers13090234.

DOI: http://dx.doi.org/10.24014/ijaidm.v8i2.37380

Refbacks

There are currently no refbacks.

Office and Secretariat:

Big Data Research Centre
Puzzle Research Data Technology (Predatech)
Laboratory Building 1st Floor of Faculty of Science and Technology
UIN Sultan Syarif Kasim Riau

Jl. HR. Soebrantas KM. 18.5 No. 155 Pekanbaru Riau – 28293
Website: http://predatech.uin-suska.ac.id/ijaidm
Email: ijaidm@uin-suska.ac.id
e-Journal: http://ejournal.uin-suska.ac.id/index.php/ijaidm
Phone: 085275359942

Journal Indexing:

IJAIDM Stats