The Effect of Augmented Reality in Enhancing Basic Communication Skills in Children with Autism Spectrum Disorder
Azizah Nurul Khoirunnisa
,
Munir
,
Faaizah Shahbodin
,
Laksmi Dewi
,
Yoga Budhi Santoso
,
Lia Susanti
Autism Spectrum Disorder (ASD) is a neurodevelopmental condition characterized by challenges in social communication and repetitive behaviors. The Pic.
- Pub. date: April 15, 2025
- Online Pub. date: April 02, 2025
- Pages: 613-623
- 109 Downloads
- 370 Views
- 0 Citations
Abstract:
Autism Spectrum Disorder (ASD) is a neurodevelopmental condition characterized by challenges in social communication and repetitive behaviors. The Picture Exchange Communication System (PECS) has been widely utilized to support communication in children with ASD by using picture cards to convey needs and responses. However, traditional PECS can be limited by its static nature and lack of immediate feedback. Recent technological advances, particularly Augmented Reality (AR), offer new avenues for enhancing these communication strategies. This study explores the integration of AR into PECS and its impact on improving basic communication skills, specifically answering questions and commenting, in children with ASD. The research involved a multiple baseline design with four participants aged 7-12 years, recruited from autism centers in Melaka, Malaysia. Results showed significant improvements in both the frequency and accuracy of responses and relevant commenting skills after the AR-based intervention. Answering skills improved by 83%, and commenting skills increased by 122%, with the average number of relevant comments rising from 3 (SD = 0.89) to 6.67 (SD = 2.25). Statistical analysis (paired t-test) revealed a significant effect (p = 0.00272). Compared to traditional methods, AR-based PECS accelerated the achievement of target communication skills. Future research should focus on larger sample sizes and explore long-term impacts to solidify these promising outcomes.
Keywords: Autism Spectrum Disorder, augmented reality, communication skills, PECS, primary education.
References
Agius, M. M., & Vance, M. (2016). A comparison of PECS and iPad to teach requesting to pre-schoolers with Autistic Spectrum Disorders. Augmentative and Alternative Communication, 32(1), 58-68. https://doi.org/10.3109/07434618.2015.1108363
Almurashi, H., Bouaziz, R., Alharthi, W., Al-Sarem, M., Hadwan, M., & Kammoun, S. (2022). Augmented reality, serious games and picture exchange communication system for people with ASD: Systematic literature review and future directions. Sensors, 22(3), Article 1250. https://doi.org/10.3390/s22031250
American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders (DSM-5-TR) (5th Ed). American Psychiatric Publishing. https://www.psychiatry.org/psychiatrists/practice/dsm
Baixauli-Fortea, I., Miranda Casas, A., Berenguer-Forner, C., Colomer-Diago, C., & Roselló-Miranda, B. (2019). Pragmatic competence of children with autism spectrum disorder. Impact of theory of mind, verbal working memory, ADHD symptoms, and structural language. Applied Neuropsychology: Child, 8(2), 101-112. https://doi.org/10.1080/21622965.2017.1392861
Bernacki, M. L., Greene, M. J., & Lobczowski, N. G. (2021). A systematic review of research on personalized learning: Personalized by whom, to what, how, and for what purpose(s)? Educational Psychology Review, 33, 1675-1715. https://doi.org/10.1007/s10648-021-09615-8
Bhatt, S. K., De Leon, N. I., & Al-Jumaily, A. (2022). Augmented reality game therapy for children with Autism Spectrum Disorder. International Journal on Smart Sensing and Intelligent Systems, 7(2), 519-536. https://doi.org/10.21307/ijssis-2017-668
Centelles, L., Assaiante, C., Etchegoyhen, K., Bouvard, M., & Schmitz, C. (2013). From action to interaction: Exploring the contribution of body motion cues to social understanding in typical development and in Autism Spectrum Disorders. Journal of Autism and Developmental Disorders, 43, 1140-1150. https://doi.org/10.1007/s10803-012-1655-0
Chen, J., & Lucke, U. (2020). Personalized intelligent intervention and precise evaluation for children with Autism Spectrum Disorder. In Proceedings of DELFI Workshops 2020 (pp. 14-17). German Informatics Society DELFI. https://doi.org/10.18420/delfi2020-ws-114
Chen, Y., Wang, Q., Chen, H., Song, X., Tang, H., & Tian, M. (2019). An overview of augmented reality technology. Journal of Physics: Conference Series, 1237(2), Article 022082. https://doi.org/10.1088/1742-6596/1237/2/022082
Cheng, Y., & Bololia, L. (2024). The effects of augmented reality on social skills in children with an autism diagnosis: A preliminary systematic review. Journal of Autism and Developmental Disorders, 54, 1317-1331. https://doi.org/10.1007/s10803-022-05878-4
Craig, A. B. (2013). Understanding augmented reality: Concepts and applications. Morgan Kaufmann. https://doi.org/10.1016/C2011-0-07249-6
Davis, R., Fletcher-Watson, S., & Digard, B. G. (2021). Autistic people’s access to bilingualism and additional language learning: Identifying the barriers and facilitators for equal opportunities. Frontiers in Psychology, 12, Article 741182. https://doi.org/10.3389/fpsyg.2021.741182
Ellingsen, R., Bolton, C., & Laugeson, E. (2017). Evidence-based social skills groups for individuals with Autism Spectrum Disorder across the lifespan. In J. B. Leaf (Ed.), Handbook of social skills and autism spectrum disorder: Assessment, curricula, and intervention (pp. 343-358). Springer. https://doi.org/10.1007/978-3-319-62995-7_20
El Shemy, I., Jaccheri, L., Giannakos, M., & Vulchanova, M. (2024). Augmented reality-enhanced language learning for children with Autism Spectrum Disorder: A systematic literature review. Behaviour and Information Technology, 43(16), 4097-4124. https://doi.org/10.1080/0144929X.2024.2304607
Ganz, J. B., Hong, E. R., & Goodwyn, F. D. (2013). Effectiveness of the PECS Phase III app and choice between the app and traditional PECS among preschoolers with ASD. Research in Autism Spectrum Disorders, 7(8), 973-983. https://doi.org/10.1016/j.rasd.2013.04.003
Garzón, J., & Acevedo, J. (2019). Meta-analysis of the impact of Augmented Reality on students’ learning gains. Educational Research Review, 27, 244-260. https://doi.org/10.1016/j.edurev.2019.04.001
Grynszpan, O., Weiss, P. L. (Tamar), Perez-Diaz, F., & Gal, E. (2013). Innovative technology-based interventions for autism spectrum disorders: A meta-analysis. Autism, 18(4), 346-361. https://doi.org/10.1177/1362361313476767
Heimann, M., Nordqvist, E., Strid, K., Almrot, J. C., & Tjus, T. (2016). Children with autism respond differently to spontaneous, elicited and deferred imitation. Journal of Intellectual Disability Research, 60(5), 491-501. https://doi.org/10.1111/jir.12272
Jin, Y. S., & Pae, S. (2014). Communication profiles of school-aged children with social communication disorder and high-functioning autism. Communication Sciences and Disorders, 19(1), 45-59. https://doi.org/10.12963/csd.14102
Keshav, N. U., Vogt-Lowell, K., Vahabzadeh, A., & Sahin, N. T. (2019). Digital attention-related augmented-reality game: Significant correlation between student game performance and validated clinical measures of attention-deficit/hyperactivity disorder (ADHD). Children, 6(6), Article 72. https://doi.org/10.3390/children6060072
Khoirunnisa, A. N., Munir, & Dewi, L. (2023). Design and prototype development of augmented reality in reading learning for Autism. Computers, 12(3), Article 55. https://doi.org/10.3390/computers12030055
Khowaja, K., Banire, B., Al-Thani, D., Sqalli, M. T., Aqle, A., Shah, A., & Salim, S. S. (2020). Augmented reality for learning of children and adolescents with Autism Spectrum Disorder (ASD): A systematic review. IEEE Access, 8, 78779-78807. https://doi.org/10.1109/ACCESS.2020.2986608
Kuo Y. T., & Kuo Y.-C. (2017). The role of augmented reality and its application in learning. The International Journal of Technology, Knowledge, and Society, 13(1), 1-9. https://doi.org/10.18848/1832-3669/CGP/v13i01/1-9
Kurniawati, L. A. (2020). Personalized learning: Empowering a student with Autism Spectrum Disorder in basic grammar course. Yavana Bhāshā: Journal of English Language Education, 3(1), 1-11. https://bit.ly/4j2Q0BT
Lee, I.-J., & Huang, Y.-C. (2024). Improving social skills in children with autism spectrum disorder using augmented reality and mixed reality technology combined with concept maps. Universal Access in the Information Society. Advance online publication. https://doi.org/10.1007/s10209-024-01135-w
Lin, L.-Y., Lin, C.-H., Chuang, T.-Y., Loh, S. C., & Chu, S. Y. (2023). Using home-based augmented reality storybook training modules for facilitating emotional functioning and socialization of children with autism spectrum disorder. International Journal of Developmental Disabilities, 71(1), 87-94. https://doi.org/10.1080/20473869.2023.2202454
McMahon, D. D., Cihak, D. F., Wright, R. E., & Bell, S. M. (2015). Augmented reality for teaching science vocabulary to postsecondary education students with Intellectual Disabilities and Autism. Journal of Research on Technology in Education, 48(1), 38-56. https://doi.org/10.1080/15391523.2015.1103149
Menéndez, E., & Lopez De Luise, M. D. (2018). Augmented reality as visual communication for people with ASD. Systemics, Cybernetics and Informatics, 16(1), 17-21. https://bit.ly/3FM6MXD
Minolin, T. M., Sagayar Raj, B. S., & Vijayaraghavan, R. (2022). Effectiveness of evidence-based intervention on social skill and communication among autism spectrum disorder children. Journal of Population Therapeutics and Clinical Pharmacology, 29(2), e1-e10. https://doi.org/10.47750/jptcp.2022.893
Mohd, C. K. N. C. K., Shahbodin, F., Suparjoh, S., & Khidir, N. A. S. M. (2019). Application of augmented reality in learning bakery for Autism Spectrum Disorder. International Journal of Engineering and Advanced Technology, 9(1), 2616-2620. https://doi.org/10.35940/ijeat.A9853.109119
Ousley, O., & Cermak, T. (2014). Autism spectrum disorder: Defining dimensions and subgroups. Current Developmental Disorders Reports, 1, 20-28. https://doi.org/10.1007/s40474-013-0003-1
Piaget, J. (1964). Part I: Cognitive development in children: Piaget development and learning. Journal of Research in Science Teaching, 2(3), 176-186. https://doi.org/10.1002/tea.3660020306
Ranaweera, K. G., Praneetha, J., De Silva, W. P. S., Kempitiya, K. R. B. N., Gamage, I., & Thilakarthna, T. (2023). Personalized and interactive learning platform for students with Autism Spectrum Disorder. In 2023 5th International Conference on Advancements in Computing (ICAC) (pp. 828-833). IEEE. https://doi.org/10.1109/ICAC60630.2023.10417404
Sahin, N. T., Keshav, N. U., Salisbury, J. P., & Vahabzadeh, A. (2018). Safety and lack of negative effects of wearable augmented-reality social communication aid for children and adults with Autism. Journal of Clinical Medicine, 7(8), Article 188. https://doi.org/10.3390/jcm7080188
Sharma, S. R., Gonda, X., & Tarazi, F. I. (2018). Autism Spectrum Disorder: Classification, diagnosis and therapy. Pharmacology and Therapeutics, 190, 91-104. https://doi.org/10.1016/j.pharmthera.2018.05.007
Shemshack, A., Kinshuk, & Spector, J. M. (2021). A comprehensive analysis of personalized learning components. Journal of Computers in Education, 8, 485-503. https://doi.org/10.1007/s40692-021-00188-7
Syahputra, M. F., Arisandi, D., Lumbanbatu, A. F., Kemit, L. F., Nababan, E. B., & Sheta, O. (2018). Augmented reality social story for autism spectrum disorder. Journal of Physics: Conference Series, 978, Article 012040. https://doi.org/10.1088/1742-6596/978/1/012040
Therrien, M. C. S., & Light, J. C. (2018). Promoting peer interaction for preschool children with complex communication needs and Autism Spectrum Disorder. American Journal of Speech-Language Pathology, 27(1), 207-221. https://doi.org/10.1044/2017_AJSLP-17-0104
Vygotsky, L. S. (1962). Thought and language. The MIT Press Cambridge.
Xie, J., Basham, J. D., Marino, M. T., & Rice, M. F. (2017). Reviewing research on mobile learning in K–12 educational settings. Journal of Special Education Technology, 33(1), 27-39. https://doi.org/10.1177/0162643417732292
Zhang, M., Ding, H., Naumceska, M., & Zhang, Y. (2022). Virtual reality technology as an educational and intervention tool for children with Autism Spectrum Disorder: Current perspectives and future directions. Behavioral Sciences, 12(5), Article 138. https://doi.org/10.3390/bs12050138