International Journal of Interactive Mobile Technologies (iJIM) – eISSN: 1865-7923 – Vol. 14, No. 14, 2020 Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... Design and Implementation of Interactive Mobile Application for Autistic Children in Physical Education Class https://doi.org/10.3991/ijim.v14i14.15477 Pitsanu Chaichitwanidchakol (), Witcha Feungchan Khon Kaen University, Khon Kaen, Thailand pitsanu.c@kkumail.com Abstract—Each autistic child has different characteristics and severity of symptoms ranging from not being able to do daily routine tasks such as exercis- ing by themselves to not being able to care for themselves and needing caretak- ers to look after them for most of the time. In the Autistic Research Centre, Khon Kaen University Demonstration School, Thailand, every morning, one of their routine tasks is exercise, especially on the treadmill, which can reduce their weight and improve their focus on school during the day. The aim of this research is to find video interaction in the form that encourage autistic chil- dren’s exercise on a treadmill suitable for individual child. Six interaction tech- niques were designed and tested. The techniques included: Face Detection (FD), Upper Body Detection (UBD), Color Detection (CD), QR Code Detection (QCD), Motion Detection (MD), and Adaptive Video Interaction (AVI). All in- teractions were developed on the iOS platform and tested on eight autistic chil- dren. Each child was tested at least 12 sessions on the treadmill, and perfor- mance of the six techniques were evaluated from the accuracy of application de- tecting the child’s presence on the treadmill compared to the actual number of times that each child disappeared. The results showed that the AVI was the most suitable technique for autistic children with an average accuracy rate of 92.31%. The study shows that the application is able to reduce the caretaker’s burden and motivate autistic children to focus while exercising. Keywords—Autistic, Video interaction, Mobile devices, Physical education class. 1 Introduction Autistic Spectrum Disorder (ASD) is a group of disorder that occurs from brain abnormality causing difficulties in various developments such as language, social skills, and in having interests and behavior that are limited and repetitive. The symp- toms of the disorder appear before the age of three with varying severity depending on language development, Intelligence Quotient (IQ), and other coexisting abnormalities. These difficulties are lifelong, especially for social skill development. Only 1 – 2% of autistic children can live normally like others. ASD cannot be entirely cured but can 134 http://www.i-jim.org https://doi.org/10.3991/ijim.v14i14.15477%0d mailto:pitsanu.c@kkumail.com Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... be meliorated through therapy by developing and training in various skills such as art therapy, music therapy, animal therapy, robot therapy, and game therapy to increase the ability of these children to live with other people. Physical therapy by exercise is a routine task that every autistic child at Special Education Division (Autistic Research Centre), Khon Kaen University Demonstration School has to do every morning before studying other subjects. This therapy helps reducing a risk of being overweight which can lead to other illness [1] as well as im- proves their focus on learning. Exercise in controlled environment such as exercise on the treadmill is favorable due to safety, convenience of caretakers and less interaction with outsiders [2], but it requires a caretaker to supervise the child throughout the exercise. This study aims to design exercising system which requires less caretaking and improves the child’s focus during exercise using existing technology. Nowadays, interactive toys [3], [4], robots [5], [6], and mobile devices [7]–[12] are used for therapy to treat and rehabilitate the symptoms of autistic children. These devices differ in how they interact with the children. This study focuses on mobile devices, for they have many features such as touch screen, camera, and other sensors, leading to a variety of different interactions. Which autistic children can use mobile devices for learning [13], [14]. However, some abnormalities in autistic children pre- vent them from using some techniques or the results will not be as effective as if they were used with non-autistic people. Therefore, only using the interactions that are appropriate for autistic children will make them interact with mobile devices better. Apart from interactions with devices mentioned above, most interactions with au- tistic children use a camera as the medium to monitor their reactions or behaviors and interact with them accordingly. In [15]–[19], Kinect was used to detect children’s body movements when playing the game and [20] to gather usage of Kinect in educa- tion as well as rehabilitation of various symptoms and diseases such as stroke, cardio- vascular rehabilitation, physical disability, severe intellectual disabilities (SID) and ASD, and in [10], Eye-Tracker goggles were used to detect their eye movement pat- terns. This study aims to find the suitable interaction techniques for autistic children to support their exercising. Six mobile camera interaction techniques were proposed in this study. These six techniques include 1) Face Detection (FD), 2) Upper Body Detection (UBD), 3) Color Detection (CD), 4) QR Code Detection (QCD), 5) Motion Detection (MD), and 6) Adaptive Video Interaction (AVI). All techniques were developed on the iOS platform and tested with eight children from Special Education Division (Autistic Research Centre), Khon Kaen University Demonstration School. Each child was tested for 12 sessions and their performance of each technique was evaluated from the child’s presence detection on the treadmill, compared to the number of times that each child actually disappeared. 2 Related Work Patients usually have the autistic symptoms life-long because there has been no cure. However, some types of therapy can be applied to lessen the disorders. In this iJIM ‒ Vol. 14, No. 14, 2020 135 Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... part, we will discuss two topics including: autistic therapy and mobile interaction for autistic children. 2.1 Autistic therapy Therapy helps relieve the severity of symptoms in autistic children, stimulate positive behavior, and increase the ability or develop skills in areas such as speaking, daily living, careering, etc. At present, there are many types of therapy. Apart from those according to the main therapy guidelines, one of the most popular therapies are called Alternative Therapies. The Alternative Therapies can be chosen to suit the symptoms and responses received from each child and used in conjunction with the main therapy. Examples of Alternative Therapy include art therapy, music therapy, animal therapy, and acupuncture. Such therapies use either equipment or various crea- tures as a medium. Art therapy uses drawing equipment, music therapy uses musical instruments, animal therapy uses dogs, cats, fish, etc., and acupuncture uses needles. Electronic devices are also used in therapy, including interactive toys [3], [4], robots [5], [6], and smartphones [7]–[12] 2.2 Mobile interactions for autistic children Interaction with autistic children on mobile devices is retaliation or communication between children with autism and mobile devices. When compared to normal people, autistic children may only respond to some interactions. Relevant research findings reveal that three interaction patterns were applied to autistic children. Interactive toys interaction: Interactive toys can interact with players through attractive patterns such as light, sound, and texture. In [3], interactive cubes were used as the medium for interaction between the games and the autistic children to inspire, increase curiosity, and enhance social skills. The result of the study found that applying interactive cubes can stimulate children to participate in the game longer, help to reduce repetitive behavior, and increase curiosity. The [4] aim of the game was to improve social interaction behavior of autistic children. Two games were created for comparison. The first game had no goal and did not use additional components. The second game had a goal and used smart toys. The result was that more social interaction was present in the second game than in the first. Interactive robot interaction: A robot is a type of machine which has different structures according to its purpose. In general, robots are created to work with difficulties, dangerous situations, or when high accuracy is needed. For autistic chil- dren, robots are used to develop social and communication skills [5]. The robots will have a child-friendly appearance, such as having cartoon characters or animals that are liked by the children. This will help prevent children from being afraid and will induce them to interact more. It was also found that using robots as a substitute for teaching led to better learning in children. Nowadays, in addition to the movement of the head, arms or legs, robots can also interact with users by talking. Camera interaction / Movement interaction: Currently, smartphones are widely used and has become an indispensable part of human daily life. Smartphones are used 136 http://www.i-jim.org Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... not just for communication but also for entertainment and learning. Various research has also used smartphones for medical use to assist in treating patients. In [10], Facial Expression Recognition and Automatic Voice Recognition techniques were applied to help children with autism learn and increase academic skills. The World of Kids system was designed to help detect user behavior on mobile devices with the purpose of identifying the emotions of mobile device users via face detection, to acquire games that are suitable for the user's mood, [11] to use the digital activity schedule manager on smartphones to help increase management skills, and to schedule activities to make autistic children able to live without having to rely on others, which leads them to have a better quality of life. And [12] use AR on mobile devices to improve the literacy in academic and learning skills for children with autism using the phonics learning method. Camera interaction or Movement interaction uses a camera to interact with people. Kinect is mostly used in the research for autistic children, in [15]–[19], Kinect was used for interaction and was called motion-based, touchless, interaction for children with autism to practice movement skills as well as develop intellectual skills [15]. Games that focus on movement without using touch, has the potential to be used in therapy for children with autism [18]. In [19], proposing the hand-eye coordination technique in playing games to treat children with autism. In addition, Eye-Tracker goggles for detecting eye movements were used in [21] to study the behavior of chil- dren with autism. 3 Methods 3.1 Interaction design The design goal is to detect whether or not the child is still on the treadmill. The presence of the child on the treadmill indicates that s/he is still running. On the other hand, his/her absence on the treadmill indicates that s/he has left. Moving equipment with multiple interactions are utilized. Interaction design for autistic children is developed based on the children’s most common behaviours which include eye contact, tactile defensiveness, low motivation, communication problems [22], and abnormalities in their behaviours such as difficulties in controlling their bodily movements, communication, emotional difficul- ties, and behavioural expressions. From these characteristics and behaviours, the most suitable interaction was to use external appearances and actions of the children com- bined with some stimuli to urge them to interact as needed. Such stimuli included food, snacks, cartoons, or anything else that the child likes [4]. This study gathered and designed six interaction techniques to interact with autistic children while exercising on a treadmill: 1) Face Detection, (FD) 2) Upper Body Detection (UBD), 3) Colour Detection (CD), 4) QR Code Detection (QCD), 5) Mo- tion Detection (MD), and 6) Adaptive Video Interaction (AVI). Fig. 1 shows the working process of the first five techniques which were similar in process but differ- ent in how presence detection was made. iJIM ‒ Vol. 14, No. 14, 2020 137 Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... Face Detection (FD): FD used a video camera with real-time image processing to detect facial features. If the eyes and mouth were detected, it meant that the child was on the treadmill. Upper Body Detection (UBD): UBD detected bodily parts from head to chest. This method is similar to FD but with a broader target and easier detection. When upper bodily parts were detected, it meant that the child was on the treadmill. Colour Detection (CD): CD detected colour from the video image by retrieving still images frame by frame and getting the colour value from each pixel to compare. RGB or HSV colour code was used for comparing. If colour from the video image matched with pre-determined colour such as the colour of the child’s clothes, it meant that the child was on the treadmill. QR Code Detection (QCD): QCD detected the QR Code generated from wanted message. If the algorithm detected the QR Code, data was read and compared to the prepared data. If prepared data matched with data from the QR Code on the child’s clothes, it meant that the child was still on the treadmill. Motion Detection (MD): MD detected motion or movement by defining initial frame as a reference frame for comparing to the current frame. If the difference was more than the defined threshold, it meant there was motion and the child was still on the treadmill. Adaptive Video Interaction (AVI): AVI used a mobile camera as the interaction between autistic children and applications or games on mobile devices. There were three sub-techniques combined in this type of interaction: 1) Face Detection, 2) Upper Body Detection, and 3) Motion Detection. AVI technique can automatically switch detection technique from Face Detection to Upper Body Detection or Motion Detec- tion in the case that facial features and upper body were not detected as shown in Fig. 2. Fig. 1. The overview of five methods of presence detection for autistic children 138 http://www.i-jim.org Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... Fig. 2. overview of Adaptive Video Interaction (AVI) of presence detection for ASD Children 3.2 System architecture design Architecture design of exercise application for autistic children on treadmill con- sists of three parts - treadmill, iPhone/iPad and speaker. The iPhone/iPad was placed in front of the treadmill to detect the child’s face and body, and the speaker is used to make the sound from iPhone/iPad louder so that the child can hear better as show in Fig. 3. Fig. 3. The Architecture Design The system involves a user, a caretaker and an expert. The user is an autistic child, who would run on a treadmill with an interaction with the application. The care taker can see the report of the child’s exercise, and the expert, assisting the care taker to improve the child’s behavior, can monitor the exercise, give comments or advises arising during the session, and see the report. iJIM ‒ Vol. 14, No. 14, 2020 139 Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... The experimental place needed to be sealed, quiet, without any distractions, se- cured, and sufficiently bright. According to Fig. 3, iPhone/iPad could only be placed in front of the autistic child, so that the FD or UBD could be employed. The speakers should be placed near the child so that s/he could hear the counting clearly, which would encourage him/her to run for a distance indicated by an expert. 3.3 Graphic user interface design Graphic User Interface (GUI) was universally designed so it can be used on both iPhone and iPad. GUI displayed two parts. The first one was the time or the counting number, indicating the goal s/he had to achieve. The speaker was used to let the child know how long s/he had to run. The second part was the video showing the child’s face or any other pictures or objects that s/he likes to encourage him/her to run. This is shown in Fig. 4. Fig. 4. The Graphic User Interface of ASD’s EX Application 4 Results 4.1 Application development The test application was developed on the iOS 10.3 platform using the Open CV library for camera management and used still images or videos to stimulate the child’s interest. The developed application can gather each individual child’s information, which can be adjusted to give the most suitable monitor for each child. Moreover, the application can also carry out the personal report which the caretaker and an expert 140 http://www.i-jim.org Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... can use to revise the activity plan. The application was tested on an iPhone 6 and iPad mini 4 as shown in Fig. 5. 4.2 Application testing The application was tested with eight autistic children (all male) from Special Edu- cation Division (Autistic Research Centre), Khon Kaen University Demonstration School as shown in Fig. 6. Fig. 5. The User Interface of ASD’s EX Application Fig. 6. Testing ASD’s EX Application The samples consisted of eight children aged between 7 to 12. The experts and care takers designed the study plan for the children. The duration of the tests was one se- mester and was part of the physical education class. Each autistic child must be tested in six techniques for 30 minutes per session and not less than 12 sessions (an average of two sessions for each technique). The accuracy of all six techniques was evaluated by the professional who took care of the autistic children. The test results are shown in Table 1. iJIM ‒ Vol. 14, No. 14, 2020 141 Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... Table 1. Performance of Six Interaction Techniques No. Evaluation Items Number of Undetect- able (by application) Number of actual disappearing (ob- served by expert) Accuracy rate 1 Face Detection (FD) 16 11 54.55% 2 Upper Body Detection (UBD) 20 13 46.15% 3 Color Detection (CD) 26 16 37.5% 4 QR Code Detection (QCD) 19 10 10% 5 Motion Detection (MD) 12 14 85.71% 6 Adaptive Video Interaction (AVI) 14 13 92.31% From Table 1, FD and UBD were used to detect facial and bodily parts, so the ad- ditional equipment was not required. Regarding CD technique, the color to be detect- ed had to differ from the surrounding so that it would function the most accurately. In the experiment, the children were asked to wear a shirt of a specific color to be de- tected. QCD used QR Code attached on the children’s shirt where it could be clearly detected by a camera. MD made use of movement detection technique, which re- quired reference frame where there was no child. After setting the frame, the child was asked to get on the treadmill and started running. As for AVI, no additional equipment was required. Instead, FB, UBD, and MD were mutually utilized to detect whether the child was still on the treadmill. Table 1 shows that AVI gains the highest accuracy rate (92.31%), with MD at 85.71%, FD at 54.55%, and QCD at 10%, respectively. Fig. 7 illustrates that, in most techniques, there are more number of undetectable (by application) than the number of actual disappearing (observed by expert). Howev- er, MD is the only techniques with less number of undetectable (by application). This is because MD detects the movement, which possibly allows errors to occur. For instance, when a child leaves the treadmill and the MD cannot detect his/her absence due to the insufficient lighting or unsuitable environment. Fig. 7. Six interaction techniques results 142 http://www.i-jim.org Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... The result from Table 1 can summarize whether each of the six techniques can be used with autistic children or not. As shown in Table 2, MD and AVI were found to be suitable for autistic children while FD, UBD, CD and QCD were not. Table 2. Conclusion of Six Interaction Techniques Testing No. Evaluation Items Useable Remark 1 Face Detection (FD) / It could be used with only some children because some do not look at the camera while testing, making facial features undetectable 2 Upper Body Detection (UBD) / It could be used with only some children because some children do not look at the camera and constantly turn around, making bodily parts undetectable 3 Color Detection (CD) X It could not be used because insufficient light- ing in the test environment resulted to noise and color error, making detection ineffective 4 QR Code Detection (QCD) X It could not be used because some children rejected to attaching unfamiliar objects onto their body and QR Codes cannot be used from a long distance 5 Motion Detection (MD) / It could be effectively used, but it could not actually detect children’s presence 6 Adaptive Video Interac- tion (AVI) / It could be effectively used According to Table 2, QCD technique is least suitable for children with autism, for QR Code is difficult to be detected from a distance. CD slightly outperforms QCD because it detects the shirt’s color. However, insufficient lighting in the test environ- ment results in noise and color error, making detection ineffective. QCD and CD face the same problem. That is, some children refused to put QR Code on their shirt or did not want to wear the shirt provided. FD and UBD are suitable only for some children who look at the camera and do not turn to their left or right (stay focus). MD works fairly well, but it could not actually detect children’s presence. Finally, AVI is the most suitable technique for children with autism. It combines advantages from FD, UBD, and MD, so it performs better detection and accurately detect the presence of the children on the treadmill. 5 Expert Opinions The experts studied these six techniques during the experiment sessions. After they observed and analyzed all autistic children, all of them prefer the AVI technique since it is the most accurate way to interact with autistic children. The experts said they could rely on the AVI technique and allowed caretaker to handle multiple children at the same time. In addition, the great value from the results in the system’s reports could help the experts adapt the study plan individually for each child. The reports revealed some significant information such as time recording of presence and absence iJIM ‒ Vol. 14, No. 14, 2020 143 Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... that leaded to study plan adjustment. In short, the experts strongly believed that sys- tem could help monitoring, logging, analyzing, and planning the physical activity for autism children. 6 Discussion Using the camera to interact with autistic children is an appropriate technique since the study of autistic children’s behaviours’ shows that some interaction regularly used by normal people are not effective with autistic children as they cannot understand what they are instructed to perform. For instance, some children can use touch inter- action but cannot understand the meaning, making them randomly touch the device. Therefore, effective patterns of interaction for these children must be based on their bio-information (heart rate, blood pressure or body temperature), actions and move- ments. According to the results of the experiment, camera-based interaction and proper techniques work well with autistic children. However, the key factor in this research is the behaviours of children with autism, and the aim is to deal with unwanted behav- iours. According to the experiments, while face detection, upper body detection, col- our detection and QR code detection techniques worked well with normal people, the results are opposite with autistic children because some of them were hyperactive and kept turning left and right or back and forth, which prevented the detection to function properly. In addition, in the experiments where colour detection and QR code detec- tion techniques were used, it was required to stick extra accessories on the autistic children (coloured paper, QR code), but some of the children did not like it and thus removed it from their bodies. It is discovered that interaction using external physical features was the most attractive option for autistic children. In fact, MD technique perfectly works by using reference frame comparing to cur- rent frame. The movement is detectable if their difference is more than the defined threshold. Since the problem of MD technique is that human presence at defined posi- tion cannot be detectable, this study presents how to improve reliability of MD tech- nique by using FD and UBD techniques. Therefore, in this paper, we have proposed Adaptive Video Interaction (AVI) method. In designing this interaction, we aimed to adjust the interaction patterns for autistic children, to increase their concentration and focus on running as much as possible so as to reduce the burden on caretakers. While AVI uses cameras to interact like other techniques tested in this research, it combines Face detection, Upper body detection and Motion detection techniques to work together and additionally uses stimulus techniques to attract attention of autistic children to be on the treadmill as long as possible, which gives better results than using Face detection or Motion detec- tion techniques alone. The outcome is that most of the autistic children had more concentration and could stay on the treadmill longer. In addition, AVI also uses counting support techniques to help children with autism count the numbers they were instructed to run. In the normal running process without using the application, there must be a caretaker to help the children count until they reach the target numbers. The 144 http://www.i-jim.org Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... counting support techniques can help the children to count numbers without the su- pervision of caretakers. This research will be greatly useful for children with autism, teachers and caretakers both in the classroom and at home. In addition, access to the application is easy and free. 7 Conclusion In this study, six mobile camera interaction techniques were used to support autis- tic children in physical education class. They include: 1) Face Detection, 2) Upper Body Detection, 3) Color Detection, 4) QR Code Detection, 5) Motion Detection, and 6) Adaptive Video Interaction (AVI). These techniques were developed for the ASD’s EX iOS application and installed on an iPhone 6 and iPad mini 4. The application was tested on eight autistic children from Special Education Division (Autistic Research Centre), Khon Kaen University Demonstration School. The results show that the AVI technique is the most suitable interaction. The re- sults from this study confirms and extends the findings of prior research [16], [18], providing additional empirical evidence that AVI does have a strong potential to im- prove attention in autistic children and reduce the tasks of caretakers. 8 Future Work For further development, more motion detection devices such as smart watches or activity tracking devices should be added in order to improve the accuracy of chil- dren’s activity detection as well as to collect bio-information such as heart rate for further analysis. The experts will analyze the data and create a lesson plan to suit each child to en- courage them to stay more concentrate. 9 Acknowledgement The authors would like to thank Special Education Division (Autistic research Cen- tre), Khon Kaen University Demonstration School, for their collaboration in this study. 10 References [1] A. M. Egan, M. L. Dreyer, C. C. Odar, M. Beckwith, and C. B. Garrison, “Obesity in young children with autism spectrum disorders: Prevalence and associated factors,” Child. Obes., vol. 9, no. 2, pp. 125–131, 2013, https://doi.org/10.1089/chi.2012.0028. [2] C. Anderson et al., “Occurrence and family impact of elopement in children with autism spectrum disorders,” Pediatrics, vol. 130, no. 5, pp. 870–877, 2012, https://doi.org/10.15 42/peds.2012-0762d. iJIM ‒ Vol. 14, No. 14, 2020 145 https://doi.org/10.1089/chi.2012.0028 https://doi.org/10.1542/peds.2012-0762d https://doi.org/10.1542/peds.2012-0762d Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... [3] E. Barakova, G. Van Wanrooij, R. Van Limpt, and M. Menting, “Using an emergent sys- tem concept in designing interactive games for autistic children,” in Proceedings of the 6th international Conference on Interaction Design And Children, IDC 2007, 2007, pp. 73–76, https://doi.org/10.1145/1297277.1297291. [4] E. Barakova, J. Gillesen, and L. Feijs, “Use of goals and dramatic elements in behavioral training of children with ASD,” 2008, pp. 37–40, https://doi.org/10.1145/1463689.14637 13. [5] A. Peca et al., “Robot Enhanced Therapy for Children with Autism Disorders: Measuring Ethical Acceptability,” IEEE Technol. Soc. Mag., vol. 35, no. 2, pp. 54–66, 2016, https:// doi.org/10.1109/mts.2016.2554701. [6] E. I. Barakova, “Robots for social training of autistic children,” Proc. 2011 World Congr. Inf. Commun. Technol. WICT 2011, no. December 2011, pp. 14–19, 2011, https://doi.org/ 10.1109/wict.2011.6141197 [7] J. Muchagata and A. Ferreira, “Visual schedule: A mobile application for autistic children - Preliminary study,” ICEIS 2019 - Proc. 21st Int. Conf. Enterp. Inf. Syst., vol. 2, pp. 452– 459, 2019, https://doi.org/10.5220/0007732804520459. [8] A. Khan, K. Li, and J. Madden, “Mobile Aid to Assist with Care Decisions in Children with Autism Spectrum Disorder (ASD),” J. Healthc. Eng., vol. 2018, p. 9703101, 2018, https://doi.org/10.1155/2018/9703101. [9] J. A. Vlachou and A. S. Drigas, “Mobile technology for students & adults with Autistic Spectrum Disorders (ASD),” Int. J. Interact. Mob. Technol., vol. 11, no. 1, pp. 4–17, 2017, https://doi.org/10.3991/ijim.v11i1.5922. [10] N. Heni and H. Hamam, “Design of emotional educational system mobile games for autis- tic children,” in 2nd International Conference on Advanced Technologies for Signal and Image Processing, ATSIP 2016, 2016, pp. 631–637, https://doi.org/10.1109/atsip.2016.752 3168. [11] N. M. Rani, R. Legino, N. Mudzafar, and M. F. Kamaruzaman, “Embedded visual sched- ule application towards autistic children development: A prelimenary study,” in ICEED 2014 - 2014 IEEE 6th Conference on Engineering Education, 2014, pp. 129–132, https:// doi.org/10.1109/iceed.2014.7194701. [12] Z. Mahayuddin and N. Mamat, “Implementing Augmented Reality (AR) on Phonics-based Literacy among Children with Autism,” Int. J. Adv. Sci. Eng. Inf. Technol., vol. 9, p. 2176, 2019, https://doi.org/10.18517/ijaseit.9.6.6833. [13] I. Damyanov and N. Tsankov, “Mobile apps in daily learning activities,” Int. J. Interact. Mob. Technol., vol. 12, no. 6, pp. 133–140, 2018, https://doi.org/10.3991/ijim.v12i6.9659. [14] C. Papoutsi, A. Drigas, and C. Skianis, “Mobile applications to improve emotional intelli- gence in Autism - A review,” Int. J. Interact. Mob. Technol., vol. 12, no. 6, pp. 47–61, 2018, https://doi.org/10.3991/ijim.v12i6.9073. [15] M. Roglic, V. Bobic, M. Djuric-Jovicic, M. Djordjevic, N. Dragasevic, and B. Nikolic, “Serious gaming based on Kinect technology for autistic children in Serbia,” in 2016 13th Symposium on Neural Networks and Applications, NEUREL 2016, 2016, pp. 1–4, https:// doi.org/10.1109/neurel.2016.7800105 [16] L. Bartoli, F. Garzotto, M. Gelsomini, L. Oliveto, and M. Valoriani, “Designing and Eval- uating Touchless Playful Interaction for ASD Children,” in Proceedings of the 2014 Con- ference on Interaction Design and Children, 2014, pp. 17–26, https://doi.org/10.1145/2593 968.2593976. [17] F. Garzotto, M. Gelsomini, L. Oliveto, and M. Valoriani, “Motion-based touchless interac- tion for ASD children: A case study,” in Proceedings of the Workshop on Advanced Visu- al Interfaces AVI, 2014, pp. 117–120, https://doi.org/10.1145/2598153.2598197. 146 http://www.i-jim.org https://doi.org/10.1145/1297277.1297291 https://doi.org/10.1145/1463689.1463713 https://doi.org/10.1145/1463689.1463713 https://doi.org/10.1109/mts.2016.2554701 https://doi.org/10.1109/mts.2016.2554701 https://doi.org/10.1109/wict.2011.6141197 https://doi.org/10.1109/wict.2011.6141197 https://doi.org/10.5220/0007732804520459 https://doi.org/10.1155/2018/9703101 https://doi.org/10.3991/ijim.v11i1.5922 https://doi.org/10.1109/atsip.2016.7523168 https://doi.org/10.1109/atsip.2016.7523168 https://doi.org/10.1109/iceed.2014.7194701 https://doi.org/10.1109/iceed.2014.7194701 https://doi.org/10.18517/ijaseit.9.6.6833 https://doi.org/10.3991/ijim.v12i6.9659 https://doi.org/10.3991/ijim.v12i6.9073 https://doi.org/10.1109/neurel.2016.7800105 https://doi.org/10.1109/neurel.2016.7800105 https://doi.org/10.1145/2593968.2593976 https://doi.org/10.1145/2593968.2593976 https://doi.org/10.1145/2598153.2598197 Paper—Design and Implementation of Interactive Mobile Application for Autistic Children in Physical... [18] L. Bartoli, C. Corradi, F. Garzotto, and M. Valoriani, “Exploring Motion-Based Touchless Games for Autistic Children’s Learning,” in Proceedings of the 12th International Confer- ence on Interaction Design and Children, 2013, pp. 102–111, https://doi.org/10.1145/2485 760.2485774 [19] A. Shapi’i, N. A. A. Rahman, M. S. Baharuddin, and M. R. Yaakub, “Interactive games using hand-eye coordination method for autistic children therapy,” Int. J. Adv. Sci. Eng. Inf. Technol., vol. 8, no. 4–2, pp. 1381–1386, 2018, https://doi.org/10.18517/ijaseit.8.4- 2.6793. [20] S. Reisi Dehkordi, M. Ismail, and N. Mat Diah, “A Review of Kinect Computing Research in Education and Rehabilitation,” Int. J. Eng. Technol., vol. 7, no. 3.15, p. 19, 2018, https://doi.org/10.14419/ijet.v7i3.15.17399. [21] U. Lahiri, Z. Warren, and N. Sarkar, “Design of a gaze-sensitive virtual social interactive system for children with autism,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 19, no. 4, pp. 443–452, Aug. 2011, https://doi.org/10.1109/tnsre.2011.2153874. [22] J. Pipitpukdee and W. Phantachat, “The Study of the pet robot therapy in Thai Autistic children,” in i-CREATe 2011 - International Convention on Rehabilitation Engineering and Assistive Technology, 2011, pp. 219–222. 11 Authors Pitsanu Chaichitwanidchakol is a PhD student at the Faculty of Engineering (Computer Engineering), Khon Kaen University. He received a B.Eng. and M.Eng. degree in computer engineering from Khon Kaen University, Thailand in 2010 and 2012 respectively. He has published many publications in the area of Human Com- puter Interaction, Video Game Design and Ubiquitous Computing. Witcha Feungchan is an assistant professor at the Faculty of Engineering (Com- puter Engineering), Khon Kaen University, Khon Kaen, 4002, Thailand. where he has been a faculty member since 2002. He completed his Ph.D. in electronic systems engineering at the University of Regina, Canada in 2009. He has made contributions to many publications in the areas of Video Games Design, Serious Games, Ubiquitous Computing, Virtual Reality, and Educational Technology. Witcha has also collaborat- ed actively with multidisciplinary teams in engineering, computer science, and educa- tion. Article submitted 2020-05-09. Resubmitted 2020-06-26. Final acceptance 2020-06-26. Final version published as submitted by the authors. iJIM ‒ Vol. 14, No. 14, 2020 147 https://doi.org/10.1145/2485760.2485774 https://doi.org/10.1145/2485760.2485774 https://doi.org/10.18517/ijaseit.8.4-2.6793 https://doi.org/10.18517/ijaseit.8.4-2.6793 https://doi.org/10.14419/ijet.v7i3.15.17399 https://doi.org/10.1109/tnsre.2011.2153874