International Journal of Interactive Mobile Technologies(iJIM) – eISSN: 1865-7923 – Vol 16 No 11 (2022) Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy Delphi Approach https://doi.org/10.3991/ijim.v16i11.30063 Farah Mohamad Zain(), Siti Nazuar Sailin, Marini Kasim, Abdul Malek Abdul Karim, Nurfarah Najlaa Zameri School of Education, Universiti Utara Malaysia, Kedah, Malaysia mz.farah@uum.edu.my Abstract—The use of augmented reality as a teaching aid among teachers is becoming more widespread. So, it is a must to create a holistic framework of aug- mented reality in order to enhance the teaching and learning context. Therefore, the purpose of this study is to develop an augmented reality immersive learning design (AILeaD) framework by using the Fuzzy Delphi Technique. The objective of this research is to gain experts’ consensus in building and identifying constructs and elements as well as their place in the AILeaD framework. The Fuzzy Delphi Tech- nique is used as a systematic method to evaluate, verify as well as to make a deci- sion in modifying all needed constructs and elements in order to create the AILeaD framework through the consensus of the experts. The research questionnaire is divided into three sections which are technology skills, instructional designs and type of augmented reality applications in a total of 36 items and using the Likert-7 point scale. The sample of this research consists of 10 experts from educational technology, teaching technology, augmented reality and model development. The finding showed that the experts agreed and approved all of the constructs and ele- ments where the three conditions were fulfilled which are the item value is less than or same with the threshold value (d) < 0.2, experts’ consensus percentage exceeded 75% and defuzzification value per item exceeded α-cut = 0.5. This study could contribute to the educational policy that focuses on the development of teaching quality with the improvement of existing skills among educators through the inno- vation and utilization of technology in the teaching and learning context. This is in line with Malaysia Education Blueprint known as Shift 7 (2013–2025) where it leverages the utilization of ICT to enhance the quality of education in Malaysia. The implication of this study is to make the AILeaD framework as a guideline for teachers, lecturers and instructional designers in producing the teaching aids in accordance with augmented reality and taking Gagne Nine Events, Cognitive Theory of Multimedia Learning dan Revised Bloom Taxonomy into account. Keywords—augmented reality, Fuzzy Delphi, immersive learning experiences, instructional design 1 Introduction An immersive learning experience is a meaningful learning environment where stu- dents are involved actively and acknowledge the content studied either in a simulation iJIM ‒ Vol. 16, No. 11, 2022 65 https://doi.org/10.3991/ijim.v16i11.30063 mailto:mz.farah@uum.edu.my Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… context or real-life situation [1]. Immersive learning could be implemented through online learning or the combination of online and face to face learning supported by the technology [2]. For instance, the usage of MOOC, simulation, augmented reality, virtual reality, live classroom, digital gamification and many more could give a huge impact on the students’ experience, knowledge and skill [3]. It is in line with the Education 4.0 in Malaysia, a new learning system that enables students to develop lifelong learning and skills [4]. Therefore, educators need to be prepared to innovate in teaching and strengthen their teaching methods and strategies. However, the current scenario shows that the technological efficiency and innovation of teaching are still at a moderate level. Augmented reality (AR) is a virtual reality technology that allows users to inter- act with the virtual object in real life [5]. AR also defined as an interactive tool and medium that connects digital information with the real world [6]. [7] described AR as a technology that overlays an image generated by the computer on a users’ view of the real world. Also, AR can be interpreted as a valuable educational tool and has a great potential for future learning in generating students’ creative thinking [8]. For instance, AR allows teachers to integrate technology as a teaching aid throughout the teaching and learning process. According to [9], there are seven AR characters that can be used as a guideline for teachers in developing augmented reality which is a substitute for an existing object, assist in explaining the process, simulation aid, gain attention, describe the abstract, explain the concept of space and a replacement for an experiment. The result of his study showed positive feedback and the teachers involved acknowledged that AR is suitable to be used as a teaching medium. Nevertheless, the usage of AR is still new among teachers especially in Malaysia and need some time for them to apply it in the teaching and learning process [3]. The previous studies shown the advantages and benefits of using AR in education. Among them is being able to increase the students’ motivation [10]–[12], improve academic performance [13], enhance cognitive development [14], promote student engagement [15], learning experience [16, 17] and as one of the teaching strategies [18]. Moreover, AR could improve the quality of education [12, 19]. According to [20], AR could help students to enhance their focus through fun activities and immersive experiences. However, the production process, guidelines to construct AR as well as the elements that need to be considered during the development of AR which could give benefits in the education field are still not fully explored. AR could be developed in various materials. Among them is the use of AR applica- tion using textbook [10, 11], mobile learning [21, 12, 22, 13, 23, 17], interactive book [14, 16], games application [24, 15]. This is in line with the study conducted by [25], who explained that the type of materials applied in the trend of AR application used between 2016 and 2017 were more to mobile applications, marker-based, AR books as well as gaming applications. A study by [26] also says that the use of marker-based is more frequently applied using AR. Therefore, educators’ knowledge of the types of AR applications helps them to adapt to the innovation in teaching and learning. 1.1 Instructional design Past research on AR seem to emphasise the Cognitive Theory of Multimedia Learning (CTML) as a design element, Gagne Nine Events as systematic planning and Revised Bloom Taxonomy for developing students’ HOT skills. However, there is still 66 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… no study that combines the three instructional designs in developing AR. According to [27], the Gagne Nine Events could give valuable information to educators because the nine steps emphasized by Gagne are the best way to produce a systematic, struc- tured and holistic teaching and learning context. Furthermore, Gagne Nine Events is flexible because educators can modify the order of the events in accordance with the needs of their respective subjects to achieve the learning objectives [28]. These events could also be applied in both synchronous and asynchronous ways [29] and is suitable for activities that stimulate the visual, auditory, verbal and kinesthetic [30]. However, there is limited research on the usage of Gagne Nine Events during the development of AR. By combining these events, educators could produce an AR that is designed in accordance with the accurate teaching arrangement to retain the learning experience for students. Table 1 shows Gagne’s Nine Events of Instruction. Table 1. Gagne’s nine events of instruction Instructional Event Description Gain Attention Provide stimulus to ensure reception of coming instruction. Inform learners of objectives Telling learners what they will be able to do following the lesson. Stimulate recall of prior learning Asking for recall of existing prior knowledge. Present the stimulus Provide and displaying the content. Provide learning guidance Supplying information relevance to enhance understanding. Elicit performance Asking to respond to the demonstrating learning. Provide feedback Providing immediate feedback on learner’s performance. Assess performance Giving feedback to learner’s additional performance for reinforcement. Enhance retention and transfer Providing various practice to generalize the capability. There are 12 principles suggested by CTML to create the effective multimedia instruction [31]. Previous researchers pointed out that a well planned and developed AR that incorporated with the principles in CTML will produce effective AR content for the students and reduce the students’ cognitive load. [32] focused on four CTML prin- ciples in developing AR which are (a) multimedia principle (overlaying printed texts with virtual pictorial content or, vice versa, by augmenting physical objects with virtual texts), (b) spatial and temporal contiguity (superimposing virtual content onto physical objects in real-time and thereby spatially and temporally aligning related physical and virtual information), (c) modality principle (playing spoken text, instead of displaying printed text, when recognizing a trigger event), (d) signalling principle (AR can imple- ment signalling by directing and guiding people through learning environments using geographic location information and visual triggers). The result showed that the use of AR-based on CTML produces a lower cognitive effort towards the students compared to the use of traditional computer technology. [33] also applied CTML in building the Augmented Reality Learning Environment (ARLE) where two principles were used, multimedia principle (Real object replaces the picture) and spatial and temporal con- tiguity (Virtual text and symbol replace the words). CTML provides a learning theory of how real-world annotation by AR can help students learn better based on human cognition and related processes in the brain. [34] only used the principle of modality iJIM ‒ Vol. 16, No. 11, 2022 67 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… in CTML as a foundation in cultivating the AR because this principle influences the students’ cognition where auditory and visual could be used at the same time. [10] on the other hand, used CTML as a basis in designing a presentation to deliver e-STAR content to students. The five principles emphasized in developing e-STAR are spatial contiguity principle, temporal contiguity principle, coherence principle, modality principle and redundancy principle. [35] used CTML in the content design where two principles were highlighted which are the Spatial Contiguity Principle dan the Coherence Principle. This showed the importance of CTML in developing AR espe- cially in designing AR content to ensure that students’ cognitive is not burdened as well as certifying that the AR design is more effective and has a great impact on students. However, not all principles in CTML can be applied in developing AR as shown in previous studies. The use of CTML principles in developing AR depends on learning objectives, learning outcomes, learning content and the suitability of multimedia mate- rials [36]. Table 2 shows a summary of the use of CTML in developing AR. Table 2. Summary of the use of CTML in developing AR Authors Cognitive Theory of Multimedia Learning [32] multimedia principle spatial and temporal contiguity modality principle signaling principle [33] multimedia principle spatial contiguity [34] prinsip modality [10] spatial contiguity principle temporal contiguity principle coherence principle modality principle redundancy principle [35] Spatial Contiguity Principle Coherence Principle Revised Bloom Taxonomy [37] combines two dimensions which are knowledge dimensions (factual, conceptual, procedural, meta-cognitive) with cognitive dimensions (remember, understand, apply, analyze, evaluate, create). It is widely used to classify learning activities according to learning objectives, analyze the syllabus, the relation- ship between assessment and learning activities or review teaching materials [38]. [39] in their study on playful and interactive environment-based augmented reality used five domains in Bloom Taxonomy which are knowledge, comprehension, application, anal- ysis and synthesis while developing AR and performing self-evaluation for the content. 1.2 Research objectives The purpose of this study is to build an AILeaD framework using the Fuzzy Delphi Technique. Therefore, the objectives of this study are (a) to validate the constructs and 68 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… elements of the AILeaD framework based on experts’ consensus, (b) to identify the position of construct and element of the AILeaD framework based on expert agreement. 2 Research methodology In this study, the Fuzzy Delphi Technique was used as a systematic method to decide on the constructs and elements required in developing the AILeaD framework through the experts’ consensus. 2.1 Sample of the study The number of experts for the Fuzzy Delphi Technique is between 10 to 15 experts [40]. Hence, there are 10 experts for the sample of this study which consists of 4 educational technology experts, 2 teaching technology experts, 3 AR experts and 1 model devel- opment expert. The criteria of selecting the experts are very important because the experts are responsible for viewing, evaluating and validating the constructs and ele- ments used in the AILeaD framework. The constructs and elements are very important for the improvement based on the consensus of the experienced experts before they can be used. Ergo, the selection criterias for the experts in this study are the experts in the field of AR, the experts in the field of teaching technology, the experts in the field of educational technology and the experts in model development with five years of experi- ence in the field of education. According to [41], those who have served between five to ten years are categorized as specialists because they have undergone a continuous pro- cess of teaching and administrative management. Table 3 shows the selected panel of experts who are involved in providing recommendations and validations of constructs and elements in the AILeaD framework. Table 3. List of expert Category Item Frequency Gender Male 7 Female 3 Teaching Experience 5–8 years 2 9–12 years 3 13–16 years 1 More than 16 years 4 Expertise Educational technology 4 Teaching technology 2 Augmented reality 3 Model development 1 Institution Universiti Utara Malaysia 4 Universiti Kebangsaan Malaysia 2 Universiti Sains Malaysia 3 Universiti Sultan Zainal Abidin 1 iJIM ‒ Vol. 16, No. 11, 2022 69 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… 2.2 Research instrument The questionnaire was used in this study to get the quantitative data. The utilization of questionnaires fulfils the condition and criteria of the Fuzzy Delphi Technique which is involving the usage of mathematical formulas to get the experts’ consensus. The instrument of this study was developed based on the previous study, namely technology skill instrument, adapted and modified by [42] that consists of 10 items while instruc- tional design instrument adapted and modified by [43, 31] that consists of 20 items. As for the types of AR application instrument, it was adapted and modified by [44] that consists of 6 items. This study used Likert-7 Point Scale and it was divided into 2 parts which are construct and element. In the first part, the experts were asked whether they agreed with the constructs in developing AILeaD (technology skills, instructional design and types of augmented reality applications). In the second part, the experts were asked whether they agreed with the elements in each construct. For example, in technology skills constructs, the elements listed and submitted to the experts are the skills of developing video, animation, graphics, programming, 3D models and audio. 2.3 Validity and reliability of the instrument Four experts were appointed to validate the research instruments which are two senior lecturers from Universiti Sains Malaysia and two senior lecturers from Universiti Utara Malaysia. During this process, comments, suggestions and corrections were advised by the experts in revising the puzzling words, some content items and certain sentences. 2.4 Design and development procedure of AILeaD framework Figure 1 shows the design and development procedures of the AILeaD framework. The first step is to develop and build the constructs and elements of the AILeaD frame- work based on the literature review. There are three existing theories that underlies this study which are CTML [31], Gagne’s Nine Events of Instruction [43] and Revised Bloom Taxonomy [37]. Based on the literature review, 8 out of 9 Gagne events were adapted in this framework namely gain attention, inform learners of objectives, stim- ulate recall of prior learning, present the stimulus, provide learning guidance, elicit performance, provide feedback and assess performance. As for the CTML, this study takes five principles into account, namely signalling principle, coherence principle, redundancy principle, contiguity principle and pre-training principle to reduce extra- neous processing and manage essential processing while developing AR. Finally, this study also refers to the Revised Bloom Taxonomy when developing AR to ensure that the task/assessment given are in line with the objectives/learning outcomes and the learning materials presented are designed according to low-level thinking (remember, 70 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… understand, apply) to high-level thinking (analyze, evaluate, create). The second step is the validation of constructs and elements based on experts’ consensus through the Fuzzy Delphi Technique. This method is based on the consensus of qualified experts in the field to ensure the validity of the information obtained [45]. The finding from Step 2 will form the AILeAD framework that can be used as a guideline in developing quality and effective AR for teaching and learning aids. Literature review Step 1 Development of Constructs and Elements Step 2 Fuzzy Delphi Technique Verification based on the experts’ consensus Design and Development of AILeaD Framework Fig. 1. Design and development of AILeaD framework 2.5 Fuzzy Delphi Technique This study analysis uses the Fuzzy Delphi Technique which is based on the thresh- old value (d) measured must be less than or equal to 0.2 [46, 47], the percentage of experts’ consensus must be more than or equal to 75% [48, 49] and defuzzification value exceeded alpha-cut = 0.5. The analysis was performed according to the fol- lowing steps: Step Process Step 1 Selection of linguistic scale. This study chooses a seven-point linguistic scale and Table 4 shows the conversion of the linguistic scale to fuzzy number. Table 4. Seven-point Linguistic scale Linguistic Scale Fuzzy Number m1 m2 m3 Strongly agree 0.90 1.00 1.00 Agree 0.70 0.90 1.00 Moderately agree 0.50 0.70 0.90 Slightly agree 0.30 0.50 0.70 Slightly disagree 0.10 0.30 0.50 Disagree 0.00 0.10 0.30 Strongly disagree 0.00 0.00 0.10 iJIM ‒ Vol. 16, No. 11, 2022 71 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Step 2 To overcome the issue of fuzziness among experts, three fuzzy values are given to form a triangular fuzzy number where m1 is the minimum value, m2 is the medium value and m3 is the maximum value. These three values can be seen in Figure 2 which is a mean triangle graph against triangular value. Fig. 2. Mean triangle graph against triangular value Step 3 Calculate and obtain the average value of a fuzzy number by identifying the average response for each fuzzy number [50]. Step 4 Identify the threshold value (d). To measure the consensus of the expert groups, the result of threshold value (d) must be less than or equal to the value of 0.2 [47]. The determination of this threshold value (d) is based on the following formula: d M m M m M m M m( , ) ( ) ( ) ( ) .� � � � � � 1 3 1 2 2 2 3 21 2 3 Step 5 Identify the percentage of experts’ agreement. The percentage value of experts’ agreement must be more than or equal to 75% [51]. Step 6 Identify alpha-cut levels. The value of α—cut is equal to 0.5 because the fuzzy number range is between 0 and 1 [52]. If the value of α—cut is less than 0.5, then the measured item is rejected based on expert agreement. If the value of α—cut is equal to 0.5 and above, then it is accepted based on expert agreement. Step 7 The defuzzification process is the process of determining the position or priority of each item or determining the position of each construct or element [53]. The determination of this value is based on the following formula: A m m m� � � �( ) ( )1 3 1 2 3 The element that obtained the highest score value was considered to be in the first position [54]. The researchers use the coded Microsoft Excel Program to get the threshold value (d), percentage of experts’ consensus and defuzzification value. The Likert Scale data gained from the experts were keyed in the Excel template and the step 1 until step 7 gained using the Microsoft Excel program (Figure 3). 72 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Fig. 3. Microsoft excel program 3 Finding 3.1 Construct for AILeaD The acceptance of construct for AILeaD must meet three conditions which are thresh- old value (d) is smaller than or equal to 0.2, experts’ consensus percentage exceeds 75% and alpha-cut value is equal to or greater than 0.5. The analysis shows that the threshold value (d) for constructs A1, A2 and A3 is smaller than 0.2. According to [55], the average value and expert rating are less than the threshold value of 0.2, so the item has obtained expert approval. The percentage of experts’ consensus on each item also exceeds 75%, namely A1 (90%), A2 (90%) and A3 (90%). According to [48], each item is considered to reach expert agreement when its percentage is equal to or higher than 75%. All defuzzification values for each item also exceeded the α-cut = 0.5 value. Overall, items A1, A2 and A3 in the AILeaD construct meet the above three conditions and are agreed and accepted by the experts. Table 5 shows the overall finding. Table 5. Construct for AILeaD Expert Construct A1 A2 A3 Expert 1 (Educational Technology) 0.084 0.099 0.114 Expert 2 (Educational Technology) 0.084 0.099 0.114 Expert 3 (Educational Technology) 0.071 0.056 0.041 Expert 4 (Educational Technology) 0.071 0.056 0.041 Expert 5 (Instructional Technology) 0.084 0.056 0.041 Expert 6 (Instructional Technology) 0.309 0.295 0.281 Expert 7 (Augmented Reality) 0.071 0.056 0.041 Expert 8 (Augmented Reality) 0.084 0.099 0.114 Expert 9 (Augmented Reality) 0.084 0.099 0.114 Expert 10 (Model Development) 0.084 0.099 0.114 d value of each item 0.103 0.101 0.094 Threshold value (d) of construct 0.129 (Continued) iJIM ‒ Vol. 16, No. 11, 2022 73 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Expert Construct A1 A2 A3 Percentage of experts’ consensus on each item 90% 90% 90% Average experts’ consensus percentage of all items 82% Percentage of all items defuzzification (alpha-cut) 0.910 0.900 0.890 Ranking 1 2 3 The items agreed upon by the experts were rearranged according to the rank, from highest to lowest as shown in Table 6. A1 refers to the basic skills required by each teacher in developing augmented reality. Meanwhile, A2 refers to the instructional design that needs to be applied while developing augmented reality. The last item in the AILeaD construct is A3 which is the Types of AR Application. Table 6. Ranking of construct for AILeaD Contruct Rank A1: Technology skills 1 A2: Instructional design 2 A3: Types of AR Application 3 3.2 Elements for technology skills The finding from the technology skills elements meets all three conditions where the item value is less than or equal to the threshold value (d) <0.2, experts’ consensus percentage exceeded 75% and defuzzification value per item exceeded α-cut = 0.5. The first condition indicates that all of the items in the technology skills elements are (d) <0.2. While the average value is 0.110 (d <0.2) and this shows the consensus of the experts in evaluating and accepting all elements for technology skills. The second condition also has been fulfilled where the average of the experts’ consensus of all items marked at 90%, exceeding the required percentage of 75%. The third condition is all alpha—cut values for each item exceed α = 0.5. This indicates that the elements of technology skills have reached expert consensus (Table 7). Table 7. Elements for technology skills Expert Element B1 B2 B3 B4 B5 B6 B7 B8 B9 B10 Expert 1 (Educational Technology) 0.114 0.138 0.092 0.107 0.206 0.145 0.129 0.092 0.281 0.161 Expert 2 (Educational Technology) 0.041 0.031 0.061 0.046 0.079 0.015 0.027 0.061 0.111 0.093 Expert 3 (Educational Technology) 0.041 0.256 0.061 0.046 0.187 0.015 0.267 0.061 0.111 0.093 Table 5. Construct for AILeaD (Continued) (Continued) 74 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Expert Element B1 B2 B3 B4 B5 B6 B7 B8 B9 B10 Expert 4 (Educational Technology) 0.041 0.031 0.061 0.046 0.079 0.015 0.027 0.061 0.143 0.093 Expert 5 (Instructional Technology) 0.281 0.256 0.061 0.046 0.079 0.015 0.027 0.061 0.143 0.093 Expert 6 (Instructional Technology) 0.041 0.031 0.061 0.046 0.079 0.015 0.027 0.061 0.409 0.093 Expert 7 (Augmented Reality) 0.041 0.031 0.061 0.046 0.079 0.015 0.027 0.061 0.111 0.093 Expert 8 (Augmented Reality) 0.114 0.138 0.092 0.046 0.780 0.253 0.027 0.092 0.111 0.161 Expert 9 (Augmented Reality) 0.114 0.138 0.092 0.107 0.206 0.015 0.129 0.092 0.143 0.458 Expert 10 (Model Development) 0.114 0.138 0.092 0.107 0.206 0.145 0.129 0.092 0.143 0.093 d value of each item 0.094 0.118 0.073 0.064 0.198 0.065 0.082 0.073 0.170 0.157 Threshold value (d) of construct 0.110 Percentage of experts’ consensus 90% 80% 100% 100% 90% 90% 90% 100% 80% 80% Average experts’ consensus percentage of all items 90% Percentage of all items defuzzification (alpha-cut) 0.890 0.873 0.907 0.897 0.823 0.870 0.880 0.907 0.773 0.807 Ranking 4 6 1 3 8 7 5 1 10 9 All of the elements that have been agreed upon by the experts are rearranged accord- ing to the order as in Table 8. B3, B8, B4, B1, B7, B2, B6, B5, B10 and B9 are arranged from the highest to the lowest rating. Table 7. Elements for technology skills (Continued) iJIM ‒ Vol. 16, No. 11, 2022 75 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Table 8. Ranking of elements for technology skills Element Rank B1: Skilled in video editing 4 B2: Skilled in making a video 6 B3: Skilled in graphic editing 1 B4: Skilled in producing graphic 3 B5: Skilled in animation editing 8 B6: Skilled in making animation 7 B7: Skilled in audio editing 5 B8: Skilled in producing audio 1 B9: Skilled in programming (Example; C, C++, Java, Flash) 10 B10: Skilled in producing 3D models 9 3.3 Instructional design (introduction) The instructional design elements were divided into three aspects, C1-introduction, C2-content delivery and C3-assessment. Table 9 shows the overall of the experts’ con- sensus for the instructional design elements (introduction). It was found that all of the three conditions were met, first, the item value was less than or equal to the threshold value (d) <0.2. C1a, C1b, C1c and C1d each of the items showed a threshold value (d) <0.2 and a threshold value (d) of the construct is 0.104. The second condition also reached the experts’ consensus where it exceeded 75%. It was found that the aver- age experts ’consensus percentage of all items was 88%. The last condition was the defuzzification value per item exceeded α-cut = 0.5 where Table 7 shows the percentage of all defuzzification items (alpha-cut) exceeding 0.5. Therefore, all of the elements in the instructional design (introduction) were accepted and reached experts’ consensus. Table 9. Elements for instructional design (introduction) Expert Element C1a C1b C1c C1d Expert 1 (Educational Technology) 0.114 0.099 0.138 0.099 Expert 2 (Educational Technology) 0.041 0.099 0.031 0.056 Expert 3 (Educational Technology) 0.041 0.056 0.031 0.056 Expert 4 (Educational Technology) 0.041 0.056 0.256 0.295 Expert 5 (Instructional Technology) 0.281 0.295 0.256 0.056 Expert 6 (Instructional Technology) 0.114 0.099 0.031 0.099 Expert 7 (Augmented Reality) 0.041 0.056 0.031 0.056 Expert 8 (Augmented Reality) 0.114 0.099 0.138 0.099 Expert 9 (Augmented Reality) 0.114 0.099 0.138 0.099 Expert 10 (Model Development) 0.041 0.056 0.138 0.099 (Continued) 76 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Expert Element C1a C1b C1c C1d d value of each item 0.094 0.101 0.118 0.101 Threshold value (d) of construct 0.104 Percentage of experts’ consensus 90% 90% 80% 90% Average experts’ consensus percentage of all items 88% Percentage of all items defuzzification (alpha-cut) 0.890 0.900 0.873 0.900 Ranking 3 1 4 1 All the elements that have been agreed upon by the experts are rearranged according to the order as in Table 10. C1b, C1d, C1a and C1c are rearranged from the highest rating to the lowest rating. Table 10. Ranking of elements for instructional design (introduction) Element Rank C1a It starts with an induction set that is able to attract the students’ attention such as the use of image, video, music, animation and interesting gamification. 3 C1b Each learning objective should be stated. 1 C1c Enabling the students to recall what they have learned by using an audio or visual signals (signaling principle) to emphasize the important information. 4 C1d Enabling the students to recall what they have learned with the necessary signals (signaling principle) to facilitate the selection and organization of information, especially to the weak students 1 3.4 Instructional design (content delivery) Table 11 shows the overall of the experts’ consensus for the elements of the Instruc- tional Design (Content Delivery). It was found that all of the three conditions were met, first, the item value was less than or equal to the threshold value (d) <0.2. C2a, C2b, C2c, C2d, C2e, C2f, C2g, C2h, C2i and C2j, each of the items show a threshold value (d) <0.2 and a threshold value (d) of construct is 0.106. The second condition also reached the experts’ consensus where it exceeded 75%. It was found that the average of the experts consensus percentage of all items was 91%. The last condition was the defuzzification value per item exceeded α-cut = 0.5 where Table 11 shows the percent- age of all defuzzification items (alpha-cut) exceeding 0.5. Therefore, all of the ele- ments in instructional design (content delivery) were accepted and reached the experts’ agreement. Table 9. Elements for instructional design (introduction) (Continued) iJIM ‒ Vol. 16, No. 11, 2022 77 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Table 11. Elements for instructional design (content delivery) Expert Element C2a C2b C2c C2d C2e C2f C2g C2h C2i C2j Expert 1 (Educational Technology) 0.114 0.092 0.114 0.242 0.114 0.204 0.200 0.114 0.114 0.076 Expert 2 (Educational Technology) 0.114 0.092 0.114 0.153 0.114 0.188 0.058 0.114 0.114 0.076 Expert 3 (Educational Technology) 0.041 0.061 0.041 0.025 0.041 0.064 0.058 0.041 0.041 0.076 Expert 4 (Educational Technology) 0.041 0.061 0.041 0.025 0.041 0.064 0.058 0.041 0.041 0.076 Expert 5 (Instructional Technology) 0.281 0.061 0.281 0.242 0.281 0.495 0.495 0.281 0.281 0.076 Expert 6 (Instructional Technology) 0.041 0.061 0.041 0.025 0.041 0.188 0.058 0.041 0.041 0.076 Expert 7 (Augmented Reality) 0.041 0.061 0.041 0.025 0.041 0.204 0.058 0.041 0.041 0.076 Expert 8 (Augmented Reality) 0.114 0.092 0.114 0.153 0.114 0.188 0.193 0.114 0.114 0.076 Expert 9 (Augmented Reality) 0.114 0.092 0.114 0.153 0.114 0.188 0.193 0.114 0.114 0.076 Expert 10 (Model Development) 0.041 0.061 0.041 0.025 0.041 0.064 0.058 0.041 0.041 0.076 d value of each item 0.094 0.073 0.094 0.107 0.094 0.185 0.143 0.094 0.094 0.076 Threshold value (d) of construct 0.106 Percentage of experts’ consensus 90% 100% 90% 80% 90% 90% 90% 90% 90% 100% Average experts’ consensus percentage of all items 91% Percentage of all items defuzzification (alpha-cut) 0.890 0.907 0.890 0.863 0.890 0.837 0.833 0.890 0.890 0.917 Ranking 3 2 3 8 3 9 10 3 3 1 All the elements that have been agreed upon by the experts are rearranged according to the ranking as in Table 12. C2j, C2b, C2a, C2c, C2e, C2h, C2i, C2d, C2f and C2g are rearranged from the highest to the lowest rating. Elements C2a, C2c, C2e, C2h and C2i share the third position of the ranking. 78 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Table 12. Ranking of elements for instructional design (content delivery) Element Rank C2a Arrange the content in order of difficulty level (starting with easy to difficult). 3 C2b Diverse the medium of delivery. 2 C2c Relate the content to everyday life. 3 C2d Apply the coherence principle by avoiding the irrelevant material even the material is interesting because it will reduce the cognitive ability of the students. 8 C2e Apply the redundancy principle with the use of an appropriate combination of multimedia elements. 3 C2f Apply the redundancy principle which is a combination of graphics with narrative alone is more effective than with additional text. 9 C2g Apply the redundancy principle by avoiding the background music if there is a narrative. 10 C2h Apply the contiguity principle by placing the words close to the relevant visuals. 3 C2i Apply the contiguity principle by supporting the narrative with appropriate visuals. 3 C2j Should be framed according to Bloom’s Taxonomy which is lower-order thinking skill (application, understanding, knowledge) to higher-order thinking skill (evaluation, synthesis, analysis). 1 3.5 Instructional design (assessment) Table 13 shows the overall of the experts’ consensus for the elements for Instruc- tional Design (Assessment). It was found that all three conditions were met, first, the item value was less than or equal to the threshold value (d) <0.2. C3a, C3b, C3c, C3d, C3e and C3f each show a threshold value (d) <0.2 and a threshold value (d) of construct is 0.089. The second condition also reached the experts’ consensus where it exceeded 75%. It was found that the average experts’ consensus percentage of all items was 93%. The last condition was the defuzzification value per item exceeded α-cut = 0.5 where Table 13 shows the percentage of all defuzzification items (alpha-cut) exceeding 0.5. Therefore, all of the elements for Instructional Design (Assessment) were accepted and reached the experts’ agreement. Table 13. Elements for instructional design (assessment) Expert Element C3a C3b C3c C3d C3e C3f Expert 1 (Educational Technology) 0.154 0.154 0.107 0.107 0.129 0.129 Expert 2 (Educational Technology) 0.154 0.154 0.107 0.107 0.129 0.129 Expert 3 (Educational Technology) 0.034 0.034 0.046 0.046 0.027 0.027 Expert 4 (Educational Technology) 0.034 0.034 0.046 0.046 0.027 0.027 Expert 5 (Instructional Technology) 0.034 0.034 0.046 0.046 0.027 0.267 Expert 6 (Instructional Technology) 0.034 0.034 0.046 0.046 0.027 0.027 Expert 7 (Augmented Reality) 0.034 0.034 0.046 0.046 0.267 0.027 (Continued) iJIM ‒ Vol. 16, No. 11, 2022 79 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Expert Element C3a C3b C3c C3d C3e C3f Expert 8 (Augmented Reality) 0.533 0.533 0.046 0.046 0.027 0.027 Expert 9 (Augmented Reality) 0.154 0.154 0.107 0.107 0.129 0.129 Expert 10 (Model Development) 0.034 0.034 0.046 0.046 0.027 0.027 d value of each item 0.120 0.120 0.064 0.064 0.082 0.082 Threshold value (d) of construct 0.089 Percentage of experts’ consensus 90% 90% 100% 100% 90% 90% Average experts’ consensus percentage of all items 93% Percentage of all items defuzzification (alpha-cut) 0.860 0.860 0.897 0.897 0.880 0.880 Ranking 5 5 1 1 3 3 All the elements that have been agreed upon by the experts are rearranged according to the ranking as in Table 14. C3c, C3d, C3e, C3f, C3a and C3b are rearranged accord- ing to the highest rating to the lowest rating. C3c and C3d share the same ranking i.e. first ranking. Table 14. Ranking of elements for instructional design (assessment) Element Rank C3a Demonstrate a learning guide by providing hints, clues, info, terminology or problem-solving workflows. 5 C3b Apply the pre-learning principle by creating a menu to display the main terms as reference and guidance. 5 C3c Tasks and assessment given are in line with the objectives and outcomes. 1 C3d Able to provide immediate feedback to students. 1 C3e Able to provide constructive feedback and justification to students. 3 C3f Assess student comprehension by performing formative assessment. 3 3.6 Types of AR application Table 15 shows the overall expert agreement for the elements of the types of AR application. It was found that all three conditions were met, first, the item value was less than or equal to the threshold value (d) <0.2. D1, D2, D3, D4, D5 and D6 each of the items showed a threshold value (d) <0.2 and a threshold value (d) of the con- struct is 0.111. The second condition also reached experts’ consensus where the per- centage exceeded 75%. It was found that the average experts’ consensus percentage of all items was 88%. The last condition was the defuzzification value per item exceeded α-cut = 0.5 where Table 15 shows the percentage of all defuzzification items (alpha-cut) exceeding 0.5. Therefore, all elements for these types of AR application are accepted and reach experts’ agreement. Table 13. Elements for instructional design (assessment) (Continued) 80 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Table 15. Elements for types of AR application Expert Element D1 D2 D3 D4 D5 D6 Expert 1 (Educational Technology) 0.160 0.208 0.208 0.232 0.160 0.208 Expert 2 (Educational Technology) 0.014 0.068 0.068 0.093 0.014 0.068 Expert 3 (Educational Technology) 0.014 0.068 0.068 0.093 0.014 0.068 Expert 4 (Educational Technology) 0.014 0.068 0.068 0.093 0.014 0.068 Expert 5 (Instructional Technology) 0.240 0.186 0.186 0.161 0.240 0.186 Expert 6 (Instructional Technology) 0.014 0.483 0.483 0.458 0.014 0.483 Expert 7 (Augmented Reality) 0.014 0.068 0.068 0.161 0.014 0.068 Expert 8 (Augmented Reality) 0.014 0.068 0.068 0.093 0.014 0.068 Expert 9 (Augmented Reality) 0.014 0.068 0.068 0.093 0.014 0.068 Expert 10 (Model Development) 0.014 0.068 0.068 0.093 0.014 0.068 d value of each item 0.051 0.135 0.135 0.157 0.051 0.135 Threshold value (d) of construct 0.111 Percentage of experts’ consensus 90% 90% 90% 80% 90% 90% Average experts’ consensus percentage of all items 88% Percentage of all items defuzzification (alpha-cut) 0.860 0.823 0.823 0.807 0.860 0.823 Ranking 1 3 3 6 1 3 All of the elements that have been agreed upon by the experts were rearranged according to the ranking as in Table 16. D1, D5, D2, D3, D6 and D4 were rearranged from the highest to the lowest rating. D1 and D5 share the same ranking which was the first ranking. While D2, D3 and D6 share the same ranking which was the third ranking. Last but not least was D4 which was located at the sixth ranking. Table 16. Types of AR application Element Rank D1 AR-based Game Application 1 D2 AR Book 3 D3 AR Flashcard 3 D4 AR Poster 6 D5 AR Gameboard 1 D6 AR Comic 3 4 Discussion The AILeaD framework was developed based on the literature review and com- bined the CTML [31], Gagne’s Nine Events of Instruction [43] and Revised Bloom Taxonomy [37]. The expert agreed that technology skills should be the first construct in the framework. To develop AR, educators should have technical skills and among the iJIM ‒ Vol. 16, No. 11, 2022 81 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… skills that were listed by the augmented reality developer are computer programming, animation, 3D modelling and multimedia [56]. Those unskilled educators would face difficulties and hardships while developing the instructional materials based on AR [42]. Those educators who inquire to develop AR should prepare themselves with the basic skills of technology like editing the graphic, audio and video. Nevertheless, if the educators want to produce a complex AR, they should master advanced technical skills like 3D modelling and programming. Besides, AR development also requires technology skills in multimedia editing like graphics, video, animation and audio depending on the AR tools used. Usually, the ready-made AR template tools only need some basic skills like video, graphic, ani- mation and audio (low-level tool). But the complex AR tools need animation skills, programming and skill to produce 3D modelling (high-level tool). The finding of this study showed that the position of technology skills agreed by the experts is from basic to advance. The first sixth level only involves basic skills such as graphics, audio and video while the seventh to tenth level indicate advanced technology skills like the abil- ity to produce animation, 3D modelling and programming. All of these technology skills are closely related to the selection of AR tools. If the educators do not have programming knowledge, low-level tools are necessary where educators only need to select, edit and upload information [44]. [56] used GUI based AR authoring tool in producing AR where 3D modelling skills are required. [57] also showed the skills of producing 3D objects, animation, audio and video in producing 3D Augmented Reality Arabic. In addition, the skills of producing and editing images, text, and 3D objects are required in producing android mobile augmented reality [34]. Therefore, these tech- nology skills are agreed by the experts as the first construct to be mastered and learned by the educators before they develop AR so that they do not face any difficulties and take a long time while developing AR later. Moreover, these elements for technology skills are also important when educators decide to choose and use AR authoring tools in developing AR. Next, the experts agreed that instructional design is the second construct in the AILeaD framework. Instructional design is a systematic process to design, build and carry out all the instructional processes. Most of the instructional design model depends on several steps to produce effective learning materials [58] and among the steps are planning, development and evaluation [59]. Thus, this construct aims to ensure the developed AR is based on the systematic instructional design. The ignorance of the instructional design during the AR development process leads to the failure of the objectives. This second construct is divided into three parts which are the introduction, con- tent delivery and assessment. The initial part is the introduction which focuses on the learning objective, gaining students attention and signalling principle. Gagne’s Nine Events of Instruction stated that educators should inform the students about the learn- ing objectives at the beginning of the lesson before delivering the learning content in order to ensure that the students know the direction of instruction, things to achieve 82 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… and motivate them to complete the lesson [60]. Next, gain the students’ attention to give the stimulation in order to make sure the students are ready to accept the order and activate the receptor [61]. Therefore, while developing AR, multimedia elements such as image, video, music, animation or gamification should be applied to ensure that the students are attracted and stay until the end of the lesson. The signalling principle in CTML stated that learners are better when cues that highlight the organization of the essential material are added [31]. During the development of AR, educators should guide the students to focus on the important concept to ease the choice and arrangement of information specific to the low-level students. The second part focuses on content delivery. When delivering the learning content through AR, educators should draft the content based on the Revised Bloom Taxonomy which is lower-order thinking skills (applying, understanding and knowledge) to higher-order thinking skills (evaluating, synthesis and analysis). Apart from measur- ing the knowledge of the students, Revised Taxonomy Bloom is also used to schedule instructional activities in a course to enhance students’ learning [62]. Educators could diversify the medium of presentation so that students do not easily feel bored. Students are more excited and attracted to presentations that have audio, video and 3D models because they feel as if they are in the real world [63]. The redundancy principle is that students learn better from graphics and narration than from graphics, narration and on-screen text [31]. Therefore, to ensure that there is no cognitive overload, the educa- tors should combine the appropriate multimedia elements, the combination of graphics with narrative alone is more effective than with additional text and avoid background music if there is narrative. While spatial contiguity is students learn better when corre- sponding words and pictures are presented near rather than far from each other on the page or screen [31]. Therefore, when developing AR, the text should be placed close to the graphic to make it easier for students to understand the content and the narrative should be matched with appropriate visuals. While developing AR content, educators should avoid irrelevant material even if it is interesting as it will reduce the cognitive ability of the students. The third part is assessment, which is an activity implemented to improve and test students’ understanding. There are six elements that were agreed upon by the experts to ensure that the assessments carried out were in line with the learning objectives, imme- diate feedback, formative assessment and providing learning guidance. According to [64], assessment is not only to assess the students’ performance but also the retrieval of information performed by the students can maintain their long-term knowledge. Finally, the experts agreed that type of AR application is the third construct in the AILeaD framework. AR can produce various types of applications such as AR simu- lation, location-based services, AR applications for tourism and many more. Never- theless, in the field of education, the development of AR is more focused on teaching objectives and conceptually shaped information [44]. Therefore, the type of AR appli- cation which is the output needs to be adapted with the objectives and information desired by the educators. iJIM ‒ Vol. 16, No. 11, 2022 83 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Table 17. The constructs and elements in an augmented reality immersive learning design A. Technology Skills 1. Skilled in producing audio 2. Skilled in graphic editing 3. Skilled in producing graphic 4. Skilled in video editing 5. Skilled in audio editing 6. Skilled in making a video 7. Skilled in making animation 8. Skilled in animation editing 9. Skilled in producing 3D models 10. Skilled in programming (eg. C, C+, java, flash) B. Instructional Design Introduction 1. Each learning objective should be stated. 2. Enabling the students to recall what they have learned with the necessary signals (signaling principle) to facilitate the selection and organization of information, especially to the weak students (signaling principle). 3. It starts with an induction set that is able to attract the students’ attention such as the use of image, video, music, animation and interesting gamification. 4. Enabling the students to recall what they have learned by using an audio or visual signals (signaling principle) to emphasize the important information. Content Delivery 1. Should be framed according to Bloom’s Taxonomy which is lower-order thinking skill (application, understanding, knowledge) to higher-order thinking skill (evaluation, synthesis, analysis). 2. Diverse the medium of delivery. 3. Arrange the content in order of difficulty level (starting with easy to difficult). 4. Relate the content to everyday life. 5. Apply the redundancy principle with the use of an appropriate combination of multimedia elements. 6. Apply the contiguity principle by placing the words close to the relevant visuals. 7. Apply the contiguity principle by supporting the narrative with appropriate visuals. 8. Apply the coherence principle by avoiding the irrelevant material even the material is interesting because it will reduce the cognitive ability of the students. 9. Apply the redundancy principle which is a combination of graphics with narrative alone is more effective than with additional text. 10. Apply the redundancy principle by avoiding the background music if there is a narrative. (Continued) 84 http://www.i-jim.org Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… Assessment 1. Tasks and assessment given are in line with the objectives and outcomes. 2. Able to provide immediate feedback to students. 3. Able to provide a constructive feedback and justification to students. 4. Assess student comprehension by performing formative assessment. 5. Demonstrate a learning guide by providing hints, clues, info, terminology or problem-solving workflows. 6. Apply the Pre-learning principle by creating a menu to display the main terms as reference and guidance. C. Types of AR Application 1. AR-based Game Application 2. AR Gameboard 3. AR Book 4. AR Flashcard 5. AR Comic 6. AR Poster 5 Conclusion This study has discussed the finding of the two objectives of this study which are (a) validate the constructs and elements of the AILeaD framework based on experts’ consensus (b) identify the position of constructs and elements of the AILeaD frame- work based on experts’ consensus. The finding of the study shows that overall experts’ consensus has been obtained to determine the construct of the framework, namely technology skills, instructional design and types of AR applications. Next, the frame- work elements for each of these constructs were validated and ranked according to the experts’ consensus as shown in Table 17. This study has several contributions especially to the field of instructional technology. Firstly, the occurrence of a new framework that combines three instructional designs which are Gagne Nine Events, Cognitive Theory of Multimedia Learning dan Revised Bloom Taxonomy, thus it is filling the gap in this area of knowledge. The combination of these three theories resulted in the prime frame- work construct which are instructional design that consists of the introduction, content delivery and assessment. Secondly, the Fuzzy Delphi technique was used to evaluate and confirm the constructs and elements that contain in the AILeaD framework. This process involves a group of experts to achieve the concurrence and agreement to make a decision. Finally, the finding of this study could be used as a guideline for teachers, lecturers, instructional designers and application designers in creating AR. All the ele- ments and constructs demonstrate the crucial of the use of AILeaD in developing the pedagogical resources based on AR and verified by the experts. Despite of that, educa- tors that want to make AR as an aid in teaching using the AILeaD framework need to Table 17. The constructs and elements in an augmented reality immersive learning design (Continued) iJIM ‒ Vol. 16, No. 11, 2022 85 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… be aligned with the learning objectives and learning outcomes. Hence, further study is suggested to develop the AR prototype based on this AILeaD framework and tested the effectiveness of students’ achievement. The benefit of this study is not only for the edu- cators, students also could gain a meaningful experience through immersive pedagogi- cal. The development of AR based on AILeaD can improve the innovation in teaching as well as improve the quality of education in Malaysia during facing the Education 4.0. 6 Acknowledgement This research was supported by Ministry of Higher Education (MoHE) of Malay- sia through Fundamental Research Grant Scheme for Research Acculturation of Early Career Researchers (RACER/1/2019/SS109/UUM/1). 7 References [1] Baker, E., Bakar, J. A., & Zulkifli, A. (2020). Elements of Engagement in Promoting Social Acceptance of Mobile Augmented Reality Application. International Journal of Interactive Mobile Technologies. 14 (17), 66–78. https://doi.org/10.3991/ijim.v14i17.16555 [2] Beck, D., Morgado, L., & O’Shea, P. (2020). Finding the Gaps About Uses of Immersive Learning Environments: A Survey of Surveys. Journal of Universal Computer Science, 26, 1043–1073. https://doi.org/10.3897/jucs.2020.055 [3] Hong, O. A., Halim, N. D., Zulkifli, N. N., Jumaat, N. F., Zaid, N. M., & Mokhtar, M. (2022). Designing Game-Based Learning Kit with Integration of Augmented Reality for Learning Geography. International Journal of Interactive Mobile Technologies, 16(2), 4–16. https://doi.org/10.3991/ijim.v14i17.16555 [4] Bujang, S. D. A., Selamat, A., Krejcar, O., Maresova, P., & Nguyen, N. T. (2020). Digital Learning Demand for Future Education 4.0—Case Studies at Malaysia Education Institu- tions. In Informatics (Vol. 7, No. 2, p. 13). Multidisciplinary Digital Publishing Institute. https://doi.org/10.3390/informatics7020013 [5] Ramli, R., Nordin, F. N. A., & Ahmad Sokri, N. E. (2018). Teknologi Realiti Luasan: Satu Kajian Lepas. E-Jurnal Penyelidikan dan Inovasi, 5(1), 17–27. [6] Monfared, M., Shukla, V. K., Dutta, S., & Chaubey, A. (2022). Reshaping Education Through Augmented Reality and Virtual Reality. In Cyber Intelligence and Information Retrieval (pp. 619–629). Springer, Singapore. https://doi.org/10.1007/978-981-16-4284-5_55 [7] Ashwini, K. B., GopalKrishna, H. D., Akhil, S., & Pattanshetti, A. D. (2022). Immersive Learning About IC-Engine Using Augmented Reality. In Immersive Technology in Smart Cities (pp. 27–39). Springer, Cham. https://doi.org/10.1007/978-3-030-66607-1_2 [8] Bower, M., Howe, C., McCredie, N., Robinson, A., & Grover, D. (2014). Augmented Reality in Education – Cases, Places and Potentials. Educational Media International, 51(1):1–15. https://doi.org/10.1080/09523987.2014.889400 [9] Saforrudin, N., Zaman, H. B., & Ahmad, A. (2016). Pengajaran Masa Depan Menggu- nakan Teknologi Augmented Reality Dalam Pendidikan Bahasa Melayu: Tahap Kesedaran Guru. Jurnal Pendidikan Bahasa Melayu, 2(2), 1–10. https://doi.org/10.5539/ass.v9n11p1 [10] Gopalan, V., Zulkifli, A. N., Faisal Mohamed, N. F., Alwi, A., Che Mat, R., Abu Bakar, J. A., & Saidin, A. Z. (2015). Evaluation of e-STAR: An Enhanced Science Textbook Using Augmented Reality Among Lower Secondary School Students. Jurnal Teknologi (Sciences and Engineering), 77(29), 55–61. https://doi.org/10.11113/jt.v77.6813 86 http://www.i-jim.org https://doi.org/10.3991/ijim.v14i17.16555 https://doi.org/10.3897/jucs.2020.055 https://doi.org/10.3991/ijim.v14i17.16555 https://doi.org/10.3390/informatics7020013 https://doi.org/10.1007/978-981-16-4284-5_55 https://doi.org/10.1007/978-3-030-66607-1_2 https://doi.org/10.1080/09523987.2014.889400 https://doi.org/10.5539/ass.v9n11p1 https://doi.org/10.11113/jt.v77.6813 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… [11] Gopalan, V., Zulkifli, A. N., & Abu Bakar, J. A. (2016). A Study of Students’ Motivation Based on Ease of Use, Engaging, Enjoyment and Fun Using the Augmented Reality Science Text- book. Revista de la Facultad de Ingenieria, 31(5), 27–35. https://doi.org/10.21311/002.31.5.04 [12] Rezende, W. J., Albuquerque, E. S., & Ambrosio, A. P. (2017). Use of Augmented Reality to Support Education – Creating a Mobile e-Learning Tool and Using it with an Inquiry-Based Approach. Proceedings of the 9th International Conference on Computer Supported Educa- tion, 1(Csedu), 100–107. https://doi.org/10.5220/0006318701000107 [13] Almenara, J. C., Osuna, J. B., Cejudo, C. L., & Martinez, M. del Mar. F. (2019). Educational Uses of Augmented Reality (AR): Experiences in Educational Science. Sustainability, 11(8), 4990. https://doi.org/10.3390/su11184990 [14] Rosli, H. W. (2013). Augmented Reality Model for Pre-school Learning. Thesis Master. Universiti Utara Malaysia. [15] Costa, M. C, Manso, A., & Patricio, J. (2020). Design of a Mobile Augmented Reality Plat- form with Game-Based Learning Purposes. Information, 11(127). https://doi.org/10.3390/ info11030127 [16] Malliga, P., Sivaranjini, S., Preethi, S. & Sadhana Routh, S. (2019). Enchancing Learning Experience through Augmented Reality. International Conference on Digital Pedagogies. https://doi.org/10.2139/ssrn.3377597 [17] Jesionkowska, J., Wild, F., & Deval, Y. (2020) Active Learning Augmented Reality for STEAM Education – A Case Study. Educational Science, 10(8), 198. https://doi.org/10.3390/ educsci10080198 [18] Hanid, M. F. A., Said, M. N. H. M., & Yahaya, N. (2020). Learning Strategies Using Aug- mented Reality Technology in Education: Meta-Analysis. Universal Journal of Educational Research, 8(5A), 51–56. https://doi.org/10.13189/ujer.2020.081908 [19] Saidin, N. F., Halim, N. D. A., & Yahaya, N. (2015). A Review of Research on Augmented Reality in Education: Advantages and Applications. International Education Studies, 8(13), 1–8. https://doi.org/10.5539/ies.v8n13p1 [20] Cheng, M. T., Lin, Y. W., & She, H. C. (2015). Learning through Playing Virtual Age: Exploring the Interactions Among Student Concept Learning, Gaming Performance, In-Game Behaviors, and the Use of In-Game Characters. Computers and Education, 86, 18–29. https://doi.org/10.1016/j.compedu.2015.03.007 [21] Pendit, U. C. (2016). Conceptual Model of Mobile Augmented Reality for Cultural Heritage Site towards Enjoyable Informal Learning (MARCHSTEIL). Thesis Doctor of Philosophy. Universiti Utara Malaysia. https://doi.org/10.11113/jt.v77.6847 [22] Kim, J. O., & Kim, J. (2018). Augmented Reality Tools for Integrative Sciences and Arts STEAM Education. International Journal of Pure and Applies Mathematics, 118(24). [23] Mahayuddin, Z. R., & Mamat, N. (2019). Implementing Augmenetd Reality (AR) on Pho- nics Based Literacy Among Children with Autism. International Journal on Advanced Science Engineering Information Technology, 9(6), 2176–2181. https://doi.org/10.18517/ ijaseit.9.6.6833 [24] Noor, N. M., Ismail, M., Yussof, R. L., & Yusoff, F. H. (2019). Measuring Tajweed Augmented Reality-Based Gamification Learning Model (TARGaLM) Implementation for Children in Tajweed Learning. Pertanika Journal of Science and Technology [Internet], 27(4), 1821–1840. [25] Yilmaz, R. M. (2018). Augmented Reality Trends in Education between 2016 and 2017 Years. In N. Mohamudally (Ed.), State of the Art Virtual Reality and Augmented Reality Knowhow (pp. 81–97). London: IntechOpen. https://doi.org/10.5772/intechopen.74943 [26] Bacca, J., Baldiris, S., Fabregat, R., Graf, S., & Kinshuk. (2014). Augmented Reality Trends in Education: A Systematic Review of Research and Applications. Educational Technology & Society, 17(4), 133–149. iJIM ‒ Vol. 16, No. 11, 2022 87 https://doi.org/10.21311/002.31.5.04 https://doi.org/10.5220/0006318701000107 https://doi.org/10.3390/su11184990 https://doi.org/10.3390/info11030127 https://doi.org/10.3390/info11030127 https://doi.org/10.2139/ssrn.3377597 https://doi.org/10.3390/educsci10080198 https://doi.org/10.3390/educsci10080198 https://doi.org/10.13189/ujer.2020.081908 https://doi.org/10.5539/ies.v8n13p1 https://doi.org/10.1016/j.compedu.2015.03.007 https://doi.org/10.11113/jt.v77.6847 https://doi.org/10.18517/ijaseit.9.6.6833 https://doi.org/10.18517/ijaseit.9.6.6833 https://doi.org/10.5772/intechopen.74943 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… [27] Khadjooi, K., Rostami, K., & Ishaq, S., (2011). How to Use Gagne’s Model of Instructional design in Teaching Psychomotor Skills: Gastroenterol Hepatol Bed Bench, 4(3) database: https://www.Ncbi.Nlm.Nih.Gov/Pmc/Articles/Pmc4017416/. https://dx.doi.org/10.22037/ ghfbb.v4i3.165 [28] Martin. F., & Klein. J., (2008). Effects of Objectives, Practice, and Review in Multimedia Instruction. Journal of Educational Multimedia and Hypermedia 17(2), 171–189. [29] Miner, M. A., Mallow, J., Theeke, L., & Barnes, E. (2015). Using Gagne’s 9 Events of Instruction to Enhance Student Performance and Course Evaluations in Undergraduate Nurs- ing Course. Nurse Educator, 40(3), 152. https://doi.org/10.1097/NNE.0000000000000138 [30] Ng, J. Y. (2014). Combining Peyton’s Four-Step Approach and Gagne’s Instructional Model in Teaching Slit-Lamp Examination. Perspectives on Medical Education, 3(6), 480–485. https://doi.org/10.1007/s40037-014-0136-x [31] Mayer, R. E. (2009). Multimedia Learning (2nd ed). New York: Cambridge University Press. https://doi.org/10.1017/CBO9780511811678 [32] Sommerauer, P., & Müller, O. (2014). Augmented Reality in Informal Learning Environ- ments: A Field Experiment in a Mathematics Exhibition. Computers & Education, 79, 59–68. https://doi.org/10.1016/j.compedu.2014.07.013 [33] Santos, M. E. C., Chen, A., Terawaki, M., Yamamoto, G., Taketomi, T., Miyazaki, J., & Kato, H. (2013, July). Augmented Reality X-Ray Interaction in K-12 Education: Theory, Student Perception and Teacher Evaluation. In Advanced Learning Technologies (ICALT), 2013 IEEE 13th International Conference on (pp. 141–145). IEEE. https://doi.org/10.1109/ ICALT.2013.45 [34] Parhizkar, B., Islam, M., Lashkari, A., Abdullas-Al-Jubair, M., Gebril, Z., & Zarrabi, M. (2012a). Simulation of Investigating the Earth and Universe Using Interactive Mobile Aug- mented Reality Based on Smart Evaluation. In Proceedings of the International MultiCon- ference of Engineers and Computer Scientists (Vol. 1, pp. 656–659). [35] Parhizkar, B., Gebril, Z. M., Obeidy, W. K., Ngan, M. N. A., Chowdhury, S. A., & Lashkari, A. H. (2012b, May). Android Mobile Augmented Reality Application Based on Different Learning Theories for Primary School Children. In Multimedia Computing and Systems (ICMCS), 2012 International Conference on (pp. 404–408). IEEE. https://doi.org/10.1109/ ICMCS.2012.6320114 [36] Saidin, N. F., Halim, N. D. A., & Yahaya, N. (2019). Framework for Developing a Mobile Augmented Reality for Learning Chemical Bonds. International Journal of Interactive Mobile Technologies, 13(7). https://doi.org/10.3991/ijim.v13i07.10750 [37] Krathwohl, D. R. (2002). A Revision of Bloom’s Taxonomy: An Overview. Theory into Practice, 41(4), 212–218. https://doi.org/10.1207/s15430421tip4104_2 [38] Amer, A. (2006). Reflections on Bloom’s Revised Taxonomy. Electronic Journal of Research in Educational Psychology, 4(1), 213–230. [39] Arcos, C., Fuertes, W., Villacís, C., Zambrano, M., Noboa, T., Tacuri, A., … & Toulkeridis, T. (2016, April). Playful and Interactive Environment-Based Augmented Reality to Stim- ulate Learning of Children. In 2016 18th Mediterranean Electrotechnical Conference (MELECON) (pp. 1–6). IEEE. https://doi.org/10.1109/MELCON.2016.7495421 [40] Adler, M., & Ziglio, E. (1996). Gazing into the Oracle: The Delphi Method and its Applica- tion to Social Policy and Public Health. Jessica Kingsley Publishers. [41] Berliner, D. C. (2004). Expert Teachers: Their Characteristics, Development and Accom- plishments. Bulletin of Science, Technology and Society, 24(3), 200–212. https://doi. org/10.1177/0270467604265535 88 http://www.i-jim.org https://www.Ncbi.Nlm.Nih.Gov/Pmc/Articles/Pmc4017416/ https://dx.doi.org/10.22037/ghfbb.v4i3.165 https://dx.doi.org/10.22037/ghfbb.v4i3.165 https://doi.org/10.1097/NNE.0000000000000138 https://doi.org/10.1007/s40037-014-0136-x https://doi.org/10.1017/CBO9780511811678 https://doi.org/10.1016/j.compedu.2014.07.013 https://doi.org/10.1109/ICALT.2013.45 https://doi.org/10.1109/ICALT.2013.45 https://doi.org/10.1109/ICMCS.2012.6320114 https://doi.org/10.1109/ICMCS.2012.6320114 https://doi.org/10.3991/ijim.v13i07.10750 https://doi.org/10.1207/s15430421tip4104_2 https://doi.org/10.1109/MELCON.2016.7495421 https://doi.org/10.1177/0270467604265535 https://doi.org/10.1177/0270467604265535 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… [42] Saforrudin, N., Zaman, H. B., & Ahmad, A. (2011, November). Technical Skills in Devel- oping Augmented Reality Application: Teachers’ Readiness. In International Visual Informatics Conference (pp. 360–370). Springer, Berlin, Heidelberg. https://doi.org/ 10.1007/978-3-642-25200-6_34 [43] Gagne, R. (1985). The Conditions of Learning (4th Ed.). New York: Holt, Rinehart & Winston. [44] Tutunea, M. F. S. (2013). Augmented Reality-State of Knowledge, Use and Experimenta- tion. The USV Annals of Economics and Public Administration, 13(2 (18)), 215–227. [45] Mohamad, S. N. A., Embi, M. A., & Nordin, N. (2015). Determining e-Portfolio Elements in Learning Process Using Fuzzy Delphi Analysis. International Education Studies, 8(9), 171–176. https://doi.org/10.5539/ies.v8n9p171 [46] Chen, C. T. (2000). Extensions of the TOPSIS for Group Decision-Making Under Fuzzy Environment. Fuzzy sets and systems, 114(1), 1–9. https://doi.org/10.1016/S0165- 0114(97)00377-1 [47] Cheng, C. H., & Lin, Y. (2002). Evaluating the Best Main Battle Tank Using Fuzzy Decision Theory with Linguistic Criteria Evaluation. European Journal of Operational Research, 142(1), 174–186. https://doi.org/10.1016/S0377-2217(01)00280-6 [48] Chu, H. C., & Hwang, G. J. (2008). A Delphi-Based Approach to Developing Expert Sys- tems with the Cooperation of Multiple Experts. Expert Systems with Applications, 34(4), 2826–2840. https://doi.org/10.1016/j.eswa.2007.05.034 [49] Murry Jr, J. W., & Hammons, J. O. (1995). Delphi: A Versatile Methodology for Conducting Qualitative Research. The Review of Higher Education, 18(4), 423–436. https://doi.org/ 10.1353/rhe.1995.0008 [50] Benitez, J. M., Martín, J. C., & Román, C. (2007). Using Fuzzy Number for Measuring Quality of Service in the Hotel Industry. Tourism Management, 28(2), 544–555. https://doi. org/10.1016/j.tourman.2006.04.018 [51] Chang, P. L., Hsu, C. W., & Chang, P. C. (2011). Fuzzy Delphi Method for Evaluating Hydrogen Production Technologies. International Journal of Hydrogen Energy, 36(21), 14172–14179. https://doi.org/10.1016/j.ijhydene.2011.05.045 [52] Mourhir, A., Rachidi, T., & Karim, M. (2014). River Water Quality Index for Morocco Using a Fuzzy Inference System. Environmental Systems Research, 3(1), 1–12. https://doi. org/10.1186/s40068-014-0021-y [53] Yaakob, M. F. M., Nawi, A., Yusof, M. R., Fauzee, M. S. O., Awang, H., Khun-Inkeeree, H., … & Habibi, A. (2020). A Quest for Experts’ Consensus on the Geo-Education Module Using Fuzzy Delphi Analysis. Universal Journal of Educational Research, 8(7), 3189–3203. https://doi.org/10.13189/ujer.2020.080748 [54] Fortemps, P., & Roubens, M. (1996). Ranking and Defuzzification Methods Based on Area Compensation. Fuzzy Sets and Systems, 82(3), 319–330. https://doi.org/ 10.1016/0165-0114(95)00273-1 [55] Waltz, C. F., Strickland, O. L., & Lenz, E. R. (Eds.). (2010). Measurement in Nursing and Health Research. Springer Publishing Company. https://doi.org/10.1891/9780826170620 [56] Wang, M. J., Tseng, C. H., & Shen, C. Y. (2010, September). An Easy to Use Augmented Reality Authoring Tool for Use in Examination Purpose. In IFIP Human-Computer Interaction Symposium (pp. 285–288). Springer, Berlin, Heidelberg. https://doi. org/10.1007/978-3-642-15231-3_31 [57] Kamaruddin, M. K. A., Bardan, S. Z., Baharuddin, N. F. A., Ibrahim, N. H., & Abd Wahid, N. H. (2018). 3D Bahasa Arab Augmented Reality (3D Baar) Membantu Meningkatkan Penguasaan Bahasa Arab Pelajar (3D Arabic Language Augmented Reality (3D Baar) in Assisting Student’s Acquisition of Arabic Language). Innovative Teaching and Learning Journal, 2(2). iJIM ‒ Vol. 16, No. 11, 2022 89 https://doi.org/10.1007/978-3-642-25200-6_34 https://doi.org/10.1007/978-3-642-25200-6_34 https://doi.org/10.5539/ies.v8n9p171 https://doi.org/10.1016/S0165-0114(97)00377-1 https://doi.org/10.1016/S0165-0114(97)00377-1 https://doi.org/10.1016/S0377-2217(01)00280-6 https://doi.org/10.1016/j.eswa.2007.05.034 https://doi.org/10.1353/rhe.1995.0008 https://doi.org/10.1353/rhe.1995.0008 https://doi.org/10.1016/j.tourman.2006.04.018 https://doi.org/10.1016/j.tourman.2006.04.018 https://doi.org/10.1016/j.ijhydene.2011.05.045 https://doi.org/10.1186/s40068-014-0021-y https://doi.org/10.1186/s40068-014-0021-y https://doi.org/10.13189/ujer.2020.080748 https://doi.org/10.1016/0165-0114(95)00273-1 https://doi.org/10.1016/0165-0114(95)00273-1 https://doi.org/10.1891/9780826170620 https://doi.org/10.1007/978-3-642-15231-3_31 https://doi.org/10.1007/978-3-642-15231-3_31 Paper—Developing an Augmented Reality Immersive Learning Design (AILeaD) Framework: A Fuzzy… [58] Hannafin, M. J. & Peck, K. L. (1988). The Design, Development and Evaluation of Instructional Software, McMillan Publishing Company. https://doi.org/10.1016/0360- 1315(90)90011-U [59] Razak, R. A., & Rahman, M. A. (2017). Pembinaan Media Pengajaran Berasaskan Multi- media Di Kalangan Guru ICTL. JuKu: Jurnal Kurikulum & Pengajaran Asia Pasifik, 1(2), 20–31. [60] Islam, N., & Salam, A. (2019). Evaluation of Training Session Applying Gagne’s Events of Instructions. Bangladesh Journal of Medical Science, 18(3), 552–556. https://doi. org/10.3329/bjms.v18i3.41625 [61] Pandey, S. (2020). Implementing Gagne’s Events of Instruction in MBA Classroom: Reflec- tions and Reporting. https://doi.org/10.30726/ijmrss/v7.i3.2020.73011 [62] Masapanta-Carrión, S., & Velázquez-Iturbide, J. Á. (2018, February). A Systematic Review of the Use of Bloom’s Taxonomy in Computer Science Education. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education (pp. 441–446). https://doi. org/10.1145/3159450.3159491 [63] Indrastoeti, J., & Tribudiharto, T. (2018). Analysis of Students’ Need for Augmented Reality as an Art Learning Medium in Primary School Teacher Education at Universitas Sebelas Maret. International Journal of Educational Research Review, 3(3), 86–92. https://doi. org/10.24331/ijere.451428 [64] Gogineni, H., Aranda, J. P., & Garavalia, L. S. (2019). Designing Professional Program Instruction to Align with Students’ Cognitive Processing. Currents in Pharmacy Teaching and Learning, 11(2), 160–165. https://doi.org/10.1016/j.cptl.2018.11.015 8 Authors Farah Mohamad Zain, School of Education, Universiti Utara Malaysia, Kedah, Malaysia. Siti Nazuar Sailin, School of Education, Universiti Utara Malaysia, Kedah, Malaysia. Marini Kasim, School of Education, Universiti Utara Malaysia, Kedah, Malaysia. Abdul Malek Abdul Karim, School of Education, Universiti Utara Malaysia, Kedah, Malaysia. Nurfarah Najlaa Zameri, School of Education, Universiti Utara Malaysia, Kedah, Malaysia. Article submitted 2022-02-08. Resubmitted 2022-03-25. Final acceptance 2022-04-06. Final version published as submitted by the authors. 90 http://www.i-jim.org https://doi.org/10.1016/0360-1315(90)90011-U https://doi.org/10.1016/0360-1315(90)90011-U https://doi.org/10.3329/bjms.v18i3.41625 https://doi.org/10.3329/bjms.v18i3.41625 https://doi.org/10.30726/ijmrss/v7.i3.2020.73011 https://doi.org/10.1145/3159450.3159491 https://doi.org/10.1145/3159450.3159491 https://doi.org/10.24331/ijere.451428 https://doi.org/10.24331/ijere.451428 https://doi.org/10.1016/j.cptl.2018.11.015