International Journal of Interactive Mobile Technologies (iJIM) – eISSN: 1865-7923 – Vol. 15, No. 18, 2021 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment in Online Learning Environment https://doi.org/10.3991/ijim.v15i18.24541 Mohd Hanafi Azman Ong1(*), Norazlina Mohd Yasin2, Nur Syafikah Ibrahim1 1Universiti Teknologi MARA (Kampus Segamat), Johor, Malaysia 2Universiti Teknologi Malaysia (UTMSPACE), Johor, Malaysia napieong@uitm.edu.my Abstract—The Covid-19 epidemic has transformed the educational scene, hence altering the learning experience of students. The traditional face-to-face classroom has evolved into a synchronous online mode that requires minimum technology literacy. Their capability for absorption of information may be compromised under massive scenarios encountered throughout the acquisition of information. This article examines the function of alternative assessment in structured learning activities with the goal of deconstructing their learning compe- tence and fostering complex interaction. The research focuses on the relationship between numerous aspects and students’ online learning experiences, notably during the pandemic. An online survey was performed with 312 respondents who utilised the Blackboard online learning platform and a PLS-SEM analysis indicated that an alternative assessment mediated the relationship of learning readiness, student engagement, and student motivation toward student learning experience simultaneously. In conclusion, our study reinforces the vital need of addressing the mediator role of alternative assessment to enhance the learning experience and, hence, success in online classes. Keywords—online learning, learning experience, immersive experience, Covid-19, mediator analysis 1 Introduction As the Covid-19 epidemic struck in 2020, education delivery shifted away from conventional face-to-face instruction and toward online instruction. Restriction of movement during the lockdown has accelerated the rise of digital learning, having a major effect on the learning experience of remote learners. The “new normal” climate necessitates that academics at Higher Education Institutions (HEIs) rethink previ- ously held beliefs. Academics at HEIs should reassess teaching approaches other than conventional lectures in light of the “new normal.” Their preparedness for blended learning, however, is very low due to difficulties faced when merging teachings into fully online classrooms. Additionally, though today’s children have a range of learning styles, they are all proficient in digital literacy [1]. The contrast between conventional 16 http://www.i-jim.org https://doi.org/10.3991/ijim.v15i18.24541 mailto:napieong@uitm.edu.my Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... teaching techniques that are “dynamic and fluid” and online pedagogy has further hindered their learning experience. Blended learning integrates online and offline instruction to foster deep and meaningful learning while maintaining the principles associated with conventional academic institutions [2]. With advanced technology, this form of learning may enhance the efficacy and efficiency of learning experiences [3]. Online instructors, on the other hand, have been slow to adjust to changes in students’ learning techniques and dynamics. Embracing students’ learning experiences enables online instructors to assess the quantity of knowledge students have acquired and their ability to apply course-related material. The majority of research on e-learning examines learning models from three perspectives: (1) efficacy and student happiness, (2) convenience, and (3) if they com- plement traditional learning. To begin, research evaluating the aspects that contribute to the effectiveness of an online learning experience as a new learning media system have been conducted. It has been found that online learning media are more likely to provide students with gratifying services [4]. Second, prior research has shown that online education facilitates learners’ access to educational resources. Because of the increasing demand for internet access, the creation of subject-based learning resources has been facilitated, culminating in the production of final goods in the form of e-materials [5]. It is possible that students with a wide range of goals, motivations, and preferences may exhibit surprising behaviours when engaging with the materials, which may further impair their learning performance. A large number of studies have looked at how online learning may supplement some of the best qualities of both traditional in person instruction as well as the advancement of communication via digital technology, especially in the setting of distant learning. The methodology was proven to be capable of providing students with information on how to give prac- tical and realistic possibilities, similar to the blended learning method [6]. As a result of technology and communication developments, online learning trends are gaining traction without compromising the key characteristics of face-to-face interaction. 2 Literature review 2.1 Student’s learning readiness and learning experience Learning readiness is a state of mind that is constantly prepared to adopt a new man- ner of learning, notably via the use of technology. Online education has been found to increase students’ readiness for learning in Malaysian higher education, which has a pos- itive effect on their learning experience [7]. The critical factors that fueled the need for online learning management have been shown to be highly dependent on students’ atti- tudes toward knowledge acquisition, particularly self-learning [8], self-efficacy [9,10], learner control [11], and self-directed learning [12]. The transition from face-to-face to online or blended learning has enhanced student engagement and perceived learning, cooperative learning and academic motivation, academic accomplishment and contin- uance, as well as satisfaction and self-confidence [13,11]. Students with a high level of self-regulation; an essential component in e-learning preparation can maintain an online learner’s ongoing effort and accurately forecast their learning result [14,15,16]. iJIM ‒ Vol. 15, No. 18, 2021 17 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... 2.2 Student engagement Instructors should consider student engagement while creating high-quality material for delivery of teaching and learning in an online learning environment. It is well established that engagement necessitates unique techniques to promote information acquisition that is connected to students’ comprehension [17,18]. Scholars have argued for a strong connection between student engagement and the specific use of a MOOC video [19], a blackboard learning management system [20], course-specific learning analytics and nudging [21] and blended learning [22,23,24,25]. Given the critical nature of the reciprocal connection between engagement and learning, it’s predictable that the connection has been explored across a range of elements, measurement approaches, and domains [26]. An interactive learning experience may reintroduce structure, pur- pose, and excitement to classroom work, which has lately been recognized as a critical aspect of learning performance. Students’ high levels of engagement and interest in attendance and punctuality indicate that student engagement has a substantial influence on students’ equal amount of responsibility for their development, learning, and accomplishment, and engage- ment [27]. Teachers who established high standards, implemented evidence-based techniques, and created engaging learning experiences were successful in harnessing their autistic students’ engagement behavior. The strategies improved their students’ abilities and emotions, as well as their learning engagement, learning process, and learning experience, all of which influenced their learning results. Students who partic- ipated in the preparation, presentation, and response to questions from the judges were better equipped to manage such circumstances in the future [28]. 2.3 Student motivation Students’ drive to study should be perseverance in the realm of educational science and technology, where complexity is defined by the relationship between teaching and learning [29]. However, their motivation often decreases while online study. Certain measures have been shown to be effective in increasing students’ motivation and learn- ing experience [30,31,32], including applied learning approaches, instructional materi- als motivating survey within the use of self-directed learning materials, collaborative problem-based learning experience, and classroom feedback [33]. Motivated learners thrive on achievement and have faith in their capacity for perfor- mance, perseverance, and innovation. Despite the overwhelming use of web-based learning and teaching to aid students’ learning, students’ motivation should remain constant throughout their learning experience. Their willingness to study a web-based learning technology influenced their satisfaction with their online courses, perceived quality, perceived relevance, competence, accomplishment, and learning experience [34,35]. They may access learning materials in advance and prepare for the next class session using their preferred modes of teaching, which increases their perceived level of learning. Indeed, their educational experience is characterized by self-regulated learning, which includes motivation, emotion, engagement, pleasure, and instructional strategies. 18 http://www.i-jim.org Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... However, online learning presents difficulties for untrained self-regulated learners [35]. Thus, to assure the efficiency of online learning, students must exhibit specific characteristics such as a sense of autonomy, superiority, control, curiosity, and engagement, as well as a strong connection and a focus on learning. Self-regulation occurs in a variety of ways throughout the learning process. High authenticity and dynamism are two traits that define an admirable individual [36]; these traits illustrate the achievement motivation for online learning [37]. 2.4 Alternative assessment as mediator variable Alternative evaluations have been frequently employed as a catalyst for technology adoption to help learners better comprehend technological functions and their implica- tions for their intended learning goals and skills. Alternative assessment is defined as a technique that has a higher formative and motivating value for students [38]. Alterna- tive evaluations have been frequently employed as a catalyst for technology adoption to help learners better comprehend technological functions and their implications for their intended learning goals and skills. The evaluation emphasizes students’ innova- tive ideas and efforts; this may be seen as a kind of creative self-expression and an alternate method of evaluating the project-based learning process [26,39]. Essentially, performance and reflection are the two components of the learning experience that are regarded fundamental for students to have a meaningful online learning experience. Individuals within the educational sector have varying perspectives on how assessment procedures should be implemented. Cognitive assessment, performance assessment, and portfolio evaluation are all included in the setting; performance assess- ment was shown to have the most impact on alternative evaluation. Additionally, other evaluation techniques used in practice include open-ended inquiries, displays, demon- strations, hands-on experimentation, computer simulation, and portfolios. Given the evidence that authentic alternative assessment is critical for effective online learning, assessment may be implemented via resources, learning tools, motivation, and assess- ment technologies [40]. Additionally, this indicates that rubrics and student portfolios achieve parity in terms of alternative evaluation in online environments. As a result, including alternate evaluations is critical for optimizing the learning experience. To the researcher’s knowledge, relatively few studies have been undertaken on the influence of alternate evaluation methods on the learning experience associated with e-learning. In educational performance evaluations, especially those involving e-learning, an alternative assessment is seen as a distinct concept. 3 Methodology A quantitative analysis and survey techniques were utilised to examine the impact of various assessment mediator variables on students’ learning preparedness, engagement, motivation, and learning experience [41,42]. A total of 312 respondents who utilised the Blackboard online learning platform were chosen using a nonprobability sample iJIM ‒ Vol. 15, No. 18, 2021 19 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... methodology that combines judgemental and convenience sampling. This strategy allows for the decrease of respondents’ selection bias. To ensure that all inquiries were addressed by respondents, an electronic media data gathering approach was utilised. In terms of data analysis, structural equation modelling with partial least squares (i.e. PLS-SEM) estimation multivariate data technique was used since the sample size can be considered as relatively small, and the conceptual framework for this study can be considered complex (consisting of two mediator paths simultaneously) [43,44]. PLS-SEM can also be considered as an optimal statistical data analysis tool for handling second-order measurement variables; the analysis allows the use of latent variable score (LVS) from the first-order measurement variable analysis as the indicator score for the second-order measurement variable [45,46]. The significance test in the PLS-SEM analysis was computed by using the bootstrapping method, which is considered more robust than the conventional t-test method [45,46]. Therefore, 5000 replications of samples were computed to obtain reliable results for the empirical t-statistics and bias corrected (i.e. BCa) bootstrap [43]. The following method for determining the mediating impact was utilised for evaluating the effect of mediation [47,48]: 1. A full mediation effect was seen if the route from the independent to the dependent variable did not show statistical significance was statistically significant because of the indirect influence. 2. A partial mediation effect occurs when the path from the independent variable to the dependent variable is significant and the indirect impact is substantial, which indicates that the mediating effect was only partially effective. 4 Analysis and result 4.1 Measurement model analysis In accordance with Table 1, all the indicators that were utilized for assessing the constructs that are being addressed in the first-order measurement model satisfy the minimal threshold value for at least .70 factor loading in the first-order model. The AVE index for each construct was more than .50, and that both reliability tests (i.e., compos- ite reliability and Cronbach’s Alpha) for each targeted construct were greater than .70 [43,49]. They demonstrate that each variable in the first-order measurement model is possible to consider it to have the best unidimensional validity, which is consistent with previous results [43,44]. 20 http://www.i-jim.org Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... Ta bl e 1. C on ve rg en t v al id ity fo r fi rs t- or de r m ea su re m en t m od el In di ca to r L oa di ng AV E C R C A L ea rn in g R ea di ne ss I h av e a pr iv at e pl ac e in m y ho m e or a t w or k th at I ca n us e fo r e xt en de d pe ri od s .9 09 ** .7 57 .9 03 .8 41 I h av e ad eq ua te ti m e th at w ill b e un in te rr up te d w hi ch I ca n w or k on m y on lin e co ur se .8 58 ** I v al ue a nd /o r n ee d fle xi bi lit y w hi ch I ca n w or k on m y on lin e co ur se .8 42 ** C og ni ti ve E ng ag em en t .8 75 .9 55 .9 29 U si ng th e on lin e pl at fo rm p ro m pt s m e ac tiv el y de vo te m ys el f t o st ud y .9 27 ** U si ng th e on lin e pl at fo rm k ee ps m e ac tiv e in le ar ni ng .9 56 ** U si ng th e on lin e pl at fo rm c an k ee p m y in te nt io n fo cu se d on le ar ni ng .9 23 ** E m ot io na l E ng ag em en t I e nj oy th e le ar ni ng b ec au se u si ng th e on lin e pl at fo rm .9 48 ** .8 48 .9 57 .9 40 T he c ou rs e is in te re st in g be ca us e it us es th e on lin e pl at fo rm .9 47 ** U si ng th e on lin e pl at fo rm re du ce s th e am ou nt o f t im e I s pe nd d oi ng s om et hi ng e ls e in th e cl as s .8 39 ** I f ee l e xc ite d w he n le ar ni ng b y us in g th is o nl in e pl at fo rm .9 45 ** In tr in si c M ot iv at io n I e nj oy th e fu n of le ar ni ng in te ra ct iv el y vi a th e on lin e pl at fo rm .9 39 ** .8 08 .9 44 .9 19 I f ee l t ha t e ng ag in g w ith a nd le ar ni ng in te ra ct iv el y vi a on lin e pl at fo rm is fu n .9 39 ** I f ee l t ha t l ea rn in g vi a on lin e pl at fo rm is in te re st in g .9 26 ** I f ee l l ea rn in g vi a on lin e pl at fo rm c an c ha lle ng e m e to le ar n ex te ns iv el y .7 82 ** E xt ri ns ic M ot iv at io n I f ee l t ha t l ea rn in g vi a on lin e pl at fo rm is h el pf ul fo r m y ac ad em ic fu tu re .9 24 ** .8 17 .9 47 .9 25 I f ee l t ha t l ea rn in g vi a on lin e pl at fo rm a ttr ac ts m e to p ar tic ip at e in th e le ar ni ng s ys te m .9 25 ** I t hi nk th e ex pe ri en ce le ar ni ng v ia a n on lin e pl at fo rm w ill b e he lp fu l f or s tu dy in g in to th e ne xt le ve l .9 28 ** I t hi nk it w ill b e be ne fic ia l t o m y ac ad em ic fu tu re If I ac hi ev e go od re su lt w he n I l ea rn u si ng a n on lin e pl at fo rm .8 36 ** (c on tin ue d) iJIM ‒ Vol. 15, No. 18, 2021 21 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... A lt er na ti ve A ss es sm en t In g en er al , a t t hi s m om en t, I p er ce iv e th at te st in g an d as se ss m en t i n an o nl in e pl at fo rm h av e a po si tiv e ef fe ct o n m y le ar ni ng .8 82 ** .8 06 .9 71 .9 65 In g en er al , a t t hi s m om en t, I p er ce iv e th at te st in g an d as se ss m en t i n an o nl in e pl at fo rm a dd v al ue to th e tim e I h av e sp en t o n th e w or k do ne .8 87 ** In g en er al , a t t hi s m om en t, I p er ce iv e th at te st in g an d as se ss m en t i n an o nl in e pl at fo rm a re v al ua bl e in st an ce s of le ar ni ng in th ei r o w n ri gh t .9 13 ** In g en er al , a t t hi s m om en t, I p er ce iv e th at te st in g an d as se ss m en t i n an o nl in e pl at fo rm m e to c on tin ue le ar ni ng .9 26 ** In g en er al , a t t hi s m om en t, I p er ce iv e th at te st in g an d as se ss m en t i n an o nl in e pl at fo rm h el p m e to n av ig at e m y ow n le ar ni ng p ro ce ss .8 65 ** In g en er al , a t t hi s m om en t, I p er ce iv e th at te st in g an d as se ss m en t i n an o nl in e pl at fo rm a re g ea re d to w ar ds th e re te nt io n of m y co m pe te nc ie s in th e lo ng er p er io d .8 95 ** In g en er al , a t t hi s m om en t, I p er ce iv e th at te st in g an d as se ss m en t i n an o nl in e pl at fo rm p re pa re m e w el l f or fu tu re le ar ni ng a ct iv iti es .9 01 ** In g en er al , a t t hi s m om en t, I p er ce iv e th at te st in g an d as se ss m en t i n an o nl in e pl at fo rm g iv e m e co nfi de nc e to c on tin ue le ar ni ng .9 09 ** C om pe te nc ie s E xp er ie nc e A s a le ar ne r, I s ee m ys el f a s hi gh ly c om pe te nt in u si ng o nl in e pl at fo rm te ch no lo gi es .8 28 ** .8 34 .9 53 .9 33 M y le ar ni ng e xp er ie nc e in th is o nl in e pl at fo rm h as m ad e m e fe el c on fid en t a s a le ar ne r .9 40 ** M y le ar ni ng e xp er ie nc e in th is o nl in e pl at fo rm h as m ot iv at ed m e to le ar n m or e .9 33 ** M y le ar ni ng e xp er ie nc e in th is o nl in e pl at fo rm h as fu lly e ng ag ed m e as a le ar ne r .9 47 ** C ri ti ca l T hi nk in g E xp er ie nc e M y le ar ni ng e xp er ie nc e in th is o nl in e pl at fo rm h as m ak e m e ab le to a na ly se a nd o rg an is e in fo rm at io n fo r m y su bj ec t .9 14 ** .8 36 .9 53 .9 35 M y le ar ni ng e xp er ie nc e in th is o nl in e pl at fo rm h as m ad e m e ab le to e va lu at e is su es c ri tic al ly fo r m y su bj ec t .9 31 ** M y le ar ni ng e xp er ie nc e in th is o nl in e pl at fo rm h as m ad e m e ab le to a pp ly th eo re tic al k no w le dg e to pr ac tic e .9 00 ** M y le ar ni ng e xp er ie nc e in th is o nl in e pl at fo rm h as m ad e m e ab le to d ev el op n ew id ea s .9 12 ** N ot es : A V E = A ve ra ge V ar ia nc e E xp la in ed ; C R = C om po si te R el ia bi lit y; C A = C ro nb ac h’ s A lp ha ; * *p < .0 1. 22 http://www.i-jim.org Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... As for the discriminant validity of each latent variable in this measurement, each of the HTMT ratio values was below .90, which means that each latent variable fully discriminates from the others (Table 2). As a consequence, the set of indicators that were used to evaluate a specific construct were accurate in their measurement of that construct [50]. Table 2. HTMT discriminant analysis for first-order measurement model (1) (2) (3) (4) (5) (6) (7) (8) (1) – (2) .719** – (3) .739** .819** – (4) .743** .855** .854** – (5) .758** .860** .856** .869** – (6) .730** .815** .824** .821** .815** – (7) .819** .816** .811** .815** .794** .871** – (8) .836** .761** .750** .794** .777** .872** .820** – Notes: (1) = Learning Readiness; (2) = Cognitive Engagement; (3) = Emotional Engagement; (4) = Intrinsic Motivation; (5) = Extrinsic Motivation; (6) = Alternative Assessment; (7) = Competencies Experience; (8) = Critical Thinking Experience; **p <.01. Because the first-order measurement model passed the convergent and discriminant validity requirements, the LVS scores computed at this step may be utilised as a result of the indicators’ performance within the framework of the second-order polynomial measurement model. As shown in Table 3, the LVS ratings for Cognitive Engagement and Emotional Engagement were intended to assess the Student Engagement construct, while the LVS ratings for Social Engagement were intended to test the Student Engage- ment construct. The Intrinsic Motivation score on the LVS and Extrinsic Motivation constructs were also used as indicators for measuring the Student Motivation construct, as shown in Table 4. The same procedure was also applied for measuring the Learn- ing Experience construct. The LVS scores for Competencies Experience and Critical Thinking Experience were used as indicators for measuring the Learning Experience construct. The indications for the Learning Readiness and Alternative Assessment constructs, on the other hand, are more specific and were retained as those from the first-order measurement model throughout this analysis step, since these two constructs lacked a dimension construct. iJIM ‒ Vol. 15, No. 18, 2021 23 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... Table 3. Convergent validity for second-order measurement model Indicator Loading AVE CR CA Learning Readiness I have a private place in my home or at work that I can use for extended periods .909** .757 .903 .841 I have adequate time that will be uninterrupted which I can work on my online course .858** I value and/or need flexibility which I can work on my online course .842** Student Engagement aCognitive Engagement .964** .930 .964 .925 aEmotional Engagement .965** Student Motivation aIntrinsic Motivation .966** .932 .965 .927 aExtrinsic Motivation .965** Alternative Assessment In general, at this moment, I perceive that testing and assessment in an online platform have a positive effect on my learning .882** .806 .971 .965 In general, at this moment, I perceive that, testing and assessment in an online platform add value to the time I have spent on the work done .887** In general, at this moment, I perceive that testing and assessment in an online platform are valuable instances of learning in their own right .913** In general, at this moment, I perceive that testing and assessment in online platform me to continue learning .926** In general, at this moment, I perceive that testing and assessment in an online platform help me to navigate my own learning process .865** In general, at this moment, I perceive that testing and assessment in an online platform are geared towards the retention of my competencies in the longer period .895** In general, at this moment, I perceive that testing and assessment in an online platform prepare me well for future learning activities .901** In general, at this moment, I perceive that testing and assessment in an online platform give me confidence to continue learning .909** Learning Experience aCompetencies Experience .965** .930 .964 .925 aCritical Thinking Experience .964** Notes: a This is using Latent Variable Score estimation; AVE = Average Variance Explained; CR = Composite Reliability; CA = Cronbach’s Alpha; **p <.01. 24 http://www.i-jim.org Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... On the other hand, the minimum threshold value of .70 for factor loading, as well as the minimum threshold values for AVE, composite reliability, and Cronbach’s Alpha for each construct, are met in the second-order measurement model, as shown in Table 3. As a result of these findings, each construct in the second-order measurement model may be deemed to have adequate unidimensional validity [43,44]. Table 4. HTMT discriminant analysis for second-order measurement model (1) (2) (3) (4) (5) (1) – (2) .761** – (3) .776** .812** – (4) .730** .825** .846** – (5) .763** .806** .839** .815** – Notes: (1) = Learning Readiness; (2) = Student Engagement; (3) = Student Motivation; (4) = Alternative Assessment; (5) = Learning Experience; **p <.01. If we look at how well the second-order measurement model discriminates among itself, each latent construct completely distinguishes itself from the others since each HTMT ratio was less than 90. (See Table 4). Because of this, the set of indicators that were utilized to assess the construct in the second-order measurement model were accurate in measuring the construct in concern [50]. 4.2 Structural model analysis The structural model analysis indicates that the all independent constructs—Learning Readiness, Student Engagement, and Student Motivation—were able to provide 83% the proportion of variance that can be explained toward the Alternative Assessment mediator construct. Simultaneously, a combination of the three independent constructs with the mediator construct was successful in explaining about 78.5 percent of the variance explained toward the Learning Experience. Both the effect size as well as the predictive relevance size of the Learning Readiness dimension are substantial in relation to the Alternative Assessment mediator construct, indicating that it is a good predictor of the latter. Contrary to this, the impact sizes of the Student Engagement and Student Motivation constructs on the mediator construct are moderate, and their pre- dictive relevance sizes are also moderate (Table 5). In the same way, when compared to the Learning Experience mediator construct, the Alternative Assessment mediator construct was able to provide a high magnitude of the impact and the size of predictive significance. The analysis also indicates that the effect size and the predictive rele- vance size for the three independent constructs toward the dependent construct were categorised as a small effect. Hence, the analysis of effect size together with predictive relevance of the structural model may be regarded to have fulfilled the very minimal requirements for a PLS model, which the magnitude of this impact is greater than zero. iJIM ‒ Vol. 15, No. 18, 2021 25 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... Table 5. Structural model Path Β t-Statistic p-Value 95% BCa Bootstrap f 2 q2 Remark LRE → ALE 0.529 11.410** <.01 (0.433, 0.614) .206 .193 Large STE → ALE 0.296 5.248** <.01 (0.190, 0.409) .119 .086 Medium STM → ALE 0.175 3.069** .002 (0.071, 0.294) .110 .076 Medium ALE → LEX 0.486 6.779** <.01 (0.344, 0.624) .187 .172 Large LRE → LEX 0.129 2.424* .015 (0.031, 0.237) .021 .005 Small STE → LEX 0.144 2.261* .024 (0.024, 0.275) .026 .009 Small STM → LEX 0.192 2.729** .006 (0.055, 0.330) .037 .012 Small Notes: LRE = Learning Readiness; STE = Student Engagement; STM = Student Motivation; ALE = Alternative Assessment; LEX = Learning Experience; β = Standardized Beta Coefficient; f 2 = Effect Size; q2 = Predictive Relevance; *p <.05; **p <.01. According to the results of the cause and effect study, all of the relevant paths were positive statistically significant at a level of 95 percent confidence level (Table 5). All of the t-statistic values were greater than 1.96, which indicates statistical significance at the 5 percent level of significance. Following the BCa (Bootstrapping confidence interval analysis), the results are similarly consistent with the t-statistical analysis: the 95 percent confidence interval does not include the value 0. 4.3 Mediating analysis The mediating analysis (Table 6) indicates that the alternative assessment statistically and simultaneously mediated the relationship of LRE → LEX, STE → LEX and STM → LEX. This is because the indirect effect coefficients are significant at 5% level of error (t-statistics > 1.96), and the 95% BCa bootstrapping confidence interval does not include the zero value. Since all the direct effects of this structural model (i.e. LRE → LEX, STE → LEX and STM → LEX) are statistically significant, the mediator paths of LRE → ALE → LEX, STE → ALE → LEX and STM → ALE → LEX can be classified partially mediated. Figure 1 and Figure 2 show the results of the analysis using PLS-SEM algorithm. Table 6. Indirect effect assessment Indirect Path IEC t-Statistic p-Value 95% BCa Bootstrap LRE → ALE → LEX 0.257 6.075** <.01 (0.182, 0.345) STE → ALE → LEX 0.144 4.069** <.01 (0.081, 0.219) STM → ALE → LEX 0.085 2.670** .008 (0.033, 0.158) Notes: LRE = Learning Readiness; STE = Student Engagement; STM = Student Motivation; ALE = Alternative Assessment; LEX = Learning Experience; IEC = Indirect Effect Coefficient; **p <.01. 26 http://www.i-jim.org Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... Fig. 1. PLS SEM analysis output for loading and path coefficient values Fig. 2. PLS SEM analysis output for t-statistic values via bootstrapping analysis 5 Conclusions and discussion As many HEIs invest in developing their capacity and capacities in digital education as a means of achieving a competitive edge throughout internationalisation, the results of this research may be utilised to further our understanding of learning theory. Learn- ers from diverse backgrounds may accept a variety of learning styles, depending on the teaching techniques used to maximise learning efficacy. Thus, the results indicate numerous suggestions to HEIs about the development and classification of an education iJIM ‒ Vol. 15, No. 18, 2021 27 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... ecosystem that spans cultures, teaching styles, and efficacy characteristics. The findings may contribute to improving the quality of education and generating revenue via digital learning in an open system. Based on the findings, learning readiness, student engagement, and motivation all have a significant role in determining the quality of an online learning experience. Alternative assessment was recognised as the mediator function, making it a priority. The new learning environment for remote students is favourable, since younger gener- ations are willing to study, participate, and interact with their teachers, despite the fact that alternative evaluations were seldom used prior to the epidemic. Students’ options have risen as a result of the quickly growing digital learning environment. Thus, HEIs should embrace digitalization of education and use it to advance and increase knowl- edge, notably via distance-learning programmes. Adult learners need a variety of teaching methodologies in online distance learning (ODL) programmes, as well as a variety of learning settings as moderators, which leads in a unique learning experience that may be the subject of future study. Additionally, the digitisation of education has increased prospects for interna- tional cooperation in academic programmes by attracting more students from differ- ent nations. Due to the variety of learning preferences and styles throughout cultures, the learning process has become more open and adaptable. This has resulted in an increase in online educational methodologies. Online education in a digital education system requires high-quality learning outcomes and experiences, highlighting the need of understanding how learners absorb information. By presenting and sharing knowl- edge in the manner in which learners perceive it, they will have a greater opportunity to choose instructors who match their learning styles, therefore gaining control over their learning. Thus, while making online learning choices, it is crucial to evaluate the learner’s experience with e-learning systems, since this is considering the benefits to the learner’s overall learning well-being and academic achievement. 6 References [1] Yasin, N.M., Ong, M.H.A., & Aziz, N.N.A. (2020). Attitude as Mediator of Technical Usage Self-Efficacy, Online Communication Self-Efficacy, Technology Access and Online Media on the Blended Learning Readiness. International Journal of Advanced Science and Technology, 29 (6s), 713–724. [2] Syakur, A. (2020). The effectiveness of English learning media through Google Classroom in Higher Education. Britian International of Linguistics Arts and Education (BIoLAE) Journal, 2(1), 475–483. https://doi.org/10.33258/biolae.v2i1.218 [3] Ichssan, I.Z., & Rahmayanti, H. (2020). HOTSTEP: Revised Anderson’s Taxonomy in environmental learning of Covid-19. European Journal of Educational Research, 9(3), 1257–1265. https://doi.org/10.12973/eu-jer.9.3.1257 [4] Putranti, N. (2016). Cara membuat media pembelajaran online menggunakan edmodo. Jurnal Pendidikan Informatika dan Sains, 2(2), 139–147. [5] Ibrahim, D.S.M., & Febriani, Y. (2018). Pengembangan E-Materi berbasis mata kuliah pada pembelajaran jarak jauh (E-Learning). Jurnal DIDIKA: Wahana Ilmiah Pendidikan Dasar, 4(2), 1–16. https://doi.org/10.29408/didika.v4i2.1170 28 http://www.i-jim.org https://doi.org/10.33258/biolae.v2i1.218 https://doi.org/10.12973/eu-jer.9.3.1257 https://doi.org/10.29408/didika.v4i2.1170 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... [6] Prayitno, A. (2015). Pemanfaatan sistem informasi perpustakaan digital berbasis website untuk para penulis. Indonesia Journal on Software Engineering (IJSE), 1(1), 28–37. [7] Adams, D., Suminto, B., Mohamed, A., & Mohamad Noor, N.S. (2018). E-learning read- iness among students of diverse backgrounds in a leading Malaysian Higher Educational Institution. Malaysian Journal of Learning and Instruction, 15(2), 227–256. https://doi. org/10.32890/mjli2018.15.2.9 [8] Herguner, G., Son, S.B., Son, S.H., & Donmez, S. (2020). The effect of online learning attitudes of University on their Online Learning Readiness. The Turkish Online Journal of Educational Technology, 19(4), 102–110. [9] Hui Lin, H., Lin, S., Hsuan Yeh, C., & Wang, Y.S. (2015). Measuring mobile learning read- iness: scale development and validation. Internet Research, 26(1), 265–287. https://doi. org/10.1108/IntR-10-2014-0241 [10] Fang, J., & Teng, M. (2021). Discussion on the improvement of online learning ability of higher vocational college students by online games and the existing problems. Journal of Physics: Conference Series, 1915(4), 1–9. https://doi.org/10.1088/1742-6596/1915/4/042054 [11] Horzum, B.H., Ozturk, E., Bektas, M., Gungoren, O.C., & Cakir, O. (2014). Secondary school students tablet computer acceptance and readiness: A structural equation modelling. Education and Science, 39(176), 81–93. https://doi.org/10.15390/EB.2014.3500 [12] Geng, S., Law, K.M.Y., & Niu, B. (2019). Investing self-directed learning and technology readiness in blended learning environment. International Journal of Educational Technology in Higher Education, 16(1), 1–22. https://doi.org/10.1186/s41239-019-0147-0 [13] Demir, K.Z., & Horzum, M.B. (2013). Relationship between online learning readiness and structure and interaction of online learning students. Educational Sciences: Theory and Practise, 13(1), 1792–1797. [14] Sahoo, S. (2016). Finding self-directed learning readiness and fostering self-directed learn- ing through weekly assessment of self-directed learning topics during undergraduate clinical training in ophthalmology. International Journal of Applied and Basic Medical Research, 6(3), 1–5. https://doi.org/10.4103/2229-516X.186959 [15] Wang, W., & Zhan, J. (2020). The relationship between English Language Learner charac- teristics and online self-regulation: A structural equation modeling approach. Sustainability, 12(7), 1–25. https://doi.org/10.3390/su12073009 [16] Mishra, D.S., Agarwal, A., & Kolekar, S.V. (2021). Dynamic Identification of Learning Styles in MOOC Environment Using Ontology Based Browser Extension. International Journal of Emerging Technologies in Learning, 16(12). 65–93. https://doi.org/10.3991/ijet. v16i12.21789 [17] Zhan, Z., & Mei, H. (2013). Academic self-concept and social presence in face to face and online learning, perceptions and effects on student’s learning achievement and satisfaction across environments. Computer and Education, 69(1), 131–138. https://doi.org/10.1016/j. compedu.2013.07.002 [18] Ramirez, D.M., & Gillig, S. (2018). Computer technology and twitter for online learning and student engagement. Journal of Multidisciplinary Research, 10(1/2), 137–153. https:// doi.org/10.4324/9780429444654-9 [19] Guo, P.J., Kim, J., & Rubin, R. (2014). How video production affects student engagement: an empirical study of MOOC videos. Proceedings of the 1st ACM Conference on Learning at Scale, pp. 41–50. https://doi.org/10.1145/2556325.2566239 [20] Ncubukezi, T., & Daramola, O. (2020). Influence of e-learning via blackboard on the learning experiences of late bloomers in information technology. European Conference on e-learning, Kidmore End (Oct 2020). DOI:10.34190/EEL.20.017. iJIM ‒ Vol. 15, No. 18, 2021 29 https://doi.org/10.32890/mjli2018.15.2.9 https://doi.org/10.32890/mjli2018.15.2.9 https://doi.org/10.1108/IntR-10-2014-0241 https://doi.org/10.1108/IntR-10-2014-0241 https://doi.org/10.1088/1742-6596/1915/4/042054 https://doi.org/10.15390/EB.2014.3500 https://doi.org/10.1186/s41239-019-0147-0 https://doi.org/10.4103/2229-516X.186959 https://doi.org/10.3390/su12073009 https://doi.org/10.3991/ijet.v16i12.21789 https://doi.org/10.3991/ijet.v16i12.21789 https://doi.org/10.1016/j.compedu.2013.07.002 https://doi.org/10.1016/j.compedu.2013.07.002 https://doi.org/10.4324/9780429444654-9 https://doi.org/10.4324/9780429444654-9 https://doi.org/10.1145/2556325.2566239 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... [21] Lawrence, J., Brown, A., Redmond, P., & Basson, M. (2019). Engaging the disengaged: Exploring the use of course-specific learning analytics and nudging to enhance online student engagement. Student Success, 10(2), 47–58. https://doi.org/10.5204/ssj.v10i2.1295 [22] Dzuiban, C.D., Hartman, J.L., Cavanagh, T.B., & Moskal, P.D. (2011). Blended courses as drivers of institutional transformation. In A. Kitchenham (Ed), Blended learning across disciplines: Model for implementation (pp. 17–37). Hershey, PA: IGI Global. https://doi. org/10.4018/978-1-60960-479-0.ch002 [23] Henrie, C.R., Bodily, R., Manwaring, K.C., & Graham, C.R. (2015). International Review of Research in Open and Distributed Learning, 16(3), 131–155. https://doi.org/10.19173/ irrodl.v16i3.2015 [24] Bouilheres, F., Le le Thi Viet, H., McDonald, S., Nkhoma, C., & Jandug-Montera, L. (2020). Defining student learning experience through blended learning. Education and Information Technologies, 25(4), 3049–3069. https://doi.org/10.1007/s10639-020-10100-y [25] Ouchaouka, L., Laouina, Z., Moussetad, M., Talbi, M., & Elamrani, N. (2021). The Effec- tiveness of a Learner-Centered Pedagogical Approach with Flipped Pedagogy and Digital Learning Environment in Higher Education Feedback on a Cell Biology Course. Interna- tional Journal of Emerging Technologies in Learning, 16(12). https://doi.org/10.3991/ijet. v16i12.19125 [26] Mathews, N., Sriratanaviriyakul, N., Hiep, P.C., & Lam, T.K. (2014). Examining the mediating role of learning engagement, learning process and learning experience on the learning outcomes through localized real case studies. Education and Training, 56(4), 287–302. https://doi.org/10.1108/ET-01-2013-0005 [27] Mohandas, P., & Vinitwatanakhun, A. (2020). Student engagement and students’ equity in Thai engagement in the Thai context. The New English Teacher, 14(1), 33–42. [28] Grau, S.L., & Akin, R. (2011). Experiential learning for nonbusiness students: Students engagement using a marketing trade show. Marketing Education Review, 21(1), 69–78. https://doi.org/10.2753/MER1052-8008210110 [29] Hauze, S., & Marshall, J. (2020). Validation of the instructional materials motivating survey: measuring student motivation to learn via mixed reality nursing education simulation. International Journal on E-Learning, 19(1), 49–64. [30] Jones, B.D., Epler, C.M., Mokri, P., Bryant, L.H., & Paretti, M.C. (2013). The effects of a collaborative problem-based learning experience on students’ motivation in Engineering Capstone Courses. Interdisciplinary Journal of Problem Based Learning, 7(2), 34–71. https://doi.org/10.7771/1541-5015.1344 [31] Cho, M.H., & Heron, M.L. (2015). Self-regulated learning: the role of motivation, emotion and use of learning strategies in students’ learning experiences in a self paced online mathematics course. Distance Education, 36(1), 80–99. https://doi.org/10.1080/01587919 .2015.1019963 [32] Trolian, T., & Jach, E.A. (2020). Engagement in college and university applied learning experiences and student’s academic motivation. Journal of Experiential Education, 43(3), 317–335. https://doi.org/10.1177/1053825920925100 [33] Gan, Z., He., J., Liu, F., & Xie, Q. (2020). Classroom feedback practice and students’ learning motivation: experiences of English as a foreign language (EFL) students. Applied Language Learning, 30(1–2), 18–40. [34] Kim, K.J., & Frick, T.W. (2011). Changes in student motivation during online learning. Journal of Educational Computing Research, 44(1), 1–23. https://doi.org/10.2190/ EC.50.1.a; https://doi.org/10.2190/EC.44.1.a [35] Cho, M.H., & Heron, M.L. (2015). Self-regulated learning: the role of motivation, emotion, and use of learning strategies in students learning experiences in a self-paced online mathematics course. Distance Education, 36(1), 80–99. https://doi.org/10.1080/01587919.2015.1019963 30 http://www.i-jim.org https://doi.org/10.5204/ssj.v10i2.1295 https://doi.org/10.4018/978-1-60960-479-0.ch002 https://doi.org/10.4018/978-1-60960-479-0.ch002 https://doi.org/10.19173/irrodl.v16i3.2015 https://doi.org/10.19173/irrodl.v16i3.2015 https://doi.org/10.1007/s10639-020-10100-y https://doi.org/10.3991/ijet.v16i12.19125 https://doi.org/10.3991/ijet.v16i12.19125 https://doi.org/10.1108/ET-01-2013-0005 https://doi.org/10.2753/MER1052-8008210110 https://doi.org/10.7771/1541-5015.1344 https://doi.org/10.1080/01587919.2015.1019963 https://doi.org/10.1080/01587919.2015.1019963 https://doi.org/10.1177/1053825920925100 https://doi.org/10.2190/EC.50.1.a https://doi.org/10.2190/EC.50.1.a https://doi.org/10.2190/EC.44.1.a https://doi.org/10.1080/01587919.2015.1019963 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... [36] Salah Eldin, K., Al-Shafie, A.I., Abdel Halim, S., & Otoom, S. (2015). Relationship between the quality of blended learning experience, self-regulated learning, and academic achieve- ment of medical students: a path analysis. Advances n Medical Education and Practices, 6(2015), 27–34. https://doi.org/10.2147/AMEP.S75830 [37] Cigdem, H., & Ozturk, M. (2016). Critical components of online learning readiness and their relationships with learner achievement. Turkish Online Journal of Distance Education, 17(2), 98–109. https://doi.org/10.17718/tojde.09105 [38] Williams, P. (2014). Squarring the circle: a new alternative to alternative-assessment. Teaching in Higher Education, 19(5), 565–577. https://doi.org/10.1080/13562517.2014.882894 [39] Smith, S. (2016). (Re) counting meaningful learning experiences: Using student-created reflective videos to make invisible learning visible during PjBL experiences. Interdisciplinary Journal of Problem based Learning, 10(1), 16. DOI: https://doi.org/10.7771/1541-5015.1541 [40] Alotaibi, S.R. (2021). A Novel Framework of Success Using of E-Assessment During Corona Pandemic. International Journal of Emerging Technologies in Learning, 16(12). https://doi.org/10.3991/ijet.v16i12.22063 [41] Creswell, J.W. (2014). Educational Research: Planning, Conducting and Evaluating Quanti- tative and Qualitative Research (4th ed.). London: Pearson New International Edition. [42] Saunders, M., Lewis, P., & Thornhill, A. (2009). Research Method for Business Students (5th ed.). New York: Prentice Hall Publications. [43] Hair, J.F., Hult, G.T.M., Ringle, C.M., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling. (PLS-SEM) (2nd ed.). Thousand Oaks: Sage Publications. [44] Ong, M.H.A., & Puteh, F. (2017). Quantitative Data Analysis: Choosing Between SPSS, PLS, and AMOS in Social Science Research. International Interdisciplinary Journal of Scientific Research, 3(1), 14–25. [45] Hair, J.F., Sarstedt, M., Ringle, C.M., & Mena, J.A. (2012). An assessment of the use of partial least squares structural equation modeling in marketing research. Journal of the Academy Marketing Science, 40(3), 414–433. https://doi.org/10.1007/s11747-011-0261-6 [46] Henseler, J., & Chin, W.W., (2010). A comparison of approaches for the analysis of inter- action effects between latent variables using partial least squares path modeling. Structural Equation Modeling 17(1), 82–109. https://doi.org/10.1080/10705510903439003 [47] Zhao, X., Lynch, J.G.J., & Chen, Q. (2010). Reconsidering Baron and Kenny: Myths and truth about mediation analysis. Journal of Consumer Research, 17, 197–206. https://doi. org/10.1086/651257 [48] Iacobucci, D., Saldanha, N., & Deng, X. (2007). A meditation on mediation: Evidence that structural equation models perform better than regression. Journal of Consumer Psychology, 7(2), 140–154. https://doi.org/10.1016/S1057-7408(07)70020-7 [49] Hair, J.F., Ringle, C.M., & Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet. Jour- nal of Marketing Theory and Practice, 19(2), 139–151. https://doi.org/10.2753/ MTP1069-6679190202 [50] Henseler, J., Ringle, C.M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modelling. Journal of the academy of market- ing science, 43(1), 114–135. https://doi.org/10.1007/s11747-014-0403-8 iJIM ‒ Vol. 15, No. 18, 2021 31 https://doi.org/10.2147/AMEP.S75830 https://doi.org/10.17718/tojde.09105 https://doi.org/10.1080/13562517.2014.882894 https://doi.org/10.7771/1541-5015.1541 https://doi.org/10.3991/ijet.v16i12.22063 https://doi.org/10.1007/s11747-011-0261-6 https://doi.org/10.1080/10705510903439003 https://doi.org/10.1086/651257 https://doi.org/10.1086/651257 https://doi.org/10.1016/S1057-7408(07)70020-7 https://doi.org/10.2753/MTP1069-6679190202 https://doi.org/10.2753/MTP1069-6679190202 https://doi.org/10.1007/s11747-014-0403-8 Paper—Immersive Experience during Covid-19: The Mediator Role of Alternative Assessment... 7 Authors Mohd Hanafi Azman Ong, Department of Statistics and Decision Sciences, Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA (Kampus Segamat), Segamat, Johor, Malaysia. E-mail: napieong@uitm.edu.my. Norazlina Mohd Yasin, School of Professional and Continuing Education, Univer- siti Teknologi Malaysia (UTMSPACE), Skudai, Johor, Malaysia. E-mail: norazlina@ utmspace.edu.my. Nur Syafikah Ibrahim, Department of Computer Sciences, Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA (Kampus Segamat), Segamat, Johor, Malaysia. E-mail: nursyafikah@uitm.edu.my. Article submitted 2021-06-04. Resubmitted 2021-07-29. Final acceptance 2021-07-29. Final version published as submitted by the authors. 32 http://www.i-jim.org mailto:napieong@uitm.edu.my mailto:norazlina@utmspace.edu.my mailto:norazlina@utmspace.edu.my mailto:nursyafikah@uitm.edu.my