ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. A SYSTEMATIC LITERA- TURE REVIEW ON THE IN- TERSECTION OF EXPERIEN- TIAL AND MULTIMEDIA LEARNING WITH VIRTUAL REALITY AND ITS IMPLICA- TIONS RUT MEHTA, CLAUDIA SANTACRUZ, BRIANNA LISCHY ✵ ABSTRACT This literature review examines the current literature and research surrounding the foundations and applications of experiential and multimedia learning in virtual reality environments. Eleven in- sightful research papers are discussed, detailing the efforts and results of multimedia learning and expe- riential learning in virtual reality independently, not combined. The literature, and consequently the lit- erature review, heavily pulls from Kolb’s Experiential Learning model and Mayer’s Cognitive Theory of Multimedia Learning. We find a general trend sug- gesting the efficacy of creating experiential learn- ing-based lessons and the efficacy of multimedia learning formats. However, based on the literature, combining these two theories and techniques may result in higher student engagement and content retention. This literature review also explores the thresholds for sensory stimuli fidelities necessary to create meaningful, effective, immersive virtual real- ity content. However, further research will be re- quired to measure attention, retention, and infor- mation recall in different virtual reality and multime- dia lesson formats, as well as engagement and pos- itive emotions associated with learning. 1 INTRODUCTION Over a (college) semester, the team com- piled a literature review on current research sur- rounding the effectiveness of using virtual reality technologies to allow for accessible experiential learning. Experiential Learning can be defined as in- teractive learning by doing; however, the specifics of the processes of this method will be later dis- cussed in this paper. The team began by utilizing education theorist Richard Kolb’s definition of the experiential learning model to compile findings on the method’s effectiveness. Next, education theorist Richard Mayer and his research into multimedia learning styles with virtual reality as a supplement was incorporated into the literature review. Virtual Reality technology is the latest that employs a simu- lated experience in 3D near-eye displays via a head- mounted display (hardware). We aimed to see if combining these two learning styles via VR could create a synergy for the learner. Here VR is defined as “a high-end (complex) user interface that involves real-time simulation and interaction through multi- ple sensorial channels (visual and auditory stimuli)” (Burdea & Coiffet, 1994). As researchers, current Rutgers students, and founders of a VR EdTech startup, SageTech, the team seeks to understand if the technology is worth integrating into education as a supplement to multimedia learning and as an experiential learning method. In the exploration process, it was found that there is little research on VR in the educational space. As VR technology rap- idly advances, including adaptive learning systems, gamification, and cloud systems, there is a need for scientific exploration into the effect alternative learning methods will have on learners. Educators, administrators, parents, and students must under- stand the integration and outcomes of VR to make a holistic decision on learning style preferences. Fol- lowing Kolb's experiential learning model and May- er's multimedia learning theory, a literature review of the implementations and implications of mixed reality in education was conducted. For this publica- tion, significant components of the research were highlighted from the more extensive literature re- view on the subject. https://link.springer.com/article/10.1007/s11423-018-9581-2#ref-CR14 ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V 2 KOLB’S MODEL OF EXPERIENTIAL LEARNING Experiential learning is the process of learn- ing by doing, first popularized by American educa- tion philosopher John Dewey in 1939 with his the- ory of education. Dewey emphasized student en- gagement and progressive education, claiming that educators must stimulate learning via experience. In 1984, American psychologist, professor, and educational theorist David A. Kolb expanded Dewey’s findings in his experiential learning theory. Cited in the Journal of Experiential Education, Kolb’s model functions as both a cycle of the learn- ing process and highlights four adaptive learning modes (Schenck & Cruickshank, 2015). This four- step cyclical process includes the concrete experi- ence (feeling), reflective observation (watching), ab- stract conceptualization (thinking), and active exper- imentation (doing). The concrete experience is a new experi- ence or reinterpretation of an existing one requiring five themes: 1. The learner is an active participant, referring to the idea that learners are involved and participating in the learning process, such as inter- acting with a chemistry lab. 2. Knowledge is situated in a place and time, where learning is dynamic as opposed to static. It is influenced by the social, phys- ical, cultural, and environmental factors in which it takes place, a crucial key in learning about historical and social movements. 3. Learners are exposed to a novel experience that involves risk, where “novel” constitutes as new or challenging event leading to opportunity for growth, like team projects. 4. Learn- ing demands inquiry into specific real-world prob- lems. Lastly, 5. Critical reflection acts as a mediator of meaningful learning, where thoughtful analyza- tion allows the learner to reflect, such as a paper outlining surprises and lessons understood. Sec- ond, reflective observation entails the learner re- flecting on past experiences and considering their existing or new knowledge to identify gaps in un- derstanding. Third, abstract conceptualization grabs the observations made in the previous stage to create a theoretical approach. Fourth, learners can test their theories and apply what they have learned to the world around them through active ex- perimentation (1). FIGURE 1: Kolb’s model of experiential learning Kolb’s model is followed by four learning types, ac- commodating, diverging, converging, and assimilat- ing. Accommodating can best be described as learning hands-on and self-reliance on intuition. Di- verging applies to learners who prefer to watch and enhance the use of gathered information with crea- tivity. Converging emphasizes problem-solving with applied learning. Lastly, assimilating occurs when the learner encounters new information they try to fit into the web of their preexisting knowledge. These four learning types are identified along two bipolar dimensions: active-to-reflective (doing- watching) and concrete-to-abstract (feeling-think- ing). Learners that are more active and concrete are considered accommodators, and so on, following the diagram above (Cornwell & Manfredo, 1994). Neuroscience research has consistently supported the effectiveness of experiential learning as a key learning method. Cited in the Journal of Ex- periential Education, the authors write that “experi- ential learning integrates different neural networks during the learning event” (Piaget, 1950/2001), re- sulting in multiple memory pathways (Hebb, 1949) and connections between abstract concepts. The neural networks referred to are the different sensory channels (auditory and visual stimuli), kinesthetic stimuli (moving), and experience-based memory ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V pathways, such as episodic memory. The combina- tion of these different encoding pathways while ac- tively learning in an immersive environment aid in stronger memory retention. When students develop demonstrations of these abstract concepts or ex- plain them through multiple modalities, there is a significantly higher retention rate (Craik & Tulving, 1975). Multiple neural pathways encoding infor- mation is more effective for long-term memory and retention compared to practicing a strict “learning style” where a single approach limits the student. Furthermore, experiential learning offers opportuni- ties for novel experiences vital for memory for- mation. The literature review will touch on this phe- nomenon more in the following text. 3 THE ROLE OF SENSORY STIMULA- TION IN EXPERIENTIAL LEARNING (EL)/VR Multisensory aspects of experiences are es- sential for EL and aid furthermore in the retention process. Creating realistic experiences in virtual re- ality environments aims to foster brain and behav- ioral responses in the virtual world that are analo- gous to those in the real world. For instance, re- searchers have been able to view the sensorimotor system in a more controlled environment, which would not have been possible in real-world experi- ments. Although the quantifiable results of studies on this system are irrelevant to the scope of this pa- per, it is essential to note the accessibility of study- ing the sensory-motor system in a controlled envi- ronment while a patient wears a VR hardware piece. The sensorimotor system is a network of neurons that includes the body’s nervous system, sensory or- gans, and motor controls. When stimulated by a digital environment containing triggering stimuli, it is easier to measure this system in action. At the same time, the patient remains in the same location instead of the patient out in the world. In a study from Georgia Tech University pre- sented at the Institute of Electrical and Electronics Engineers (IEEE) Annual International Symposium Virtual Reality, 322 subjects participated in an ex- perimental study. The study investigated the effects of tactile (touch), olfactory (smell), audio (hearing), and visual (sight) sensory cues on a participant's sense of presence in a virtual environment by plac- ing the participants in a simulated corporate office suite and varying these sensory cues. There were four primary dependent variables: one question on the overall rating of presence (range from 0 to 100), a longer 13-item presence questionnaire, a four- item questionnaire on the spatial layout, and a five- item questionnaire on object location. The partici- pant’s memory was also tested on the objects in that environment (testing recall and retention). Results strongly indicate that increasing the different sen- sory modalities in a virtual environment can increase both the sense of presence and memory for objects in the environment (Dinh et al.). The paper From Presence to Consciousness through Virtual Reality by Maria V. Sanchez-Vives and Mel Slater further explores the concept of the presence or the feeling of “being there.” To take this further, consider “telepresence,” first introduced by Minsky in 1980. Telepresence is seen when the user acquires the sense that they are immersed in a dif- ferent environment than reality. For instance, a user of virtual reality technology sees through the eyes of a headset and uses their arms and legs to control in- game movements. Here, the machine “body” re- places one’s true self. The user is immersed in an en- vironment with similar bodily controls to reality, de- veloping the phenomena of telepresence. Similarly, “virtualization” occurs when the user interprets a vir- tual image as a real object without anything physi- cally being there. By immersing a user in a virtual space with virtualization and sensory stimuli, telepresence becomes possible. ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V FIGURE 2: Early visualizations (top) and the physical setup (bottom) of telepresence The diagram above illustrates a user experi- encing a virtual environment, yet responding to stimuli as if it was real, not virtual. Tactile stimuli of a floorboard’s edge, accompanied by visuals of a deep precipice, cause the user's heart to race; this paradox is at the root of the concept of presence. Audio stimuli are one of the sensory chan- nels of encoding external input for an individual and are especially strong when an individual is attentive to their environment. Since VR technology is espe- cially skilled at providing a user with audio and vis- ual stimuli for an immersive digital experience, it is important to delve into the contributions of audio stimuli for presence within a VR environment. Spatialized sound, or a surround sound ef- fect, significantly increases the sense of presence in a virtual environment by creating realistic auditory cues. (Hendrix & Barfield, 1996). This phenomenon is commonly called the soundscape or the acoustic environment humans perceive in a particular con- text. A soundscape encompasses the entire aroma of an environment, including natural or mechanical sounds. A soundscape is beneficial because of the increased immersion and telepresence a user feels, which is necessary for enhancing experiential learn- ing in VR. To further investigate audio sensory stimuli, a 2020 study in the Journal of Frontiers in Robotics and AI compared walking in a virtual park with a soundscape vs. self-triggered footsteps. The publi- cation demonstrated that auditory perception can “compensate for restricted visual fields of view” (Kern and Ellermeier, 2020), or limitations of visual stimuli. Two features were studied within the envi- ronment: the soundscape, consisting of ambient na- ture audio, and footsteps, corresponding to walking audio. During the experience, the participants were asked to count specified objects in the environment. As a result, the background soundscape aided in a higher sense of presence, immersion, and involve- ment in addition to lower distractions, compared to distinct footsteps. The study stressed that “presence is enhanced by the reproduction of sound”, with ef- fective soundscape sounds serving as three times more effective in creating a more subtle, holistic im- mersion. The Effects of Student Engagement, Satis- faction, and Perceived Learning in Online Learning Environments bridges these results to classroom learning. A survey of 216 graduate students re- vealed a .652 correlation between learner interac- tion and student engagement and a .403 correlation between instructor presence and student engage- ment. The study then explored a .891 correlation between student engagement and perceived stu- dent learning (Gray and DiLoreto, 2016). Interaction and learning were “fully mediated by student en- gagement,” demonstrating a statistically significant link between engaged students and classroom learning. These phenomena may be a valuable con- sideration for designers of VR environments in the future, emphasizing the importance of audio-sen- sory stimuli and their influence on higher presence and user engagement. 4 MAYER’S COGNITIVE THEORY OF MULTIMEDIA LEARNING Now that the fundamentals of experiential learning have been reviewed, the literature review will move into education theorist Richard Mayer and ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V his theory on Multimedia Learning styles. The de facto source on this is the Cognitive Theory of Multi- media Learning by Richard E. Mayer states his the- ory very as being rooted in three cognitive science principles of learning: THE DUAL-CHANNEL ASSUMPTION: the assumption that human information processing systems include dual channels for visual and auditory information, respectively. THE LIMITED CAPACITY ASSUMPTION: the assump- tion that every human has a limited capacity for pro- cessing information. THE ACTIVE PROCESSING ASSUMPTION: the as- sumption that active learning requires carrying out a coordinated set of processes. The rationale behind the multimedia learn- ing theory is that humans learn more deeply from words and pictures than words alone, and our scope of multimedia consumption is immensely growing. Mayer’s theory outlines how one might effectively present information through multimedia formats, dubbing the term “multimedia design.” This leads to the next logical question. How can different multimedia formats be used to pro- mote learning? In multimedia instructional environ- ments, learners are exposed to a variety of text and visual materials, including static and dynamic forms (Mayer and Moreno, 2002). Animation is one of these forms of dynamic pictorial multimedia, refer- ring to a “simulated motion picture depicting the movement of drawn (or simulated) objects.” In this study, Mayer and Moreno, based on their research, created a collection of seven principles for multime- dia animation design by comparing the problem- solving transfer performance with and without cer- tain conditions; These seven principles are Multime- dia, Spatial Contiguity, Temporal Contiguity, Coher- ence, Modality, Redundancy, and Personalization. These allow the measurement of the students’ abil- ity to use what they have learned in new situations, creating a framework for designing animations, nar- rations, and other multimedia content. There have been multiple attempts to test the instructional effectiveness of immersive virtual reality against traditional instructional effectiveness. In a study conducted by Richard Mayer and Jocelyn Parong, the effectiveness of virtual reality in learning science was explored through two experiments, one comparing VR with traditional slideshow learn- ing content (to mimic traditional instructional envi- ronments) and the other comparing segmented VR with individual lesson summaries (referred to as VR+) versus continuous VR lessons. Mayer and Pa- rong examined mean post-test scores and self-re- ported engagement, interest, and motivation levels. They found that students who viewed a slideshow scored higher on a post-test (M = 13.54 versus M = 10.17) but showed lower levels of interest, motiva- tion, and engagement ratings compared to the other group. Experiment 2 showed that the VR+ learning experience produced significantly better results on the post-test than VR (M = 13.84 versus M = 10.31), while the groups did not differ in interest, engagement, and motivation. An interesting point to consider is that the VR learners performed as well as slideshow learners in conceptual questions but lacked only terms of factual questions. This supports the cognitive theory of multimedia learning and demonstrates the value of generative learning (learning both physically and cognitively actively in organizing and integrating new information into ex- isting knowledge structures) strategies in immersive VR environments (Parong, Mayer, 2018). However, further research needs to be conducted with Mayer’s theory of multimedia learning and design principles to study the effectiveness of segmented and supplemental VR content to combine multiple multimedia formats of educational content into Kolb’s experiential learning model. ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V FIGURE 3: Conceptual model of the cognitive theory of multimedia learning, from the Cambridge Handbook of Mul- timedia Learning, pp. 43 – 7 5 COMMENTS ON THE LITERATURE AND THE APPLICATIONS OF THE RE- SEARCH Looking back on the literature com- piled, the need for continued research to be done on the effectiveness of experiential learn- ing content and multimedia design in educa- tional multimedia formats, especially future technological formats such as Virtual Reality (VR), Augmented Reality (AR) and Ex- tended/Mixed Reality (XR), is recognized. Aug- mented reality is a digital experience that en- hances the real world through modification and digital projection, while Extended/Mixed Reality combines VR and AR. Virtual, augmented, and mixed reality provides a wide range of possible applications to bring users into a fully immersive environ- ment that might not otherwise be accessible. In fact, many corporations have turned to XR for corporate training. Experiential learning is a powerful form of learning that can be effectively utilized through virtual reality, such as taking field trips or having other inaccessible or expen- sive experiences. However, as previously men- tioned, one would need to study the short and long-term effects of virtual reality education and content retention. These effects can be any- where from headaches/migraines, non-effective learning, or increased distractions to hindered problem-solving ability, dependence on move- ment to learn, or shortened attention span, amongst countless other possibilities. Furthermore, based on Mayer’s Cogni- tive Theory of Multimedia Learning, education is supercharged when presented in multiple for- mats, and therefore, virtual reality would need to be paired with other media formats for full ef- fectiveness. Based on the literature presented, it is hypothesized that segmented VR learning designed with the multimedia principles out- lined above, paired with reflection exercises such as summarizing content and posttests, can drastically increase learning effectiveness and retention by promoting conceptual learning and increased engagement. There is an incred- ible importance of research in bridging the two educational theories, Kolb’s model of Experien- tial Learning and Mayer’s Cognitive Theory of Multimedia Learning, and it is exciting to see what future literature and research hold∎ 6 REFERENCES [1] Burdea, G. C., & Coiffet, P. (1994). Virtual reality technology (1st ed.). London: Wiley-Interscience. [2] Schenck, J., & Cruickshank, J. (2015). Evolving Kolb: Experiential Education in the Age of Neu- roscience. Journal of Experiential Education, 38(1), 73–95. https://doi.org/10.1177/1053825914547153 [3] Abdulwahed, Mahmoud, and Zoltan K. Nagy. “Applying Kolb’s Experiential Learning Cycle for Laboratory Education.” Journal of Engineering Education, vol. 98, no. 3, 2009, pp. 283–94. Wiley Online Library, HTTPS://DOI.ORG/10.1002/J.2168- 9830.2009.TB01025.X. https://www.cambridge.org/core/books/the-cambridge-handbook-of-multimedia-learning/09E09224829AB8D3D327EF8A0E9B5288 https://www.cambridge.org/core/books/the-cambridge-handbook-of-multimedia-learning/09E09224829AB8D3D327EF8A0E9B5288 https://doi.org/10.1177/1053825914547153 ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V [4] Bergsteiner, Harald, and Gayle C. Avery. “The Twin-Cycle Experiential Learning Model: Recon- ceptualising Kolb’s Theory.” Studies in Continu- ing Education, vol. 36, no. 3, Sept. 2014, pp. 257– 74. EBSCOhost, HTTPS://DOI.ORG/10.1080/0158037X.2014.90478 2. [5] Brotchie, Peter R., et al. “Head Position Signals Used by Parietal Neurons to Encode Locations of Visual Stimuli.” Nature, vol. 375, no. 6528, 6528, May 1995, pp. 232–35. www.nature.com, HTTPS://DOI.ORG/10.1038/375232A0. [6] Cahill, L., et al. “Amygdala Activity at Encoding Correlated with Long-Term, Free Recall of Emo- tional Information.” Proceedings of the National Academy of Sciences, vol. 93, no. 15, July 1996, pp. 8016–21. pnas.org (Atypon), HTTPS://DOI.ORG/10.1073/PNAS.93.15.8016. [7] Corbetta, Maurizio, and Gordon L. Shulman. “Control of Goal-Directed and Stimulus-Driven Attention in the Brain.” Nature Reviews Neurosci- ence, vol. 3, no. 3, 3, Mar. 2002, pp. 201–15. www.nature.com, HTTPS://DOI.ORG/10.1038/NRN755. [8] Cornwell, John M., and Pamela A. Manfredo. “Kolb’S Learning Style Theory Revisited.” Educa- tional and Psychological Measurement, vol. 54, no. 2, June 1994, pp. 317–27. SAGE Journals, HTTPS://DOI.ORG/10.1177/001316449405400200 6. [9] Dinh, H. Q., et al. “Evaluating the Importance of Multi-Sensory Input on Memory and the Sense of Presence in Virtual Environments.” Proceedings IEEE Virtual Reality (Cat. No. 99CB36316), 1999, pp. 222–28. IEEE Xplore, HTTPS://DOI.ORG/10.1109/VR.1999.756955. [10] Experiential Learning Effects on Knowledge Re- tention and Higher-Order Thinking Skills: A Study of Kolb’s Experiential Learning Model in the Intro- ductory Managerial Accounting Course - ProQuest. HTTP://WWW.PROQUEST.COM/DOCVIEW/2467153652 ?PARENTSESSIONID=TOPGXYPXAFR- ZUO1X1FJVZJGVIDTXRXQRFWCWRE%2BOV6M%3D &PQ-ORIGSITE=PRIMO&ACCOUNTID=13626. AC- CESSED 25 SEPT. 2022. [11] Flavián, Carlos, et al. “The Influence of Scent on Virtual Reality Experiences: The Role of Aroma- Content Congruence.” Journal of Business Re- search, vol. 123, Feb. 2021, pp. 289–301. DOI.org (Crossref), HTTPS://DOI.ORG/10.1016/J.JBUSRES.2020.09.036. [12] General and Specific Brain Regions Involved in Encoding and Retrieval of Events: What, Where, and When. HTTPS://DOI.ORG/10.1073/PNAS.93.20.11280. AC- CESSED 12 SEPT. 2022. [13] General Music Learning Is Also Social and Emo- tional Learning. HTTPS://DOI.ORG/10.1177/1048371319891421. [14] Goldstein, E. Bruce. Cognitive Psychology: Con- necting Mind, Research, and Everyday Experi- ence. 4th edition ; Student edition, Cengage Learning, 2015. [15] Helsel, Sandra. “Virtual Reality and Education.” Educational Technology, vol. 32, no. 5, 1992, pp. 38–42. [16] Hendrix, Claudia, and Woodrow Barfield. “The Sense of Presence within Auditory Virtual Envi- ronments.” Presence: Teleoperators and Virtual Environments, vol. 5, no. 3, Aug. 1996, pp. 290– 301. Silverchair, HTTPS://DOI.ORG/10.1162/PRES.1996.5.3.290. [17] Herweg, Nora A., and Michael J. Kahana. “Spatial Representations in the Human Brain.” Frontiers in Human Neuroscience, vol. 12, 2018. Frontiers, HTTPS://WWW.FRONTIERSIN.ORG/ARTI- CLES/10.3389/FNHUM.2018.00297. [18] Hettinger, Lawrence J., and Gary E. Riccio. “Visu- ally Induced Motion Sickness in Virtual Environ- ments.” Presence: Teleoperators and Virtual En- vironments, vol. 1, no. 3, Aug. 1992, pp. 306–10. Silverchair, HTTPS://DOI.ORG/10.1162/PRES.1992.1.3.306. [19] Ionta, Silvio, et al. “Multi-Sensory and Sensorimo- tor Foundation of Bodily Self-Consciousness – An Interdisciplinary Approach.” Frontiers in Psychol- ogy, vol. 2, 2011. Frontiers, HTTPS://WWW.FRONTIERSIN.ORG/ARTI- CLES/10.3389/FPSYG.2011.00383. [20] Jäncke, Lutz. “Music, Memory and Emotion.” Journal of Biology, vol. 7, no. 6, Aug. 2008, p. 21. BioMed Central, HTTPS://DOI.ORG/10.1186/JBIOL82. [21] Jones, Lynette A., and Allan M. Smith. “Tactile Sensory System: Encoding from the Periphery to the Cortex.” WIREs Systems Biology and Medi- cine, vol. 6, no. 3, 2014, pp. 279–87. Wiley Online Library, HTTPS://DOI.ORG/10.1002/WSBM.1267. ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V [22] Kalpouzos, Grégoria, and Johan Eriksson. “Memory Self-Efficacy Beliefs Modulate Brain Ac- tivity When Encoding Real-World Future Inten- tions.” PloS One, vol. 8, no. 9, 2013, p. e73850. ProQuest, HTTPS://DOI.ORG/10.1371/JOURNAL.PONE.0073850. [23] Kavanagh, Sam, et al. “A Systematic Review of Virtual Reality in Education.” Themes in Science and Technology Education, vol. 10, no. 2, Dec. 2017, pp. 85–119. [24] Keller, Arielle S., et al. “Attention Matters: How Orchestrating Attention May Relate to Class- room Learning.” CBE—Life Sciences Education, vol. 19, no. 3, Sept. 2020, p. fe5. lifescied.org (Atypon), HTTPS://DOI.ORG/10.1187/CBE.20-05-0106. [25] Kern, Angelika C., and Wolfgang Ellermeier. “Au- dio in VR: Effects of a Soundscape and Move- ment-Triggered Step Sounds on Presence.” Frontiers in Robotics and AI, vol. 7, 2020. Fron- tiers, HTTPS://WWW.FRONTIERSIN.ORG/ARTI- CLES/10.3389/FROBT.2020.00020. [26] Kim, Hayeon, and In-Kwon Lee. “Studying the Ef- fects of Congruence of Auditory and Visual Stim- uli on Virtual Reality Experiences.” IEEE Transac- tions on Visualization and Computer Graphics, vol. 28, no. 5, May 2022, pp. 2080–90. IEEE Xplore, HTTPS://DOI.ORG/10.1109/TVCG.2022.3150514. [27] Kolb, David A. Experiential Learning: Experience as the Source of Learning and Development. FT Press, 2014. [28] Kumar, Naveen, et al. Research Journal of Phar- maceutical, Biological and Chemical Sciences. 2016, p. 7. [29] Lepage, Martin, et al. “Hippocampal PET Activa- tions of Memory Encoding and Retrieval: The HIPER Model.” Hippocampus, vol. 8, no. 4, 1998, pp. 313–22. Wiley Online Library, HTTPS://DOI.ORG/10.1002/(SICI)1098-1063 [30] Maity, Kousik, et al. “An Immunostimulating Wa- ter Insoluble β-Glucan of an Edible Hybrid Mush- room: Isolation and Characterization.” Fitotera- pia, vol. 84, Jan. 2013, pp. 15–21. PubMed, HTTPS://DOI.ORG/10.1016/J.FITOTE.2012.10.014. [31] Makransky, Guido, et al. “Adding Immersive Vir- tual Reality to a Science Lab Simulation Causes More Presence but Less Learning.” Learning and Instruction, vol. 60, Apr. 2019, pp. 225–36. DOI.org (Crossref), HTTPS://DOI.ORG/10.1016/J.LEARNIN- STRUC.2017.12.007. [32] Makransky, Guido, and Lau Lilleholt. “A Struc- tural Equation Modeling Investigation of the Emotional Value of Immersive Virtual Reality in Education.” Educational Technology Research and Development, vol. 66, no. 5, Oct. 2018, pp. 1141–64. DOI.org (Crossref), HTTPS://DOI.ORG/10.1007/S11423-018-9581-2. [33] Mania, Katerina, et al. “Cognitive Transfer of Spa- tial Awareness States from Immersive Virtual En- vironments to Reality.” ACM Transactions on Ap- plied Perception, vol. 7, no. 2, Feb. 2010, p. 9:1- 9:14. February 2010, HTTPS://DOI.ORG/10.1145/1670671.1670673. [34] Mayer, Richard E., and Roxana Moreno. “Anima- tion as an Aid to Multimedia Learning.” Educa- tional Psychology Review, 2001, p. 13. [35] Miller, Carrie Lewis, et al. Learning Theories: Mul- timedia Learning Theory. p. 3. [36] Money, J., and M. De Priest. “Three Cases of Genital Self-Surgery and Their Relationship to Transexualism.” Journal of Sex Research, vol. 12, no. 4, Nov. 1976, pp. 283–94. PubMed, HTTPS://DOI.ORG/10.1080/00224497609550947. [37] Park, Sangin, et al. “Evaluation of Visual-Induced Motion Sickness from Head-Mounted Display Using Heartbeat Evoked Potential: A Cognitive Load-Focused Approach.” Virtual Reality, vol. 26, no. 3, Sept. 2022, pp. 979–1000. DOI.org (Cross- ref), HTTPS://DOI.ORG/10.1007/S10055-021-00600-8. [38] Parong, Jocelyn, and Richard E. Mayer. “Learn- ing Science in Immersive Virtual Reality.” Journal of Educational Psychology, vol. 110, 2018, pp. 785–97. APA PsycNet, HTTPS://DOI.ORG/10.1037/EDU0000241. [39] Patil, Tejaswini, et al. “Developing a Case-Based Experiential Learning Model at a Program Level in a Regional University: Reflections on the De- velopmental Process.” Australian Journal of Adult Learning, vol. 60, no. 2, July 2020, pp. 225– 44. [40] Powell, Kristin, and Marcella Wells. “The Effec- tiveness of Three Experiential Teaching Ap- proaches on Student Science Learning in Fifth- Grade Public School Classrooms.” The Journal of Environmental Education, vol. 33, no. 2, Jan. 2002, pp. 33–38. DOI.org (Crossref), HTTPS://DOI.ORG/10.1080/00958960209600806. ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V [41] Practice, Teacher Education and. Tep Vol 18-N4. R&L Education, 2007. [42] Recanzone, Gregg H. “Interactions of Auditory and Visual Stimuli in Space and Time.” Hearing Research, vol. 258, no. 1, Dec. 2009, pp. 89–99. ScienceDirect, HTTPS://DOI.ORG/10.1016/J.HEARES.2009.04.009. [43] Rolls, Edmund T., and Alessandro Treves. “The Neuronal Encoding of Information in the Brain.” Progress in Neurobiology, vol. 95, no. 3, Nov. 2011, pp. 448–90. ScienceDirect, HTTPS://DOI.ORG/10.1016/J.PNEURO- BIO.2011.08.002. [44] Román-López, Talía V., et al. “Brain Electrical Ac- tivity from Encoding to Retrieval While Maintain- ing and Manipulating Information in Working Memory.” Memory, vol. 27, no. 8, Sept. 2019, pp. 1063–78. EBSCOhost, HTTPS://DOI.ORG/10.1080/09658211.2019.16202 87. [45] Rudolph, Michelle. Cognitive Theory of Multime- dia Learning. no. 2, p. 15. [46] Sanchez-Vives, Maria V., and Mel Slater. “From Presence to Consciousness through Virtual Real- ity.” Nature Reviews Neuroscience, vol. 6, no. 4, 4, Apr. 2005, pp. 332–39. www.nature.com, HTTPS://DOI.ORG/10.1038/NRN1651. [47] Schacter, Daniel L., et al. “Brain Regions Associ- ated with Retrieval of Structurally Coherent Vis- ual Information.” Nature, vol. 376, no. 6541, 6541, Aug. 1995, pp. 587–90. www.nature.com, HTTPS://DOI.ORG/10.1038/376587A0. [48] Schenck, Jeb, and Jessie Cruickshank. “Evolving Kolb: Experiential Education in the Age of Neu- roscience.” Journal of Experiential Education, vol. 38, no. 1, Mar. 2015, pp. 73–95. EBSCOhost, HTTPS://DOI.ORG/10.1177/1053825914547153. [49] Schott, Christian, and Stephen Marshall. “Virtual Reality and Situated Experiential Education: A Conceptualization and Exploratory Trial.” Jour- nal of Computer Assisted Learning, vol. 34, no. 6, 2018, pp. 843–52. Wiley Online Library, HTTPS://DOI.ORG/10.1111/JCAL.12293. [50] Sperduti, Marco, et al. “Interaction between At- tentional Systems and Episodic Memory Encod- ing: The Impact of Conflict on Binding of Infor- mation.” Experimental Brain Research, vol. 235, no. 12, Dec. 2017, pp. 3553–60. Springer Link, HTTPS://DOI.ORG/10.1007/S00221-017-5081-6. [51] “The 4 Components of the Experiential Learning Cycle.” Norwich University Online, HTTPS://ONLINE.NORWICH.EDU/ACADEMIC-PRO- GRAMS/RESOURCES/4-COMPONENTS-EXPERIENTIAL- LEARNING-CYCLE. [52] The Effects of Student Engagement, Satisfaction, and Perceived Learning in Online Learning Envi- ronments. (2016). HTTPS://FILES.ERIC.ED.GOV/FULLTEXT/EJ1103654.PDF. [53] The Importance of Sound in Virtual Reality | Uni- versity of Silicon Valley. HTTPS://USV.EDU/BLOG/VIRTUAL-REALITY-VR-SOUND-IM- PORTANCE/. [54] Virtanen, Aurora. “What Is Kolb’s Experiential Learning Theory?” Growth Engineering, 2 Nov. 2021, HTTPS://WWW.GROWTHENGINEERING.CO.UK/KOLB-EXPE- RIENTIAL-LEARNING-THEORY/. [55] Vogel, Susanne, and Lars Schwabe. “Learning and Memory under Stress: Implications for the Classroom.” Npj Science of Learning, vol. 1, no. 1, 1, June 2016, pp. 1–10. www.nature.com, HTTPS://DOI.ORG/10.1038/NPJSCILEARN.2016.11. [56] Yeganeh, Bauback. Mindful Experiential Learn- ing. Case Western Reserve University, 2007. etd.ohiolink.edu, HTTPS://ETD.OHIOLINK.EDU/APEX- PROD/RWS_OLINK/R/1501/10?CLEAR=10&P10_AC- CESSION_NUM=CASE1163023095. [57] Zhu, Ziwei, et al. “Modeling and Detecting Stu- dent Attention and Interest Level Using Weara- ble Computers.” 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN), 2017, pp. 13–18. IEEE Xplore, HTTPS://DOI.ORG/10.1109/BSN.2017.7935996. [58] Kavanagh, S., Luxton-Reilly, A., Wuensche, B. & Plimmer, B. (2017). A systematic review of Virtual Reality in education. Themes in Science and Technology Education, 10(2), 85-119. Retrieved January 29, 2023. https://doi.org/10.1109/BSN.2017.7935996 ARESTY RUTGERS UNDERGRADUATE RESEARCH JOURNAL, VOLUME I, ISSUE V Rut Metha is a Rutgers undergraduate student double majoring in Busi- ness Analytics and Information Technology (BAIT) and Computer Sci- ence with a minor in Mathematics at Rutgers University - NB (RBS and SAS). Rut strives to push the boundaries of human capabilities through his work in SageTech, AI projects, and other emerging technologies such as Quantum Computing/Machine Learning (QML), Human-Com- puter Interfaces (HCIs), and autonomous humanoid robots. Claudia Santacruz is a Rutgers undergraduate student double majoring in Cognitive Science and Information Technology and Informatics (ITI). She is an honors program student passionate about the study of cog- nitive science and how understanding brain processes could aid in ei- ther the use or implementation of advancing technology. Her research areas lie in multi-sensory information encoding, user experience, and memory systems. She is a research assistant at Rutgers Memory Opti- mization Lab studying how humans use strategies to encode spatial in- formation. Additionally, she recently joined Dr. Wendy Ju’s lab at Cor- nell Tech studying human computer interaction and autonomous vehi- cle interfaces. She is also cofounder of EdTech startup SageTech, a platform for hosting virtual reality educational content inspired by multi-sensory virtual learning environments. Claudia has also interned with Johnson & Johnson working on user experience (UX) and ex- tended reality technology. After her undergrad she plans on continu- ing entrepreneurship and pursuing graduate studies leading to a PhD in Cognitive Science. Brianna Lischy is a Rutgers undergraduate student at the Rutgers Busi- ness School majoring in Business Analytics and Information Technol- ogy (BAIT) with a concentration in professional selling. She is inter- ested in connecting learning processes to technology through her work in the Interdisciplinary Research Teams (IRT) and relevant course- work. She helped lead data collection from students, educators, and administrators in the Northeast Region I-Corps Customer Discovery Program. As a result, she established new insights and linkage be- tween experimental learning and emerging EdTech methodologies. Brianna is also a passionate entrepreneur, working as Co-Founder of SageTech. She is excited for her upcoming role as a Business Develop- ment intern this summer, furthering her work in customer research and strategic problem solving.