Microsoft Word - 2 Jhoni & Arfha.docx English Language Teaching Educational Journal ISSN 2621-6485 Vol. 5, No. 3, December 2022, pp. 169-179 https://doi.org/10.12928/eltej.v5i3.4874 http://journal2.uad.ac.id/index.php/eltej/index eltej@pbi.uad.ac.id Shifting critical listening class to virtual learning during the Covid-19 pandemic Jhoni Eppendi a,1,*, Arfha Rizky Firdausya b,2 a, b Universitas Borneo Tarakan, Jl. Amal lama no 1, Tarakan and 77115, Indonesia 1 eppendij@borneo.ac.id*; 2 arfhafirdausya@gmail.com * corresponding author A R T I C L E I N F O A B S T R A C T Article history Received 18 September 2022 Revised 27 October 2022 Accepted 25 November 2022 Transforming the conventional face-to-face EFL learning into virtual learning has been believed to be an ideal alternative to education access in the middle of the COVID-19 outbreak. Hypothetically, abrupt transitions will require adaptation and rising practical predicament since the necessary toolkit must be allocated individually to conduct the listening Course. Thus, this study's purpose is to examine students' perception of the functioning of remote learning for Critical Listening class due to a prediction for drawing divergent language acquisition. This study involved forty-six students of the English education department at the Borneo University of Tarakan as research respondents. The data was recorded by distributing questionnaires and closed-ended questions through Google Forms and interview, while mixed analysis methodologies were applied. The questionnaire and interview result showed that students claim they struggle hard in the transitional phase and developing their educational outcomes. Most participants noticed an augmented listening performance in one teaching period, yet a higher chance of committing academic dishonesty than the prior learning circumstance. Therefore, the learning performance still needs enhancement in providing universally supported audios and solutions to plagiarism. This is an open access article under the CC–BY-SA license. Keywords Critical Listening Class Virtual Learning Covid-19 How to Cite: Eppendi, J., & Firdausya, A. R. (2022). Shifting critical listening class to virtual learning during the Covid-19 pandemic. English Language Teaching Educational Journal, 5 (3), 169-179. 1. Introduction As the most traditional teaching and learning mode, the face-to-face class has been primarily applied in Indonesia for centuries. Face-to-face learning is defined as physical learning participation for periodic concourses. The students will be engaged in a learning activity, instructed by a teacher, following a specified teaching session schedule (Cooper, 2020). Face-to-face or conventional Learning is also known to provide a traditional education where the teacher is unimpeded to manage the whole learning process and is viewed as the key figure (Ananga & Biney, 2021). The face-to-face class combined teaching methods, e.g., writing, discussion, reading, group work, presentations, practice, and demonstration. Conventional style is believed to help reach effective knowledge transfer and communication between students and teachers (Astuti et al., 2019). Since the physical presence of a teacher and the interactive nature of face-to-face classes create a comfortable and welcoming learning environment, it is highly ideal encouraging students to participate in the learning process. Unexpectedly, the whole culture of Learning that has been run inherently must meet massive and simultaneous alterations. Due to the Corona Virus (COVID-19) worldwide spread, the World Health Organization (WHO) attempted to break the chain of transmission by issuing orders to implement large-scale social restrictions universally (Bueno, 2020). This policy prompted the enactment of 170 English Language Teaching Educational Journal ISSN 2621-6485 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) regulation in Indonesia to restrict and address almost all public activities access on a virtual basis (Rasmitadila et al., 2020). In the formal education field, conventional teaching and learning program faces a significant obstacle in implementing the health protocols to a large extent, as they require the participation of students in each teaching session. Not seeing any better option, The Ministry of Education and Cultural has instructed a national mandate to shift the current teaching and learning activities with Study From Home (SFH) (Mendikbud, 2020). Consequently, both lecturers and students must continue to fulfill each duty and responsibility by assiduously exploiting efficacious learning technology as an alternative during the lockdown (Soni, 2020). Transforming the prior learning activities into e-learning was assumed to prompt tensed adaptation and predicted a challenging transition owing to sudden and unexpected shifting (Crawford et al., 2020). In grappling with the abrupt change from brick-and-mortar education into total remote learning, challenges confront both parties (students and teachers) to maintain the educational performance (Dhawan, 2020). A study by Atmojo & Nugroho (2020) came up with challenges in carrying out pure virtual Learning during the coronavirus explosion, including the lack of readiness. Teachers admit that they did not have much time to prepare the backup learning system. A comparable level of chaos might apply to the students, heading to a disquieting adaptation and mean score drop. Meanwhile, online learning provides students with increased flexibility, convenience, and access to many courses and resources, making it a popular choice for many learners (Eppendi & Vega, 2020). Since the learning access shifting is imposed to reduce human exposure to public space, the lecturers attempted to redesign the learning scheme to be more remotely reachable. Therefore, the current study concerns fully online learning that has been applied to tertiary education students. Even though virtual learning has been increasingly popular in the education pathway (Safsouf et al., 2018), studies in the learning proceeding literature generally observe carrying out face-to-face classes (Wang & Chen, 2013; Thai, Wever, & Valcke, 2020; Usher & Barak, 2020). In such a term, the lecturer and the learners can directly communicate precise pronunciation and exchange knowledge. Instead, some education providers opt to practice blended learning- a collaboration of face-to-face and computer- mediated instruction (Brian & Nikolaevna, 2016). Even though it is juxtaposed with blended Learning, fully online Learning develops another set of obstacles. Before the invasion of the 20's global pandemic, very little empirical research explicitly discussing pure virtual Learning was published (Sun, 2014). The urge of traditional Learning attaches the most to a skill-based course that needs appropriate media to apply; For instance, a listening comprehension course. Listening skills are part of four principal EFL competencies that need to be honed by practicing, using third person assistance (audio and technology) (Arono, 2014). In concordance with Solak (2016) and , instead of a passive skill, Listening including an engaging and collaborative mechanism in which the listener generates sounds of speech and attempts to add meaning to spoken words. The recipient starts to identify the speaker's feelings and intended message to respond to verbal communication effectively (Gilakjani & Ahmadi, 2011). In EFL learning, listening skills are judged as essential, for the key to language learning is to obtain language input (Gilakjani & Sabouri, 2016). In students' requirements to undertake any learning instruction, the importance of listening skills is highlighted as the most frequently exploited skill in the language classroom (Hamouda, 2013). In each listening session, specific media such as an audio player, headset, and Personal Computers are required to engage and support the learning process, available as a single laboratory set. By applying pure e-learning all through the nation, the equipped media must be accessible for students to experience similar learning circumstances; otherwise, students' chances to draw diverse feedback and language acquisition progress might be higher. Several researchers have conveyed good news apropos the reliability of online Learning. A previous study proposed by Gördeslioğlu & Yüzer (2019) on how the Blackboard Learn works for second-semester students at Koc University confirms the virtual Learning is proven as a supportive invention to achieve a higher level of listening competency in a brief span, yet still, lack in developing an adequate student-teacher interaction. Contemplating this issue, it is worth demanding an interactive and accessible learning media for the prevalent distribution of information. It is affirmed that utilizing smartphone apps as learning media potentially encourages students' self-paced Learning since it enables learners to access content practically anywhere and anytime (Mindog, 2016). There is number of mobile applications that provide instant messaging, and the WhatsApp application is on the top- ranked list (Cetinkaya, 2017). Church & De Oliveira (2013) emphasize this point by stating that WhatsApp has risen in popularity due to economic reasons, requiring low data cost, and being more ISSN 2621-6485 English Language Teaching Educational Journal 171 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) social-conversational. This hype then has been brought into the EFL teaching path by Setyowati (2019), where she has shown profitable completion after creating a learning WhatsApp group. Without significant problems, Wijaya Putra senior high school students enjoy learning as their listening performance increases. In response to the former studies, the current research concerns to discuss WhatsApp as a primary educational technology to conduct the main listening comprehension class agenda to seek renewal and discovery for handy EFL learning media. The study pairs verified the significance and efficiency of fully online learning and were taken from the education provider's perspective. As appointed earlier, literature review on pure virtual learning is somewhat scarce in quantity; it gets rarer when it comes to virtual listening classes for tertiary education students. The course objectives are pretty at a high pace, requiring the students to develop listening comprehension in advanced spoken English. Therefore, this research aim was to examine students' perception of the functioning of remote Learning for Critical Listening class due to a prediction for drawing divergent language acquisition. 2. Method 2.1. Research Participant and Context of the Study The required listening course targets the English Department students in the fourth semester of the academic year, particularly at the Borneo University of Tarakan, North Kalimantan, Indonesia. The purpose of this course is to have excellent comprehension in listen for specific personal information, listen for prediction, listen for greetings and introduction, listen for completing and note-taking, listen for evaluating, comparing with own reaction, and rating, and listen for specific information. One semester's activities revolved around eight units and were distributed in 16 meetings, covering mid- term and final exams. Also, this course possesses a prerequisite, an interpretive listening course, before the students take this course. This research took 46 participants, all of whom were undergraduate-fourth-semester students enrolled in a critical listening class of the English Education Department at Borneo University of Tarakan in North Kalimantan. The participants were recruited via course credit for their participation. Each meeting started with a class discussion where the students had an introduction to the material. Technically, three platforms (WhatsApp, Kahoot, and iSpring Cloud) were applied variously in each session. After topic orientation, the lecturer shared the audio in WhatsApp group chat one by one. The tagged student was instructed to take at least one unsolved question in each meeting and share it with the class alternately. Done with the listening session, the students attended a Kahoot quiz session to recollect what they had learned with fun. Finally, in every eight meetings, the exam will be administered on the iSpring Cloud website. 2.2. Research Design This study has been conducted using a mixed-method design by integrating qualitative and quantitative approaches (Schoonenboom & Johnson, 2017). Each issue's paradigm is the initial data collection as qualitative and quantitative data in interviews to grant a broader insight into the investigated study. The mixed-methods analysis presents the opportunity to conduct more meaningful, detailed, and deliberate research than the case using only a single approach (qualitative or quantitative) (Whitehead & Schneider, 2012). Besides, it provides the researcher with other valuable instruments to apply to their research expertise. The study utilized a mixed-methods research design, which involved collecting and analyzing qualitative and quantitative data. The quantitative data was collected through a questionnaire that assessed the participants' perception of the virtual class of critical listening. The survey consisted of standardized measures of virtual class performance during covid-19 pandemic. The qualitative data was collected through interviews with a subset of participants who reported high responses to the survey questionnaire. The interviews focused on exploring the participants' experiences of an online class in more detail. 2.3. Data Collection and Analysis The research data were collected from the second-year students in the English Education Department of the Borneo University of Tarakan in North Borneo. They were asked for their perception of the distanced learning application on the Critical Listening course. Respondents' 172 English Language Teaching Educational Journal ISSN 2621-6485 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) impressions were recorded in questionnaires and interviews in the form of open-ended questions to perceive the students' background in their preceding claims. The data were collected on two separate occasions through Google form links; the first attempt was taken from May 17 to 22nd, 2020, while the second distribution was from May 30 to June 1, 2020. The enrolled students in the critical listening class were 74, and only 46 students actively participated in an online class since they found an unstable internet connection in their environment. Questionnaires used in this research composed of one identical type of item using a four-point Likert-type scale. The questionnaire was designed to determine students' perceptions of the sudden curriculum digitalization (Joshi, Kale, Chandel, & Pal, 2015). It was statistically calculated to measure each statement's attitude ratio and then presented in a descriptive approach. The interview questions were designed to explore the students' experiences with virtual learning and how it has impacted their critical listening skills. The interviews provided more detailed and in-depth information on the students' perceptions of virtual learning and how it has affected their learning outcomes. The data collected from the questionnaires and interviews were analyzed thematically to identify common themes and patterns. It enables the researchers to understand how the COVID-19 pandemic has affected critical listening classes in a virtual learning environment. 3. Findings and Discussion Out of all the 74 students engaged in the online learning proceedings, only 46 shared their views (37.84% non-participant). The data show a diverse perception of the online learning application, revealing that digitizing the Critical Listening Course class gave students a taste of a more advanced battlefield. More than half of the respondents struggled due to the adaptation phase but still managed to stabilize their academic performance. Here is the result of the obtained data analysis. 3.1. Students’ Impressions on the Current E-Learning The questionnaire findings recorded students' various experiences in applying e-learning in the Critical Listening course. The most conspicuous admission comes from the idea of the dysfunctional application for most participants, considering specific issues that came along while conducting the learning session (Table 1). Table 1. Respondent Responses to virtual Critical Listening Class No Statement Response SA A D SD 1 Virtual learning is beneficial in the middle of a global pandemic 4 32 7 3 2 I experienced rapid adaptation to the online earning 3 27 12 4 3 Online learning is challenging 9 33 3 1 4 I have external issues that affect the learning process 8 31 7 - 5 I find it troublesome to access the learning platform 11 21 13 1 6 I always join the online class on time and participate well 4 25 15 2 7 The given material is accessible and easy to understand 2 14 23 7 8 I find it hard to communicate with classmates and lecturer during the learning session 8 24 14 - 9 I need some help to access the learning platform 7 25 14 - 10 The lecturer provides explicit instruction during the learning session 4 24 16 2 11 I can easily focus during the entire listening session 5 21 18 2 12 Submitting any assignment counts to be convenient 3 29 12 2 13 I find it burdensome to speak through a voice note 5 18 20 3 14 The online exam form counts to be user-friendly 3 26 17 - 15 The distribution of the audios is disorganized and affect the effectiveness of the session 5 24 17 - 16 Online learning gives me an efficient learning experience 4 24 12 6 17 Switching to online Learning does not affect my progress in language acquisition 4 22 20 - 18 Online learning helps me improve my listening skill 2 32 10 2 19 I prefer to learn online with the chosen platform as the medium rather than the conventional class in my future learning. 1 9 15 2 a. Source: adapted from Joshi et al., 2015 ISSN 2621-6485 English Language Teaching Educational Journal 173 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) Though numerous obstacles have emerged and were involved in the sessions' affectivity, out of 46 respondents, 65.2% do not deal with a lengthy adjustment to the new education scheme. Moreover, 63% of students realize their excellent attendance and performance during class. Over and above, 73.9% of them proclaimed augmented listening skills in a time. The factors mainly arrive from the platform's accessibility for the learning material (audios, PowerPoint, and eBook) and the lecturer's explicit instruction. Even though, the online class issues appeared, still the main objectives of learning had been met on a fairly broad scale, and most participants wished to shift back to face-to-face learning for the subsequent application. 3.2. Feedback to the Online Learning The qualitative data obtained from the open-ended questions indicate WhatsApp as the most favored platform throughout the e-learning period (92.6% vote). The chosen media has been a place to access the learning content and perform the teaching-learning activity (listening and discussion session). Therefore, as a primary learning platform, an abundance of praise and judgment during the implementation was varied and intriguing. Fig. 1. Respondents’ View on WhatsApp Features The participants have been questioned on traits in the learning platforms that support their listening skill acquisition. The analysis proves that Whatsapp's mobile version is operated twice as much as the desktop version, for it is a less effortful way to get connected. Simultaneously, the rest tend to access the online listening class by exploiting both of the choices synchronously. Besides the low-cost and convenient access as the prominent advantage, several distinctive highlights are on the list. Conforming to the graph above, the most approved feature in WhatsApp win by the audio play, followed by the chat room and starred message. The interview findings showed that how the learning process turns out to be more comfortable with infinite audio plays. Through WhatsApp, the students are allowed to repeat the given audios limitlessly to perfect the assessment. Moreover, the audios must have automatically downloaded before it is ready to listen, leading to a flexible practice at any time. Another stated preferential is the chat room feature and starred message. A chat room as a learning forum is where the lecturer shared the material and assignment through chat, and the contents are counted to be intelligible. The task collection system is also accessible and convenient; the assignments were submitted through group chat rooms. The starred message feature obtains the same amount of votes as the chat room does. It technically functions as a 'bookmark' of the platform to compile the critical messages and files. The open-ended question defined that with the platform's features, the students have many chances to practice and an open-access learning resource. The students' lexicon got extended, resulting in more vital listening skills after WhatsApp mediated the class. The current learning scheme also pushes the students to be more productive in-class participation. The tense of learning surprisingly builds their critical thinking and structure accuracy. Although positive feedbacks are flooding, the absence of deficiencies is still quite hard to evade. The data shows that 45.5% of participants agree with the language acquisition improvements, whereas the other 31.8% questioned the new learning mode's advantages. Some of them claimed that there was no discernible transformation to their listening skills during the period of learning. 0 5 10 15 20 25 Audio play Chat room Starred message Nothing Irrelevant points 174 English Language Teaching Educational Journal ISSN 2621-6485 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) For some, the learning activity appears to be less advantageous in performance. Respondents likewise affirmed their inclination to switch back to the prior learning circumstance. • Does distance learning give any benefit to critical listening acquisition progress? Actually, not really. Many applications are used interchangeably, which makes the students increasingly bored during the learning activity. Moreover, e-learning makes us less likely to practice our communication skills directly. • If, any chance, the future listening class is continuously conducted online, is there any hesitation? We (partly participants) prefer face-to-face class because the material was delivered in a way more graspable than in the online course. Despite students' interlanguage that might influence the learning activity, 84.78% of participants faced particular external issues during online learning. • Is there any specific trouble in conducting online learning? If there is any, what are those? In some cases, the audio was not supported in the iOS version did hinder us (partly participants) from doing my best in class. Another time, personally, the device's memory was full, which created a problem in downloading the audio and a weak internet connection. 3.3. Respondents Suggestion Students feel that the amount of material should be increased, and the task's duration should be extended. The accessible audio format should be available, considering some operating systems in students' devices do not support the play. Some thought that the online lectures mediated by WhatsApp should be implemented earlier and are willing to cope in the next semester, while the rest considered to shift back to the conventional class or alter the learning platform, regarding the high chances of committing plagiarism. 3.4. Discussion Although online class was challenging and problematic, the study found that shifting to the new learning mode, a Critical Listening course (online learning), was revealed to be favored and helpful. The respondents find the online class better in assisting them to participate in the class activity, although it offers more barriers than beneficial (Halim & Hashim, 2019; Octaberlina & Muslimin, 2020; Al-Amin, Zubayer, Deb, & Hasan, 2021; Eppendi, Muliawaty, & Aisyah , 2021). Besides, immediate acceptance and adaptation are deemed to take place. In creating a proportionate learning application, the required media in distanced Learning should support the learning objectives. However, the provided audio file yet capable of covering the students' situational diversity on particular occasions. In line with Setyowati (2019) & Gördeslioğlu & Yüzer (2019), augmented listening skills are shown with another soft skill proficiency. Another point is that the rise in students' confidence in delivering their opinions is significant. However, this finding exposes an issue that (Setyowati, 2019) did not find, where her finding was the positive effect and students’ exemplary performance in an online class. Compared to her study, the current findings show minimum misbehavior in the class discussion. Most of the time, the students use formal English while holding the discussion but do code-switching when they have peer discussion. On the other hand, the present research highlights the students' various capacities to reach the learning forum, whereas poor connection got involved in 26% of participants. The university students typically come from sundry domiciles throughout the nation. The research participants themself originated from hometowns scattered across the North Borneo province, counting rural and border areas. Those who are trapped in unstable internet networks are rather live in rural or suburban areas. After all, individual states of network source causing a lack of access to reliable internet network are generally following the instruction of virtual education (Jibrin et al., 2017); (Adnan & Anwar, 2020); Rasmitadila et al., 2020; Atmojo & Nugroho, 2020; Dhawan, 2020). Notwithstanding the problematic learning circumstance, participants deduced that virtual learning helps them acquire listening skills effectively. This result approves the amount of research that associates WhatsApp with the online class (Fauzi & Angkasawati, 2019; Setyowati, 2019; Dewi, 2019). The lecturer's explicit instruction was admitted as an advantage proving how the ISSN 2621-6485 English Language Teaching Educational Journal 175 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) communication realms amongst the distanced learners and lecturer were appropriately built, filling the gap in the study of Gördeslioğlu & Yüzer (2019). Despite this, a small number of students encounter different states of affairs. Miscommunication throughout the learning session was reported to be falling due to the lack of explanation. Besides, the distribution of the audios is disorganized. There is no definite time limit in the individual listening section, which affects the session's efficacy. Since the students only give the material with insufficient instruction, that leads students get confused when the material is done. The adoption of online learning obliquely detaches elements of homogeneity from the formal learning culture. Limited access to the audio files for iOS users leads to troublesome downloads and contributes significantly to their academic performance. They have to access the m4a format file on other devices, explaining why some participants project duality access. Otherwise, being out of presence is the worst choice. Aside from this issue, the students succeed in adjusting the requisite toolkit. By utilizing features of WhatsApp to reconstruct the teaching and learning environment, a virtual listening class is not impossible for being close to wholly relevant. On the other hand, the sophomores' language proficiency appeared to get caught up—the inadequate mental lexicon yields suboptimal performance to interpret several phrases in the speaker's speech. This fact strengthens by 65.2% voices, affirmed the material comprehension is almost out of their league. A higher level of academic fraud has been detected among online learning practices, for it is easier to commit than in face-to-face class. The un-proctored assessments and examinations are prone to plagiarism, especially when the given time for each topic is more than sufficient. The user's device is easily compatible to access multiple platforms concurrently, e.g., search engines. One of the threats to implementing online tests is that students may present fraudulent behavior and do unethical acts (Munoz & Mackay, 2019). Cheating has been recognized as a common phenomenon (Raines et al., 2011), but still, none of such misbehavior should be neglected under the term of education. Whereas a student is willing to cheat, then the educational outcomes will be depreciated. More certain learning activities are deemed necessary under plagiarism as a serious ethical offense. Fighting it from the root of the problem will somewhat bring up an effective solution. In remote assessments, teleconference offers to facilitate proctoring and conclusively avert cheating (Hylton et al., 2016). Other online testing applications have conducted examinations in a supervised environment by blocking access beyond the Learning Management System (Ghauth & Abdullah, 2010). Holistic proctoring ensures identity verification and assessment behavior monitor. The stated notion where students are more likely to cheat in uncontrolled environments than in supervised settings propped these findings (Khalid et al., 2014). The robust platform excellently accommodates learning activity through its reliable features. In the light of its primary function as the communication media, WhatsApp has been a daily basis for various levels of society, counting in lecturers and students. The familiarities brought up by WhatsApp helps to create a more natural learning atmosphere. By the convenience granted, the intention to build a clear comprehension within each meeting has been achieved with lighter effort. However, the enhancement of the execution in the future retains expected. 4. Conclusion This compiling of dual sides of pure virtual listening comprehension class contributed to complete and widened technology utilization in education literature, as the study's scope is a novel discovery. Implementing SFH throughout the nation will set a hypothesize being challenging in transition. The students have to anticipate the need for the required online listening tools to attain the planned learning goals. However, the students can accommodate the learning media, even though the provided audios are inaccessible to every device. In most cases, students noticed an improvement in their language acquisition during the virtual class and were provided with a practical learning experience. Regardless, most respondents preferred to switch back to the face-to-face class as they believed direct deliverance of teaching materials remains an essential part of learning. However, another reason why is online learning increases opportunities for plagiarism. In a condition where none of us can predict the end of the mandatory remote activities, this research provided an insightful manual that needs minor enhancement. Discussed alternatives and advancement referring to the applied virtual learning can be internalized in prospective learning and study. 176 English Language Teaching Educational Journal ISSN 2621-6485 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) Acknowledgment This paper writing class project would not have been possible without the cooperative support of the respondent, the second-year students of the English Education Department at the Borneo University of Tarakan. We are grateful to all of those with whom we had the pleasure to work during the research. Each of our study participants has provided us personal and professional assistance and cooperated with a great deal about this scientific research; therefore, this research can meet the purpose of a paper writing class project. REFERENCES Adnan, M., & Anwar, K. (2020). Online Learning Amid the COVID-19 Pandemic: Students Perspectives. Journal of Pedagogical Sociology and Psychology, 2(1), 45–51. https://doi.org/10.33902/JPSP.2020261309 Al-Amin, M., Zubayer, A. A., Deb, B., & Hasan, M. (2021). Status of tertiary level online class in Bangladesh: students’ response on preparedness, participation and classroom activities. Heliyon, 7, 1-7. https://doi.org/10.1016/j.heliyon.2021.e05943 Ananga, P., & Biney, I. K. (2021). Comparing Face-To-Face and Online Teaching and Learning in Higher Education. MIER Journal of Educational Studies Trends & Practices, January 2018, 165–179. https://doi.org/10.52634/mier/2017/v7/i2/1415 Arono. (2014). Improving students listening skills through interactive multimedia in Indonesia. Journal of Language Teaching and Research, 5(1), 63–69. https://doi.org/10.4304/jltr.5.1.63-69 Astuti, C. C., Sari, H. M. K., & Azizah, N. L. (2019). Perbandingan Efektifitas Proses Pembelajaran Menggunakan Metode E-Learning dan Konvensional. Proceedings of the ICECRS, 2(1), 35. https://doi.org/10.21070/picecrs.v2i1.2395 Atmojo, A. E. P., & Nugroho, A. (2020). EFL Classes Must Go Online! Teaching Activities and Challenges during COVID-19 Pandemic in Indonesia. Register Journal, 13(1), 49–76. https://doi.org/10.18326/rgt.v13i1.49-76 Brian, A., & Nikolaevna, K. V. (2016). Blended Learning: Definition, Models, Implications for Higher Education. Bulletin of the South Ural State University, 8(2), 24–30. https://doi.org/10.14529/ped160204 Bueno, D. C. (2020). Physical Distancing: A Rapid Global Analysis of Public Health Strategies to Minimize Covid-19 Outbreaks. Institutional Multidisciplinary Research and Development (IMRaD), 3(1), 31–53. https://doi.org/10.13140/RG.2.2.30429.15840/1 Cetinkaya, L. (2017). The impact of WhatsApp use on success in the education process. International Review of Research in Open and Distance Learning, 18(7), 59–74. https://doi.org/10.19173/irrodl.v18i7.3279 Church, K., & De Oliveira, R. (2013). What’s up with WhatsApp? Comparing mobile instant messaging behaviors with traditional SMS. MobileHCI 2013 - Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services, 352–361. https://doi.org/10.1145/2493190.2493225 Cooper, N. (2020). Distance Learning vs Face-to-Face – Benefits, and Drawbacks. NCC. https://www.ncchomelearning.co.uk/blog/distance-learning-vs-face-to-face-benefits-and- drawbacks/ ISSN 2621-6485 English Language Teaching Educational Journal 177 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) Crawford, J., Butler-henderson, K., Rudolph, J., Malkawi, B., Glowatz, M., Magni, P. A., & Lam, S. (2020). COVID-19: 20 countries’ higher education intra-period digital pedagogy responses. Journal of Applied Learning & Teaching, 3(1). https://doi.org/10.37074/jalt.2020.3.1.7 Dewi, S. R. (2019). Utilizing Whatsapp Application for Teaching Integrated English (A Case Study tt University of Technology Yogyakarta). Universitas Muria Kudus, 9(2), 165–171. https://jurnal.umk.ac.id/index.php/RE/article/view/3383/1730 Dhawan, S. (2020). Online Learning: A Panacea in the Time of COVID-19 Crisis. Journal of Educational Technology Systems, 49(1), 5–22. https://doi.org/10.1177/0047239520934018 Eppendi, J., & Vega, N. D. (2020). Addressing EFL Paper-Based Assignment Into WhatsApp. the 1st International Conference on Folklore, Language, Education and Exhibition (ICOFLEX 2019). 512, pp. 344-348. Jakarta: Atlantis Press. https://doi.org/10.2991/assehr.k.201230.064 Eppendi, J., Muliawaty, W., & Aisyah , A. (2021). Can gadget manage the classroom? A Journal of Culture, English Language Teaching & Literature, 21(2), 327-345. Fauzi, I., & Angkasawati, P. (2019). the Use of Listening Logs Through Whatsapp in Improving Listening Comprehension of EFL Students. JOEL (Journal of Applied Linguistics & Literature), 4(1), 13–26. https://doi.org/10.33369/joall.v4i1.6773 Ghauth, K. I., & Abdullah, N. A. (2010). Measuring learner’s performance in e-learning recommender systems. Australasian Journal of Educational Technology, 26(6), 764–774. https://doi.org/10.14742/ajet.1041 Gilakjani, A. P., & Ahmadi, M. R. (2011). A Study of Factors Affecting EFL Learners’ English Listening Comprehension and the Strategies for Improvement. Journal of Language Teaching and Research, 2(5), 977–988. https://doi.org/10.4304/jltr.2.5.977-988 Gilakjani, A. P., & Sabouri, N. B. (2016). The Significance of Listening Comprehension in English Language Teaching. Theory and Practice in Language Studies, 6(8), 1670–1677. http://dx.doi.org/10.17507/tpls.0608.22 Gökgöz Gördeslioğlu, N., & Ergün Yüzer, T. (2019). Using LMS and Blended Learning in Designing a Course to Facilitate Foreign Language Learning. KnE Social Sciences, 2019, 10–25. https://doi.org/10.18502/kss.v3i24.5164 Halim, M. S., & Hashim, H. (2019). Integrating web 2.0 technology in ESL classroom: A review on the benefits and barriers. Journal of Counseling and Educational Technology, 2(1), 19-26. https://doi.org/10.32698/0381 Hamouda, A. (2013). An Investigation of Listening Comprehension Problems Encountered by Saudi Students in the EL Listening Classroom. Progressive Education and Development, 2(2), 113–155. https://www.hrmars.com/admin/pics/1882.pdf Hylton, K., Levy, Y., & Dringus, L. P. (2016). Utilizing webcam-based proctoring to deter misconduct in online exams. Computers and Education, 92–93, 53–63. https://doi.org/10.1016/j.compedu.2015.10.002 Jibrin, M. A., Musa, M. N., & Shittu, T. (2017). Effect of internet on the academic performance of tertiary institutions’ students in Niger State, Nigeria. International Journal of Education, Learning and Training, 2(2), 57–69. 178 English Language Teaching Educational Journal ISSN 2621-6485 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) Joshi, A., Kale, S., Chandel, S., & Pal, D. K. (2015). Likert Scale: Explored and Explained. British Journal of Applied Science & Technology, 7(3), 396-403. https://doi.org/10.9734/BJAST/2015/14975 Khalid, A., Stutzmann, B., Lowder, M. L., Atiqullah, M. M., Singh, R., & Chin, C. A. (2014). Academic misconduct at a polytechnic university - Case studies. ASEE Annual Conference and Exposition, Conference Proceedings. Mendikbud. (2020). SE Mendikbud: Pembelajaran secara Daring dan Bekerja dari Rumah untuk Mencegah Penyebaran Covid-19. Kementrian Pendidikan Dan Budaya. https://www.kemdikbud.go.id/main/blog/2020/03/se-mendikbud-pembelajaran-secara- daring-dan-bekerja-dari-rumah-untuk-mencegah-penyebaran-covid19 Mindog, E. (2016). Apps and EFL: A case study on the use of smartphone apps to learn English by four Japanese university students. JALT CALL Journal, 12(1), 3–22. https://doi.org/10.29140/jaltcall.v12n1.199 Munoz, A., & Mackay, J. (2019). An online testing design choice typology towards cheating threat minimisation. Journal of University Teaching and Learning Practice, 16(3), 1–16. https://doi.org/10.53761/1.16.3.5 Octaberlina, L. R., & Muslimin, A. I. (2020). EFL Students Perspective towards Online Learning Barriers and Alternatives Using Moodle/Google Classroom during COVID-19 Pandemic. International Journal of Higher Education, 9(6), 1-9. https://doi.org/10.5430/ijhe.v9n6p1 Raines, D. A., Ricci, P., & Brown, S. L. (2011). Cheating in Online Courses: The Student Definition. The Journal of Effective Teaching, 11(1), 80–89. Rasmitadila, Rusmiati, A. R., Reza, R., Achmad, S., Syaodih, E., Nurtanto, M., Sultan, A., Riana, A., & Tambunan, S. (2020). The perceptions of primary school teachers of online Learning during the COVID-19 pandemic period : A Case study in Indonesia. Journal of Ethnic and Cultural Studies, 7(2), 90–109. https://doi.org/10.29333/ejecs/388 Safsouf, Y., Mansouri, K., & Poirier, F. (2018). A new model of learner experience in online learning environments. International Conference Europe Middle East & North Africa Information Systems and Technologies to Support Learning, 29. http://doi.org/10.1007/978-3-030- 03577-8_4 Schoonenboom, J., & Johnson, R. B. (2017). How to Construct a Mixed Methods Research Design. KZfSS Kölner Zeitschrift Für Soziologie Und Sozialpsychologie, 69(2), 107–131. https://doi.org/10.1007/s11577-017-0454-1 Setyowati, Y. (2019). Let’s Listen Through WhatsApp: An energizing listening exercise in EFL Class. Journal of Physics: Conference Series, 1179(1). https://doi.org/10.1088/1742- 6596/1179/1/012052 Solak, E. (2016). Book Review: Teaching Language Skills for Prospective English Teachers. Sakarya University Journal of Education, 6(3), 232–234. https://doi.org/10.19126/suje.282235 Soni, V. D. (2020). Global Impact of E-learning during COVID 19. SSRN Electronic Journal, 12. https://doi.org/10.2139/ssrn.3630073 Sun, S. Y. H. (2014). Learner perspectives on fully online language learning. Distance Education, 35(1), 18–42. https://doi.org/10.1080/01587919.2014.891428 ISSN 2621-6485 English Language Teaching Educational Journal 179 Vol. 5, No. 3, December 2022, pp. 169-179 Eppendi, J., & Firdausya, A. R. (Shifting critical listening class to virtual learning.....) Thai, N. T., Wever, B. D., & Valcke, M. (2020). Face-To-Face, Blended, Flipped, or Online Learning Environment? Impact on Learning Performance and Student Cognitions. Journal of Computer Assisted Learning, 36(3), 397-411. https://doi.org/10.1111/jcal.12423 Usher, M., & Barak, M. (2020). Team Diversity as a Predictor of Innovation in Team Projects of Face-to-Face and Online Learners. Computers & Education, 144. https://doi.org/10.1016/j.compedu.2019.103702 Wang, Y., & Chen, N. S. (2013). Engendering Interaction, Collaboration, and Reflection in the Design of Online Assessment in Language Learning: A Reflection from the Course Designers. In C. H. X. Bin Zou, Minjie Xing, Yuping Wang, Mingyu Sun (Ed.), Computer- Assisted Foreign Language Teaching and Learning: Technological Advances (pp. 16–39). IGI Global. https://doi.org/10.4018/978-1-4666-2821-2.ch002 Whitehead, D., & Schneider, Z. (2012). Mixed-Method Research. In Nursing & Midwifery Research: Methods and Appraisal for Evidence-Based Practice (4th Editio, p. 264). Mosby Australia.