Universitas Muhammadiyah Malang, East Java, Indonesia JPBI (Jurnal Pendidikan Biologi Indonesia) p-ISSN 2442-3750, e-ISSN 2537-6204 // Vol. 6 No. 2 July 2020, pp. 265-272 10.22219/jpbi.v6i2.12161 http://ejournal.umm.ac.id/index.php/jpbi jpbi@umm.ac.id 265 Research Article HOTS-AEP-COVID-19 and ILMIZI learning model: The 21st-century environmental learning in senior high school Ilmi Zajuli Ichsan a,b,1,*, Henita Rahmayanti a,2, Agung Purwanto a,3, Diana Vivanti Sigit b,4, Mieke Miarsyah b,5, Paulo Weslem Portal Gomes c,6 a Department of Population and Environmental Education, Universitas Negeri Jakarta, Rawamangun Muka Street, East Jakarta 13220, Indonesia b Department of Biology Education, Universitas Negeri Jakarta, Rawamangun Muka Street, East Jakarta 13220, Indonesia c Institute of Biology, University of Campinas, Monteiro Lobato Street, Sao Paulo 13083-862, Brazil 1 ilmizajuli95@gmail.com*; 2 henita.rahmayanti@unj.ac.id; 3 agungpurwanto@unj.ac.id; 4 dianav@unj.ac.id; 5 mmiarsyah@unj.ac.id; 6 p264495@dac.unicamp.br * Corresponding author INTRODUCTION Coronavirus Disease 2019 (COVID-19) a disease from new coronavirus (SARS-Cov-2) causes many changes in the world in various fields of activity. Start from economic activities, government, educational activities, and overall activities in the world received negative impact from COVID-19 (He, 2020; Tian et al., 2020; Zhou et al., 2020). Environmental learning at various levels of education is one of activities that received of COVID-19 impact. Environmental learning when COVID-19 pandemic becomes an interesting issue to solve. Various problems arise due to changes in learning. Physical distancing policy changes learning strategies. A R T I C L E I N F O A B S T R A C T Article history Received May 10, 2020 Revised June 08, 2020 Accepted June 17, 2020 Published July 21, 2020 Environmental learning in the Coronavirus Disease 2019 (COVID-19) pandemic requires 21st-century learning innovation which promotes Higher-Order Thinking Skills (HOTS) of which ILMIZI is the potential learning model. The purpose of this study was to measure the students’ HOTS using HOTS Assessment based on Environmental Problem of COVID-19 (HOTS-AEP-COVID-19) and describe the syntax of ILMIZI model for the implementation of e-learning during the COVID-19 pandemic. The research subjects used were 172 senior high school students randomly selected from Bekasi City in several schools. The descriptive research used online survey as the data collection technique. The results showed that the students HOTS scores measured using HOTS-AEP-COVID-19 were still in very low category either for all students (22.83) or male students (21.32) and female students (23.82). Hence, the ILMIZI model need further evaluation to be implemented as an alternative for the 21st-Century environmental learning. Copyright © 2020, Ichsan et al This is an open access article under the CC–BY-SA license Keywords HOTS-AEP-COVID-19 ILMIZI learning model Learning Innovation How to cite: Ichsan, I. Z., Rahmayanti, H., Purwanto, A., Sigit, D. V., Miarsyah, M., & Gomes, P. W. P. (2020). HOTS-AEP- COVID-19 and ILMIZI learning model: The 21st-Century environmental learning in senior high school. JPBI (Jurnal Pendidikan Biologi Indonesia), 6(2), 265-272. doi: https://doi.org/10.22219/jpbi.v6i2.12161 http://ejournal.umm.ac.id/ http://u.lipi.go.id/1422867894 http://u.lipi.go.id/1460300524 https://doi.org/10.22219/jpbi.v6i2.12161 http://ejournal.umm.ac.id/index.php/jpbi mailto:jpbi@umm.ac.id http://creativecommons.org/licenses/by-sa/4.0/ https://doi.org/10.22219/jpbi.v6i2.12161 https://crossmark.crossref.org/dialog/?doi=10.22219/jpbi.v6i2.12161&domai JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 6, No. 2, July 2020, pp. 265-272 266 Ichsan et al (HOTS-AEP-COVID-19 and ILMIZI learning …) Conventional learning in general of face-to-face learning in class changes to using an e-learning can change the teacher and students learning activities (Mbipom et al., 2018; Mhouti et al., 2017, 2018; Mirabolghasemi et al., 2019; Nugraini et al., 2013; Radovan & Perdih, 2016). Environmental learning using e-learning will be slightly different from conventional learning in the classroom. Besides that, student also discuss various concepts of COVID-19 to prevent a wider spread of the COVID-19 pandemic in the environment. COVID-19 was one of environmental problem that must be solved. That resulted in the ability of students in the 21st century is needed, one of which is the ability of Higher Order Thinking Skills (HOTS) to solve a problem. This ability was a important ability that students must have in solving problems (Fitzpatrick & Schulz, 2015; Saido et al., 2015; Vijayaratnam, 2012; Wang & Wang, 2011; Yeung, 2015). When this COVID-19 pandemic occurs it is best to measure students' HOTS from the COVID-19 aspect. HOTS was one ability that suitable to solve COVID-19 problem in the environmental context. Previous research has carried out the HOTS measurement of students using Higher Order Thinking Skills Assessment based on Environmental Problems (HOTS-AEP) at various levels of education (Ichsan et al., 2019). The instrument developed to measure the ability of HOTS students and university students with a focus on environmental issues. In this study, the instrument can be modified into Higher Order Thinking Skills based on the Environmental Problem of Corona Virus Disease (HOTS-AEP-COVID-19). The use of this instrument was an urgent thing to do and a novelty in this research. That is because previous studies have not been done in measuring HOTS students in COVID-19 situations. The use of HOTS-AEP-COVID-19 was an urgent thing to do. The urgency is due to the unavailability of HOTS data profiles for students on the COVID-19 topic at the Senior High School level. Besides that, other components in learning must be done, start from use of appropriate learning models to improve the ability. In general, several 21st-century abilities are very commonly known today, such as critical thinking, creative thinking, communication, and collaboration (Barricelli et al., 2016; Grant & Smith, 2018; Heong et al., 2012; Lee, 2016; Nissim et al., 2016; Oncu, 2016; Quieng et al., 2015; Reyna et al., 2019; Zohar & Agmon, 2018). This ability must still be trained when the COVID-19 pandemic. The use of learning models becomes one of the important components, one of the innovations of learning models that can be used is ILMIZI learning model that has a syntax start from identify problems, limitation problems, make mind map, interpret results, analyze results, interaction and evaluate (Ichsan, 2019). This model has previously been implemented on a small scale but has not been implemented further (Ichsan, Sigit, et al., 2020). The ILMIZI model is a potential model to be implemented in e-learning during COVID-19. Other research that has been done related to COVID-19 has been carried out mainly about finding various drugs that can potentially cure COVID-19 patients (Ahorsu et al., 2020; Bashyam & Feldman, 2020; Georgiev, 2020; Ni et al., 2020). Also, other research showed that learning science during the COVID-19 pandemic has also experienced changes in various countries, strategies and learning media was change to e-learning version (Bakker & Wagner, 2020; Erduran, 2020; Sintema, 2020). That point makes this research follows the world's research trends and becomes a novelty. Based on this, the purpose of this study was to measure students HOTS using HOTS-AEP-COVID-19 and describe ILMIZI syntax for implementation of e-learning during the COVID-19 pandemic. METHOD This research was conducted in March 2020 when the World Health Organization raised the state of contamination to the COVID-19 pandemic, a disease caused by the new coronavirus (SARS-Cov-2). The method used descriptive analysis with data collection techniques using a survey via Google form (online media). The sample used in this study were 172 senior high school students randomly selected from Bekasi City in several school. The sample consisted of 66 male students and 106 female students. The instrument used was Higher Order Thinking Skills Assessment based on the Environmental Problem of Corona Virus Diseases (HOTS-AEP-COVID-19). This instrument was a modification of HOTS-AEP that was previously developed (Ichsan et al., 2019). HOTS-AEP-COVID previously have been implemented for junior high school students (Ichsan, Rahmayanti, et al., 2020). The number of items from this instrument is six items. Indicators of this instrument can be more details seen in Table 1. The instrument developed was tested for validity and reliability. The validity test used is Pearson product- moment and reliability using split-half (Spearman-Brown). The analysis of the data used in this study descriptively is displayed in Table 1. The categorization of student HOTS scores consists of Very high, high, moderate, low, and very low. These categories can be seen further in Table 2. JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 6, No. 2, July 2020, pp. 265-272 267 Ichsan et al (HOTS-AEP-COVID-19 and ILMIZI learning …) Table 1. Indicator HOTS-AEP-COVID-19 Aspect Indicator Item Analyze (C4) Analyzing environmental problems causing the spread of COVID-19 1,2 Evaluate (C5) Evaluate community behavior for protecting the environment from COVID-19 3,4 Create (C6) Creating problem solutions of environmental problems to prevent COVID-19 5,6 Table 2. Categories of HOTS scores measured using HOTS-AEP-COVID-19 Category Interval Score Very High X > 81,28 High 70,64 < X ≤ 81,28 Moderate 49,36 < X ≤ 70,64 Low 38,72 < X ≤ 49,36 Very Low X ≤ 38,72 Source: Category adapted from Ichsan et al. (2019) for scale 0-100 In addition to analyzing students' HOTS descriptively, this study also carried out a description of ILMIZI syntax in the form of teacher and student activity during e-learning. This needed to facilitate teachers in implementing ILMIZI learning models in 21st-century environmental learning. The description of the ILMIZI model also with a duration of usage time for each syntax. In this research, ILMIZI Model not yet implemented for senior high school students. In this research just conduct an analysis for learning stages (syntax) of ILMIZI. RESULTS AND DISCUSSION The instrument validity test results showed that the six items HOTS-AEP-COVID-19 had a valid category. This showed that instrument can be used in HOTS measurements. More clearly from the results of the validity test can be seen in Table 3. While the reliability measurement results showed a value of 0.73 which can be used in this study. Table 3. HOTS-AEP-COVID-19 instrument validity test results Item r value r table Category Item 1 0.54 0.24 Valid Item 2 0.63 0.24 Valid Item 3 0.65 0.24 Valid Item 4 0,70 0.24 Valid Item 5 0.72 0.24 Valid Item 6 0.72 0.24 Valid The results showed that HOTS scores of senior high school students measured using HOTS-AEP-COVID- 19 showed that the average score were in the very low category. This showed that students' knowledge about COVID-19 in the HOTS still very low and needs to be improved, especially in the second item related to analyzing environmental problems that contribute to the spread of COVID-19. The low score is on all student respondents both male and female students. More details about score can be seen in Table 4. Table 4. Average HOTS student scores for each item measured by HOTS-AEP-COVID-19 No Item All Male Female 1 Based on the news about COVID-19, analyze what environmental factors are causing more epidemics of COVID-19? 2.13 2.11 2.15 2 In your opinion, what environmental issues contributed the most to the spread of COVID-19? Explain the results of your analysis 1.95 1.88 2.00 3 Give your opinion and critique about community behavior that not protect the environment from COVID-19 2.49 2.30 2.60 4 What behavior should the community do to minimize the environment from COVID-19? Give your critique and suggestions 2.13 1.95 2.25 5 Create an idea about efforts to reduce the impact of the spread of COVID- 19 in the environment around your home 2.17 2.03 2.26 6 Make a short paragraph (consisting of at least 3 sentences) about the relationship between the importance of protecting the environment and the distribution of COVID-19 2.83 2.52 3.03 Raw Score 13.70 12.79 14.29 Average Score ( scale 0-100) 22.83 21.32 23.82 Category Very low Very low Very low JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 6, No. 2, July 2020, pp. 265-272 268 Ichsan et al (HOTS-AEP-COVID-19 and ILMIZI learning …) The Students HOTS score based on each indicator showed that student scores are still in the very low category. This can be seen in Table 5, mainly related to the ability to analyze environmental problems in the context of COVID-19 prevention. This showed that environmental learning at senior high school is not entirely based on HOTS. Many students answered the question in very short paragraph and not based on their analysis result. Then, many students answered based on textbook and didn’t give their own argumentation. Table 5. Average HOTS student scores for each indicator of HOTS-AEP-COVID-19 Aspect Indicator All Male Female C4 Analyzing environmental problems causing the spread of COVID-19 2.04 1.99 2.08 C5 Evaluate community behavior for protecting the environment from COVID-19 2.31 2.13 2.42 C6 Creating problem solutions of environmental problems to prevent COVID-19 2.50 2.27 2.65 Meanwhile, to support environmental learning in the 21st-century, we need a learning model that is compatible with 21st-century learning. One of them is the ILMIZI model that can be applied to e-learning during COVID-19. This model can be adapted for conventional learning and e-learning by modifying teacher activity and also student activity. The duration of the use of the ILMIZI model can also be adjusted for each stage of learning. The following is the syntax or stages of learning from the ILMIZI model along with the activities of the teacher, students, and the duration (total 100 minutes) of learning for each step in Table 6. Table 6. ILMIZI learning model activity in e-learning during COVID-19 for senior high school students No Syntax Teacher activity Students activity Duration 1 Identify problem The teacher provides a theme of environment and COVID-19 to be discussed by senior high school students in e-learning media such as WhatsApp group Senior high school students identify environmental problems, especially those related to COVID-19 problems in WhatsApp group 10 min 2 Limitation problem The teacher asks senior high school students to limit the problem to be solved, especially about COVID-19, then write in WhatsApp group Senior high school students limit the problem from various problems that have been identified, especially about COVID-19, then write the problem in WhatsApp group 10 min 3 Make mind map The teacher asks senior high school students to create mind maps with a variety of creative colors Senior high school students create a mind map about their problems and the solution for this problem, mind map made individually 30 min 4 Interpret result Senior high school students are asked by the teacher to interpret the mind map results that have been made Senior high school students interpret the mind map results that have been made in their notes 10 min 5 Analyze Result The teacher asks senior high school students to analyze the results written before Senior high school students write the results of the analysis in each note 10 min 6 Interaction and evaluate The teacher asks senior high school students to upload the mind map in e-learning media that has been created and asks other students to give comments in WhatsApp group Senior high school students upload mind maps on e-learning learning media and then comments about their classmates mind map in WhatsApp group 30 min Note: Duration of this ILMIZI learning for 100 minutes, duration can be modified according to the learning topic The ILMIZI model is one of the models developed to increase HOTS capabilities. Also, this model has compatibility with various competencies needed by students in the 21st century. Competencies in the 21st- century are critical thinking, creative thinking, communication, and collaboration. This ability can be improved by using the ILMIZI model which can be seen in Figure 1. Based on Figure 1 it can be seen that each step of learning from ILMIZI trains abilities in the 21st-century. Starting from the first learning stage which is identifying problems, this stage will train the ability of collaboration and communication between students in WhatsApp group. Communication in this context means students must give comments for their classmates works. That was because students must discuss between in group, so that the problems identified are not the same between groups. Then the second syntax was to limited the problem, this ability will practice the ability of critical thinking. That was because the limited problem must be specific, this critical thinking ability was needed to limit the problem. The next step was to made mind map and also interpret the results, the two stages of learning will train students' creative thinking skills. The ability to think creatively is very important in 21st-century learning (Camacho & Legare, 2015; Miller, 2018; Seechaliao, 2017; Şener et al., 2015). JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 6, No. 2, July 2020, pp. 265-272 269 Ichsan et al (HOTS-AEP-COVID-19 and ILMIZI learning …) Figure 1. ILMIZI learning model and 21st-century skills Process . After making a mind map individually and interpreting the results, the next step was to analyze the results of the mind map and the interpretation of the previous stages. Analysis on mind map focused on their limitation problem in step 2. This analysis stage will train students' critical thinking skills. That was because students will be able to think critically by analyzing a variety of data and events that occur around their environment. The final stage was interaction and evaluated, it will train the students' collaboration and communication skills. The ability of these students is needed in 21st-century learning. Based on the results of this study it was found that the ILMIZI learning model has the potential to be implemented using e-learning. In this research, ILMIZI not yet implemented on senior high school students. ILMIZI syntax in this context have an advantages and potentially to improve HOTS in future research. The use of ILMIZI has become a learning innovation when the COVID-19 pandemic. Changes in learning strategies when COVID-19 must be adapted to the use of suitable learning models. The learning model used to increase students' HOTS. That is because the Students HOTS score in COVID-19 was still low. This also makes learning innovation in terms of teaching materials or learning media must be further developed to improve HOTS (Barber et al., 2015; Chin & Chen, 2013; Parkin et al., 2012; Seechaliao, 2017). Innovations that can be further developed to improve students HOTS about concept of COVID-19 is to develop a worksheet, based on information about COVID-19. This will facilitate students in understanding various things about COVID-19 and prevention efforts in their respective environment. HOTS-AEP-COVID-19 can also be developed further in the form of a learning media integrated with HOTS questions. That will make the developed learning media have the potential to increase students' HOTS and also the 21st-century's ability of students (Deschryver, 2017; Istiyono et al., 2019; Saido et al., 2015; Saputri et al., 2018). Environmental learning, in this case, was a key role in reducing the impact of the spread of COVID-19 on students. That was because environmental learning discusses highly contextual topics related to COVID-19 prevention in their respective environments. In addition to changing the learning system, the existence of COVID-19 also changes the need for higher knowledge. That is because the ability of HOTS will greatly assist students in efforts to solve environmental problems (Fischer, 2018; Rahman, 2019; Turnip et al., 2016; Winarno et al., 2017). Specifically to prevent the spread of COVID-19 in their environment. The knowledge of students will be able to prevent students from COVID-19 pandemic. Therefore in the short term, it is necessary to develop various environmental learning innovations for various levels about COVID-19, especially in senior high school levels. CONCLUSION Based on the results of the study showed that students' HOTS scores measured using HOTS-AEP-COVID- 19 were in the very low category. It showed that students' knowledge of COVID-19 in the environment still needs to be improved. The ILMIZI model was the models that can be used in e-learning. That was because the ILMIZI previous develop, this model based on HOTS and each syntax can improve the ability of 21st-century skills. HOTS score of students relative in very low, the suggestion from this research was to develop various Interaction and Evaluate Communication Collaboration Critical Thinking Creative Thinking Identify Problem Limitation Problem Analyze result Make Mind Map Interpret result JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 6, No. 2, July 2020, pp. 265-272 270 Ichsan et al (HOTS-AEP-COVID-19 and ILMIZI learning …) HOTS-based learning media, teaching materials, students worksheet to support HOTS in environmental learning during COVID-19. ACKNOWLEDGEMENT Thank you to all the teachers in several school in Bekasi city, who have participated to help in the implementation of this research. Thank you to all senior high school students from several school in Bekasi city who are to be participants in this study. REFERENCES Ahorsu, D. K., Lin, C. Y., Imani, V., Saffari, M., Griffiths, M. D., & Pakpour, A. H. (2020). The fear of Covid-19 scale: development and initial validation. International Journal of Mental Health and Addiction, 1–9. doi: https://doi.org/10.1007/s11469-020-00270-8 Bakker, A., & Wagner, D. (2020). Pandemic: Lessons for today and tomorrow? Educational Studies in Mathematics, 104, 1-4. doi: https://doi.org/10.1007/s10649-020-09946-3 Barber, W., King, S., & Buchanan, S. (2015). Problem based learning and authentic assessment in digital pedagogy: Embracing the role of collaborative communities. Electronic Journal of E-Learning, 13(2), 59–67. doi: https://doi.org/10.1002/tl.7401 Barricelli, B. R., Gadia, D., Rizzi, A., & Marini, D. L. R. (2016). Semiotics of virtual reality as a communication process. Behaviour and Information Technology, 35(11), 879–896. doi: https://doi.org/10.1080/01449 29X.2016.1212092 Bashyam, A. M., & Feldman, S. R. (2020). Should patients stop their biologic treatment during the Covid-19 pandemic. The Journal of Dermatological Treatment, 31(4), 317-318. doi: https://doi.org/10.1080/09546 634.2020.1742438 Camacho, D. J., & Legare, J. M. (2015). Opportunities to create active learning techniques in the classroom. Journal of Instructional Research, 4, 38–45. doi: https://doi.org/10.9743/JIR.2015.5 Chin, K. Y., & Chen, Y. L. (2013). A mobile learning support system for ubiquitous learning environments. Procedia - Social and Behavioral Sciences, 73, 14–21. doi: https://doi.org/10.1016/j.sbspro.2013.02.013 Deschryver, M. (2017). Using the web as a higher order thinking partner: Case study of an advanced learner creatively synthesizing knowledge on the web. Journal of Educational Computing Research, 55(2), 240– 271. doi: https://doi.org/10.1177/0735633116667356 Erduran, S. (2020). Science education in the era of a pandemic to education for understanding and solving the Covid-19 crisis? Science & Education, 29, 233–235. doi: https://doi.org/10.1007/s11191-020-00122- w Fischer, E. (2018). Two analogy strategies: The cases of mind metaphors and introspection. Connection Science, 30(2), 211–243. doi: https://doi.org/10.1080/09540091.2017.1350937 Fitzpatrick, B., & Schulz, H. (2015). Do curriculum outcomes and assessment activities in science encourage higher order thinking? Canadian Journal of Science, Mathematics and Technology Education, 15(2), 136–154. doi: https://doi.org/10.1080/14926156.2015.1014074 Georgiev, T. (2020). Coronavirus disease 2019 (Covid-19) and anti-rheumatic drugs. Rheumatology International, 19–20. doi: https://doi.org/10.1007/s00296-020-04570-z Grant, M., & Smith, M. (2018). Quantifying assessment of undergraduate critical thinking. Journal of College Teaching & Learning, 15(1), 27–38. doi: https://doi.org/10.19030/tlc.v15i1.10199 He, Z. (2020). What further should be done to control Covid-19 outbreaks in addition to cases isolation and contact tracing measures? BMC Medicine, 18(1), 8–10. doi: https://doi.org/10.1186/s12916-020-01551- 8 Heong, Y. M., Yunos, J., Othman, W., Hassan, R., Kiong, T. T., & Mohamad, M. M. (2012). The needs analysis of learning higher order thinking skills for generating ideas. Procedia - Social and Behavioral Sciences, 59, 197–203. doi: https://doi.org/10.1016/j.sbspro.2012.09.265 Ichsan, I. Z. (2019). ILMIZI: Innovation learning model for natural science and environmental learning based on HOTS. International Journal for Educational and Vocational Studies, 1(6), 578–584. doi: https://doi. org/10.29103/ijevs.v1i6.1640 https://doi.org/10.1007/s11469-020-00270-8 https://doi.org/10.1007/s10649-020-09946-3 https://doi.org/10.1002/tl.7401 https://doi.org/10.1080/0144929X.2016.1212092 https://doi.org/10.1080/0144929X.2016.1212092 https://doi.org/10.1080/09546634.2020.1742438 https://doi.org/10.1080/09546634.2020.1742438 https://doi.org/10.9743/JIR.2015.5 https://doi.org/10.1016/j.sbspro.2013.02.013 https://doi.org/10.1177/0735633116667356 https://doi.org/10.1007/s11191-020-00122-w https://doi.org/10.1007/s11191-020-00122-w https://doi.org/10.1080/09540091.2017.1350937 https://doi.org/10.1080/14926156.2015.1014074 https://doi.org/10.1007/s00296-020-04570-z https://doi.org/10.19030/tlc.v15i1.10199 https://doi.org/10.1186/s12916-020-01551-8 https://doi.org/10.1186/s12916-020-01551-8 https://doi.org/10.1016/j.sbspro.2012.09.265 https://doi.org/10.29103/ijevs.v1i6.1640 https://doi.org/10.29103/ijevs.v1i6.1640 JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 6, No. 2, July 2020, pp. 265-272 271 Ichsan et al (HOTS-AEP-COVID-19 and ILMIZI learning …) Ichsan, I. Z., Rahmayanti, H., Purwanto, A., Sigit, D. V., Singh, C. K. S., & Babu, R. U. M. (2020). HOTS-AEP- Covid-19: Students knowledge and digital worksheet of ilmizi environmental learning model. International Journal of Advanced Science and Technology, 29(6), 5231–5241. Retrieved from http://sersc.org/journals/index.php/IJAST/article/view/19581 Ichsan, I. Z., Sigit, D. V., Miarsyah, M., Ali, A., Arif, W. P., & Prayitno, T. A. (2019). HOTS-AEP: Higher order thinking skills from elementary to master students in environmental learning. European Journal of Educational Research, 8(4), 935–942. doi: https://doi.org/10.12973/eu-jer.8.4.935 Ichsan, I. Z., Sigit, D. V., Rahmayanti, H., Purwanto, A., Rosyid, A., Suwandi, T., Ali, A., & Hermawati, F. M. (2020). Implementasi model pembelajaran ILMIZI dan peningkatan HOTS siswa SD berdasarkan gender pada pembelajaran lingkungan. JIPVA (Jurnal Pendidikan IPA Veteran), 4(1), 11–24. doi: https://doi.org/10.31331/jipva.v4i1.1076 Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2019). Developing of computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European Journal of Educational Research, 9(1), 91–101. doi: https://doi.org/10.12973/eu-jer.9. 1.91 Lee, A. Y. L. (2016). Media education in the School 2.0 era: Teaching media literacy through laptop computers and iPads. Global Media and China, 1(4) 435–449 doi: https://doi.org/10.1177/20594364166 67129 Mbipom, B., Craw, S., & Massie, S. (2018). Improving e-learning recommendation by using background knowledge. Expert Systems, 2018, e12265. doi: https://doi.org/10.1111/exsy.12265 Mhouti, A. El, Erradi, M., & Nasseh, A. (2018). Using cloud computing services in e-learning process: Benefits and challenges. Education and Information Technologies, 23(2), 893–909. doi: https://doi.org/10.1007/s 10639-017-9642-x Mhouti, A. El, Nasseh, A., Erradi, M., & Vasquèz, J. M. (2017). Enhancing collaborative learning in Web 2.0- based e-learning systems: A design framework for building collaborative e-learning contents. Education and Information Technologies, 22(5), 2351–2364. doi: https://doi.org/10.1007/s10639-016-9545-2 Miller, A. L. (2018). The role of creative coursework in skill development for university seniors. Global Education Review, 5(1), 88–107. Retrieved from https://ger.mercy.edu/index.php/ger/article/view/360 Mirabolghasemi, M., Choshaly, S. H., & Iahad, N. A. (2019). Using the HOT-fit model to predict the determinants of E-learning readiness in higher education: A developing Country’s perspective. Education and Information Technologies, 24(6), 3555–3576. doi: https://doi.org/10.1007/s10639-019- 09945-9 Ni, L., Zhou, L., Zhou, M., Zhao, J., & Wang, D. W. (2020). Combination of western medicine and Chinese traditional patent medicine in treating a family case of Covid-19 in Wuhan. Frontiers of Medicine. doi: https://doi.org/10.1007/s11684-020-0757-x Nissim, Y., Weissblueth, E., Scott-Webber, L., & Amar, S. (2016). The effect of a stimulating learning environment on pre-service teachers’ motivation and 21st century skills. Journal of Education and Learning, 5(3), 29. doi: https://doi.org/10.5539/jel.v5n3p29 Nugraini, S. H., Choo, K. A., Hin, H. S., & Hoon, T. S. (2013). Impact of e-AV biology website for learning about renewable energy. TOJET: The Turkish Online Journal of Educational Technology, 12(2), 376– 386. Retrieved from http://www.tojet.net/articles/v12i2/12235.pdf Oncu, E. C. (2016). Improved creative thinkers in a class: A model of activity based tasks for improving university students creative thinking abilities. Educational Research and Reviews, 11(8), 517–522. doi: https://doi.org/10.5897/ERR2015.2262 Parkin, H. J., Hepplestone, S., Holden, G., Irwin, B., & Thorpe, L. (2012). A role for technology in enhancing students’ engagement with feedback. Assessment and Evaluation in Higher Education, 37(8), 963–973. doi: https://doi.org/10.1080/02602938.2011.592934 Quieng, M. C., Lim, P. P., & Lucas, M. R. D. (2015). 21st century-based soft skills: Spotlight on non-cognitive skills in a cognitive-laden dentistry program. European Journal of Contemporary Education, 11(1), 72– 81. doi: https://doi.org/10.13187/ejced.2015.11.72 Radovan, M., & Perdih, M. (2016). Developing guidelines for evaluating the adaptation of accessible web- based learning materials. International Review of Research in Open and Distance Learning, 17(4), 166– 181. doi: https://doi.org/10.19173/irrodl.v17i4.2463 Rahman, M. M. (2019). 21st century skill “Problem Solving”: Defining the concept. Asian Journal of Interdisciplinary Research, 2(1), 64–74. doi: https://doi.org/10.34256/ajir1917 http://sersc.org/journals/index.php/IJAST/article/view/19581 https://doi.org/10.12973/eu-jer.8.4.935 https://doi.org/10.31331/jipva.v4i1.1076 https://doi.org/10.12973/eu-jer.9.1.91 https://doi.org/10.12973/eu-jer.9.1.91 https://doi.org/10.1177/2059436416667129 https://doi.org/10.1177/2059436416667129 https://doi.org/10.1111/exsy.12265 https://doi.org/10.1007/s10639-017-9642-x https://doi.org/10.1007/s10639-017-9642-x https://doi.org/10.1007/s10639-016-9545-2 https://ger.mercy.edu/index.php/ger/article/view/360 https://doi.org/10.1007/s10639-019-09945-9 https://doi.org/10.1007/s10639-019-09945-9 https://doi.org/10.1007/s11684-020-0757-x https://doi.org/10.5539/jel.v5n3p29 http://www.tojet.net/articles/v12i2/12235.pdf https://doi.org/10.5897/ERR2015.2262 https://doi.org/10.1080/02602938.2011.592934 https://doi.org/10.13187/ejced.2015.11.72 https://doi.org/10.19173/irrodl.v17i4.2463 https://doi.org/10.34256/ajir1917 JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 6, No. 2, July 2020, pp. 265-272 272 Ichsan et al (HOTS-AEP-COVID-19 and ILMIZI learning …) Reyna, J., Hanham, J., & Meier, P. C. (2019). A framework for digital media literacies for teaching and learning in higher education. E-Learning and Digital Media, 15(4), 176–190. doi: https://doi.org/10.1177/ 2042753018784952 Saido, G. M., Siraj, S., Nordin, A. B. Bin, & Amedy, O. S. A. (2015). Higher order thinking skills among secondary school students in science learning. The Malaysian Online Journal of Educational Science, 3(3), 13–20. Retrieved from https://mojes.um.edu.my/article/view/12778 Saputri, A. C., Sajidan, S., Rinanto, Y., Afandi, A., & Prasetyanti, N. M. (2018). Improving students’ critical thinking skills in cell-metabolism learning using stimulating higher order thinking skills model. International Journal of Instruction, 12(1), 327–342. doi: https://doi.org/10.29333/iji.2019.12122a Seechaliao, T. (2017). Instructional strategies to support creativity and innovation in education. Journal of Education and Learning, 6(4), 201–208. doi: https://doi.org/10.5539/jel.v6n4p201 Şener, N., Türk, C., & Taş, E. (2015). Improving science attitude and creative thinking through science education project: A design, implementation and assessment. Journal of Education and Training Studies, 3(4), 57–67. doi: https://doi.org/10.11114/jets.v3i4.771 Sintema, E. J. (2020). Effect of COVID-19 on the performance of grade 12 students: Implications for stem education. Eurasia Journal of Mathematics, Science and Technology Education, 16(7), 1–6. doi: https:// doi.org/10.29333/ejmste/7893 Tian, S., Hu, N., Lou, J., Chen, K., Kang, X., Xiang, Z., Chen, H., Wang, D., Liu, N., Liu, D., Chen, G., Zhang, Y., Li, D., Li, J., Lian, H., Niu, S., Zhang, L., & Zhang, J. (2020). Characteristics of Covid-19 infection in Beijing. Journal of Infection, 80(4), 401–406. doi: https://doi.org/10.1016/j.jinf.2020.02.018 Turnip, B., Wahyuni, I., & Tanjung, Y. I. (2016). The effect of inquiry training learning model based on just in time teaching for problem solving skill. Journal of Education and Practice, 7(15), 177–181. Retrieved from https://eric.ed.gov/?id=EJ1103095 Vijayaratnam, P. (2012). Developing higher order thinking skills and team commitment via group problem solving: a bridge to the real world. Procedia - Social and Behavioral Sciences, 66, 53–63. doi: https:// doi.org/10.1016/j.sbspro.2012.11.247 Wang, S., & Wang, H. (2011). Teaching higher order thinking in the introductory mis course: A model-directed approach. Journal of Education for Business, 86(4), 208–213. doi: https://doi.org/10.1080/08832323.201 0.505254 Winarno, S., Muthu, K. S., & Ling, L. S. (2017). Direct problem-based learning (DPBL): A framework for integrating direct instruction and problem-based learning approach. International Education Studies, 11(1), 119–126. doi: https://doi.org/10.5539/ies.v11n1p119 Yeung, S. yin S. (2015). Conception of teaching higher order thinking: Perspectives of Chinese teachers in Hong Kong. Curriculum Journal, 26(4), 553–578. doi: https://doi.org/10.1080/09585176.2015.1053818 Zhou, G., Chen, S., & Chen, Z. (2020). Back to the spring of Wuhan: Facts and hope of Covid-19 outbreak. Frontiers of Medicine, 1–4. doi: https://doi.org/10.1007/s11684-020-0758-9 Zohar, A., & Agmon, V. A. (2018). Raising test scores vs. teaching higher order thinking (HOT): Senior science teachers’ views on how several concurrent policies affect classroom practices. Research in Science and Technological Education, 36(2), 243–260. doi: https://doi.org/10.1080/02635143.2017.139 5332 https://doi.org/10.1177/2042753018784952 https://doi.org/10.1177/2042753018784952 https://mojes.um.edu.my/article/view/12778 https://doi.org/10.29333/iji.2019.12122a https://doi.org/10.5539/jel.v6n4p201 https://doi.org/10.11114/jets.v3i4.771 https://doi.org/10.29333/ejmste/7893 https://doi.org/10.29333/ejmste/7893 https://doi.org/10.1016/j.jinf.2020.02.018 https://eric.ed.gov/?id=EJ1103095 https://doi.org/10.1016/j.sbspro.2012.11.247 https://doi.org/10.1016/j.sbspro.2012.11.247 https://doi.org/10.1080/08832323.2010.505254 https://doi.org/10.1080/08832323.2010.505254 https://doi.org/10.5539/ies.v11n1p119 https://doi.org/10.1080/09585176.2015.1053818 https://doi.org/10.1007/s11684-020-0758-9 https://doi.org/10.1080/02635143.2017.1395332 https://doi.org/10.1080/02635143.2017.1395332