Universitas Muhammadiyah Malang, East Java, Indonesia JPBI (Jurnal Pendidikan Biologi Indonesia) p-ISSN 2442-3750, e-ISSN 2537-6204 // Vol. 5 No. 3 November 2019, pp. 451-458 10.22219/jpbi.v5i3.8768 http://ejournal.umm.ac.id/index.php/jpbi jpbi@umm.ac.id 451 Research Article Information literacy skill: An alternative to support biology student’s learning outcomes Murni Saptasari a,1,*, S. Sunarmi a,2, Eko Sri Sulasmi a,3, Rido Sigit Wicaksono a,4, Ahmad Kamal Sudrajat a,5 a Department of Biology, Faculty of Mathematics and Sciences, Universitas Negeri Malang, Jl. Semarang 5 Malang, East Java 65145, Indonesia 1 murni.sapta.fmipa@um.ac.id*; 2 sunarmi.fmipa@um.ac.id; 3 eko.sri.fmipa@um.ac.id; 4 rsigit23@gmail.com; 5 kamalsudrajat2@gmail.com * Corresponding author INTRODUCTION The fast and rapid development of information and technology in the 21st-Century becomes a challenge for educators. The challenges are to educate students as curious individuals, to think critically, and communicate effectively (Bell, 2010; Binkley et al., 2014; Erich & Popescu, 2010; Greenstein, 2012). Saglam, Cankaya, Ucer, and Cetin (2017) argues that the development of information technology has a significant impact on education, the most important problem to overcome in the 21st-Century is instilling information literacy to students. The purpose of information literacy is fundamentally helping students to understand the knowledge-making process and strengthen their capacity in terms of using and creating a variety of information or knowledge products (Feng & Ha, 2016; Fullard, 2017; Ranaweera, 2017). The definition of information literacy is a set of integrated A R T I C L E I N F O A B S T R A C T Article history Received June 29, 2019 Revised November 01, 2019 Accepted November 19, 2019 Published November 30, 2019 Information literacy is a fundamental aspect to ease students in encompassing the knowledge-making process as well as empowering their capacity in using and creating various information and knowledge products. The purpose of this study was to determine the effect of integrating information literacy rubric with Project-Based Learning on students’ learning outcomes in Structure of Plant Development course. This quasi-experimental research used a non-randomized pretest-posttest control group design. The population in this study was the all biology department undergraduate students at the Universitas Negeri Malang in 2018/2019 academic year. The sample consisted of 120 students which were divided into two groups (control and experiment). The data gained was analyzed using one-way ANCOVA. The results showed that Project-Based Learning which was integrated with information literacy rubric had a significant impact on biology students’ learning outcomes. Based on the findings, it is suggested that educators should provide a proper strategy as an effort to support their students’ learning outcomes. Copyright © 2019, Saptasari et al This is an open access article under the CC–BY-SA license Keywords Information literacy skill Learning outcome Project-based learning outcome How to cite: Saptasari, M., Sunarmi, S., Sulasmi, E. S., Wicaksono, R., & Sudrajat, A. K. (2019). Information literacy skill: An alternative to support biology student’s learning outcomes. JPBI (Jurnal Pendidikan Biologi Indonesia), 5(3), 451- 458. doi: https://doi.org/10.22219/jpbi.v5i3.8768 http://ejournal.umm.ac.id/ http://u.lipi.go.id/1422867894 http://u.lipi.go.id/1460300524 https://doi.org/10.22219/jpbi.v5i3.8768 http://ejournal.umm.ac.id/index.php/jpbi mailto:jpbi@umm.ac.id http://creativecommons.org/licenses/by-sa/4.0/ https://doi.org/10.22219/jpbi.v5i3.8768 https://crossmark.crossref.org/dialog/?doi=10.22219/jpbi.v5i3.8768&domai JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 5, No. 3, November 2019, pp. 451-458 452 Saptasari et al (Information literacy skill …) capabilities that include: 1) identification of the extent of information needed; 2) accessing information effectively and efficiently; 3) critically evaluate information and sources; 4) use information effectively to achieve individual goals; 5) access and use information ethically and legally (Hulett et al., 2013; Klucevsek & Brungard, 2016). Information literacy is generally needed to find, take, analyze, and use information (Ranaweera, 2017). Information literacy is an important skill to be empowered. With information literacy, students will become learning human beings (Feng & Ha, 2016). Ranaweera (2017) adds through information literacy, students are provided with an ability to recognize when they need information, where to locate it, how to use it effectively and efficiently, also evaluate the information and sources critically. In spite of the importance of information literacy, it is reported that information literacy skills of Indonesian high school and higher education students belong to a low category. PISA (2015) reported that Indonesia student’s reading proficiency score is 397 which belongs to the 1b level. It means that Indonesian students can make a simple connection between information in the text and common everyday knowledge, but still incapable to make a reflection and critically evaluate the quality of a worth-to-read text. The low reading proficiency contributes to the low level of information literacy skill in higher education. Sinurat, Zulharman, and Amtarina (2017) showed that college students are commonly able to decide the extent of needed information, access information effectively but still unable to evaluate the information resources efficiently and critically. A low-skilled person will affect the learning outcome of that person since learning itself needs skill in managing information. These phenomena are caused by the implementation of inappropriate learning strategies. Information literacy skills in traditional learning are often not honed because students are only passive recipients of information through the lecture method (Detlor et al. 2012). Some of the lecturer’s teaching is more likely to provide extensive scientific content without regarding the process of how students achieve learning goals (Stefani, 2009). Whereas biology students need to be trained to be skilled in information literacy in developing scientific methods. McFarlane (2013) states that learning science is advancing factual, principle and procedural knowledge through scientific means. Flierl, Bonem, Maybee, and Fundator (2018) emphasize information literacy as an essential result of undergraduate education. Porter et al. (2010) add that it is necessary to provide authentic learning opportunities for first-year biology students by exploring science as a process, so students may turn into information literates. Information literacy can be developed using appropriate learning models/strategies/methods (Dolničar, Podgornik, & Bartol, 2017; Dunne, Dunne, & Sheridan, 2012; Genlott & Grönlund, 2013; Hulett et al., 2013; Karimi, Ashrafi-Rizi, Papi, Shahrzadi, & Hassanzadeh, 2015). One learning model that can improve skills information literacy is Project-Based Learning (PjBL) (Chu, Tse, & Chow, 2011; Eliana, Senam, Wilujeng, & Jumadi, 2016; Saliba, Mussleman, Fernandes, & Bendriss, 2017). PjBL is considered a better effort than a lecture method since involving an in-depth exploration of issues, themes or problems without predefined answers (Harada, Kirio, & Yamamoto, 2008). The previous study by Saptasari, Sunarmi, and Sulasmi (2018) found that there was no effect of PjBL on biology student’s botanical literacy skills, another form of information literacy skill which is emphasizing on botany, in the Structure and Development of Plants course. The study showed that students experience several obstacles in completing the project, such as 1) having difficulty in reading and taking the core of scientific reading material content; 2) inadequate research sources in compiling articles and analyzing data; 3) students often use reference sources that cannot be justified. In line with Wijaya, Sudjimat, and Nyoto (2016) stated that there were commonly found errors during the information literacy learning process such as misunderstanding the instruction and error in selecting information. Therefore PjBL itself should be combined by a learning tool which provides direct feedback to maximize its effect upon the information literacy skill. A learning tool which provides direct feedback toward the student’s process is a formative assessment. Davies, Earle, McMahon, Howe, and Collier (2017) stated that a formative assessment is a process used by teachers and students during instruction that provides feedback to adjust ongoing teaching and learning to improve student’s achievement of an intended instructional outcome. Through formative assessments, teachers monitor student progress, provide students feedback and adjust instructional approaches toward improved teaching and learning (Andersson & Palm, 2017; Hansen & Ringdal, 2018; Hooker, 2017). In other words, a formative assessment may also help students identify their strengths and weakness and the target areas that need to be worked on (Hansen & Ringdal, 2018; Xiao & Yang, 2019; Zainuddin, Shujahat, Haruna, & Chu, 2020). Additionally, it helps the teacher recognize where students are struggling and address problems immediately. There are still barely found any research trying to determine the effect of integrating formative assessment in a certain learning model in order to promote student’s learning outcomes through information literacy. Thus, this research aims to determine the effect of integrating information literacy rubric, as a formative assessment, on Project-Based Learning in student’s learning outcomes during the Structure of Plant Development course. JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 5, No. 3, November 2019, pp. 451-458 453 Saptasari et al (Information literacy skill …) METHOD This quasi-experimental research was using a nonrandomized pretest-posttest control group design (Leedy & Ormrod, 2019) as shown in Table 1. The study conducted in March - November 2018. The population in the study was all Biology Department undergraduate students at the Universitas Negeri Malang in the 2018/2019 academic year. The sample used was consisted of 120 students who took the Structure of Plant Development course. The sample divided into two study groups (control and experimental group). Each study group consisted of two classes. Control groups used a project-based learning model while the experimental groups used a project-based learning model that integrated the information literacy rubric. Both groups are equally given the same project which is making a scientific paper as an alternative problem solving through research approaches and related to the structure and development of plant generative topic, therefore the expected learning outcome is a writing skill. Table 1. Non-randomized pretest-posttest control group design Group Pretest Treatments Posttest K T1 X1 T2 E T3 X2 T4 Note: K = control group; E = experiment group; X1 = PjBL; X2 = PjBL integrated information literacy rubric The measured learning achievement was students' writing skills using the rubric for a research project in education which is adapted from Wolf and Stevens (2007). The rubric itself contains eight aspects namely abstract, introduction, methods results, discussion/conclusion, limitation, references, and written report. Every aspect consists of three indicators (beginning, proficient, and advanced) including a description for each indicator. The data were analyzed using descriptive and inferential analysis. The inferential analysis was used to test the students' research hypothesis. The inferential analysis used the ANCOVA test with the prerequisite test namely homogeneity (Levene’s test) and normality (Shapiro-Wilk) test. Descriptive analysis was used to describe the students’ learning outcomes. Also, questionnaires were given to understand students’ responses toward the information literacy rubric. The rubric consists of three opened-question which asked how do students feel by using the rubric in the PjBL, do they find the rubric gave wether advantages or disadvantages, and what do they use the rubric for. RESULTS AND DISCUSSION The result of the homogeneity and normality test is presented in Table 2 and Table 3, respectively. The homogeneity result shows that Sig. value 0.313 > 0.05, this means that the data is homogeneous. Table 3 shows that the data distributed normally with the Sig. value is 0.61 > 0.05. Table 2. Homogeneity test results F df1 df2 Sig. 1.026 1 118 0.313 Table 3. Normality test result N 120 Normal Parameters a,b Mean .0000 Std. Deviation 4.81630 Most Extreme Differences Absolute .079 Positive .046 Negative -.079 Test Statistic .079 Asymp. Sig. (2-tailed) .061c Table 4 shows a summary of the ANCOVA test results in the control and experiment group. The results of the ANCOVA test is less than 0.05, this means that the null hypothesis rejected and the research hypothesis is accepted. In other words, the information literacy rubric used in the experimental group affects the students’ learning outcomes. Furthermore, Table 5 shows the corrected average students’ learning outcomes in the experimental group amounting to 75.911% while in the control group were 66.489%. These findings indicate that the empowerment of learning outcomes with information literacy rubric assessment in the experimental JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 5, No. 3, November 2019, pp. 451-458 454 Saptasari et al (Information literacy skill …) group is better than in the control group. These results also supported by the improvement of students’ learning outcomes percentage in the experimental group which is higher than the control group. Table 4. Summary of ANCOVA test results in experimental and control group Source Type III Sum of Squares df Mean Square F Sig. Corrected Model 6308.783a 2 3154.391 133.699 0.000 Intercept 3311.249 1 3311.249 140.347 0.000 XHBK 3601.283 1 3601.283 152.640 0.000 Class 2663.597 1 2663.597 112.896 0.000 Error 2760.417 117 23.593 Total 617402.000 120 Corrected Total 9069.200 119 a. R Squared = .696 (Adjusted R Squared = .690) Table 5. Comparison of corrected average learning outcomes in experimental and control group Group Pretest Posttest Difference Corrected Average Experiment 54.75 75.950 21.200 75.911 Control 54.63 66.450 11.817 66.489 Based on these comparisons, it can be seen that the application of information literacy rubric assessment can improve learning outcomes compared to the control group. According to Soleymani (2014) there was a link between information literacy and student academic success at Isfahan University of Medical Sciences. Other research was conducted by Julien, Detlor, Serenko, Willson, and Lavallee (2009b, 2009a) showed that there is an influence between information literacy and student learning outcomes. Flierl et al. (2018) argue that giving student assignment to synthesize information and communicate results throughout one semester are correlate positively with academic achievement. The results of the ANCOVA test show that information literacy influences learning outcomes. Besides that, it is found that the average corrected learning achievement of students in the experimental group is higher than control group. These findings indicate that the empowerment of learning outcomes with information literacy rubric assessment in the experimental group is better than students in the control group without it. The task given for students in one semester in the Structure of Plant Development course was to compile scientific articles. However, based on the results of previous research shows that students are still not trained and therefore need effort through information literacy (Saptasari et al., 2018). Klucevsek and Brungard (2016) declare that to be able to write in compiling scientific articles, students must develop skills in information literacy. Information literacy treatment in the experimental group with a rubric to assist students in completing assignments. The research is following Rapchak, Brungard, and Bergfelt (2016) opinion that rubric is used as a formative assessment to help students in the learning process. Authentic assessments of the tasks applied will make students possess not only content mastery but also the ability to use content knowledge in problem- solving. Other research shows that the use of formative assessment rubrics can improve critical thinking skills (Visande, 2014). Thus, the utilization information literacy as formative assessment may also help students identify their strengths and weakness and the target areas that need to be worked on (Andersson & Palm, 2017; Hansen & Ringdal, 2018; Wilson, Roscoe, & Ahmed, 2017; Xiao & Yang, 2019; Zainuddin et al., 2020). In addition, student’s will improve their learning outcome because of the teacher can recognize where students are struggling and address problems immediately. The results of the descriptive analysis revealed that students showed an active learning process in carrying out tasks from information literacy rubric assessment such as identifying the extent of information needed, accessing and evaluating information. Detlor et al. (2012) stated that the application of information literacy is an active learning strategy because through information literacy rubric students analyze, synthesize, and evaluate information to support the achievement of student learning in the classroom. The result also indicated that students in the experimental group experienced some benefits from using the information literacy rubric assessment. Generally, there are three benefits and its percentage which can be seen in Figure 1. Findings from student responses indicate that the use of rubric information literacy provides several benefits for students such as: (1) giving clear instruction guidance; (2) assessing individual achievement; and (3) motivating better performance. Laurian and Fitzgerald (2013) said that rubric directed at helping lecturers and students to assess their learning, thus a student can improve their learning formally. The use of rubrics is essential when working with complex learning processes. Rapchak et al. (2016) emphasizes that the rubric used according to the project learning model allows students to assess their assignments directly and the purpose is to determine the learning outcomes. In line with the finding of Bennett (2011) that identified the key of formative assessment strategies which were said to be effective in improving learners’ achievement including (1) clarifying and JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 5, No. 3, November 2019, pp. 451-458 455 Saptasari et al (Information literacy skill …) sharing learning intentions and criteria for success; (2) providing feedback that moves learners forward; (3) activating students as the owners of their learning (self-assessment); and (4) activating students as instructional resources for one another (peer assessment). 70% 20% 10% Giving clear instruction guidance Assessing individual achievement Motivating better performance Figure 1. Percentage of student’s responses toward the benefits of using information literacy rubric assessment The implementation of the information literacy rubric assessment used consists of three criteria: 1) beginning; 2) proficient; and 3) advanced. The results obtained from students, in general, are still at the beginning of the indicator because it needs to integrate into several other subjects to help develop students' intellectual abilities. At the beginning of the sign has a concept to connect science with other disciplines, student can write scientific terms, but they still have misunderstandings (Fakhriyah, Masfuah, Roysa, Rusilowati, & Rahayu, 2017). According to Flierl et al. (2018) the relationship between information literacy and student achievement varies based on the rating scale. The range of studies of small-scale investigations offers in detail how students use information for specific tasks and large-scale studies related to library resources. The results of this research showed that PjBL which was integrated with information literacy rubric had a significant impact on biology students’ learning outcomes. However, it is suggested that educators should provide a proper strategy as an effort to support their students’ learning outcomes. CONCLUSION The results showed that Project-Based Learning which was integrated with the information literacy rubric had a significant impact on biology students’ learning outcomes. There are differences in the enhancement of student’s learning outcomes between the experiment group and the control group. The experiment group which used PjBL integrated with information literacy rubric assessment had better learning outcomes enhancement than the control group which just used PjBL. The results showed that the use of information literacy rubric assessment affected the student learning outcome with a corrected average is 75,911. Based on the findings, it is suggested that educators should provide a proper strategy as an effort to support their students’ learning outcomes. ACKNOWLEDGMENT This research was supported and funded by DRPM (Direktorat Riset dan Pengabdian Masyarakat or Directorate of Research and Community Engagement) of Ministry of Research and Technology of the Republic JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 5, No. 3, November 2019, pp. 451-458 456 Saptasari et al (Information literacy skill …) of Indonesia with PDUPT (Penelitian Dasar Unggulan Perguruan Tinggi or Basic Research of Higher Education) scheme. REFERENCES Andersson, C., & Palm, T. (2017). The impact of formative assessment on student achievement: A study of the effects of changes to classroom practice after a comprehensive professional development programme. Learning and Instruction, 49, 92–102. doi: https://doi.org/10.1016/j.learninstruc.2016.12.00 6 Bell, S. (2010). Project-based learning for the 21st century: Skills for the future. The Clearing House: A Journal of Educational Strategies, Issues and Ideas, 83(2), 39–43. doi: https://doi.org/10.1080/0009865 0903505415 Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy and Practice, 18(1), 5–25. doi: https://doi.org/10.1080/0969594X.2010.513678 Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2014). Defining twenty-first century skills. In Assessment and teaching of 21st century skills. doi: https://doi.org/10.1007/ 978-94-007-2324-5_2 Chu, S. K. W., Tse, S. K., & Chow, K. (2011). Using collaborative teaching and inquiry project-based learning to help primary school students develop information literacy and information skills. Library and Information Science Research, 33(2), 132–143. doi: https://doi.org/10.1016/j.lisr.2010.07.017 Davies, D. J., Earle, S., McMahon, K., Howe, A., & Collier, C. (2017). Development and exemplification of a model for teacher assessment in primary science. International Journal of Science Education, 39(14), 1869–1890. doi: https://doi.org/10.1080/09500693.2017.1356942 Detlor, B., Booker, L., Serenko, A., & Julien, H. (2012). Student perceptions of information literacy instruction: The importance of active learning. Education for Information, 29(2), 147–161. doi: https://doi.org/10.323 3/EFI-2012-0924 Dolničar, D., Podgornik, B. B., & Bartol, T. (2017). A comparative study of three teaching methods on student information literacy in stand-alone credit-bearing university courses. Journal of Information Science, 43(5), 601–614. doi: https://doi.org/10.1177/0165551516655084 Dunne, S., Dunne, S., & Sheridan, V. (2012). Developing first year student information literacy: Reflections on the learning process. All Ireland Journal of Higher Education, 4(1), 1–15. Retrieved from https://ojs.aish e.org/index.php/aishe-j/article/view/72 Eliana, E. D. S., Senam, Wilujeng, I., & Jumadi. (2016). The effectiveness of project-based e-learning to improve ICT literacy. Jurnal Pendidikan IPA Indonesia, 5(1), 51–55. doi: https://doi.org/10.15294/jpii.v 5i1.5789 Erich, A., & Popescu, C. (2010). The impact of information literacy in the academic education environment. Library and Information Science, (14), 150–161. Retrieved from https://www.researchgate.net/pub lication/265036131_The_Impact_of_Information_Literacy_in_the_Academic_Education_Environment Fakhriyah, F., Masfuah, S., Roysa, M., Rusilowati, A., & Rahayu, E. S. (2017). Student’s science literacy in the aspect of content science? Jurnal Pendidikan IPA Indonesia, 6(1), 81–87. doi: https://doi.org/10.152 94/jpii.v6i1.7245 Feng, L., & Ha, J. L. (2016). Effects of teachers’ information literacy on lifelong learning and school effectiveness. Eurasia Journal of Mathematics, Science and Technology Education, 12(6), 1653–1663. doi: https://doi.org/10.12973/eurasia.2016.1575a Flierl, M., Bonem, E., Maybee, C., & Fundator, R. (2018). Information literacy supporting student motivation and performance: Course-level analyses. Library and Information Science Research, 40(1), 30–37. doi: https://doi.org/10.1016/j.lisr.2018.03.001 Fullard, A. (2017). Using the ACRL Framework for information literacy to foster teaching and learning partnerships. South African Journal of Libraries and Information Science, 82(2), 46–56. doi: https://doi. org/10.7553/82-2-1627 Genlott, A. A., & Grönlund, Å. (2013). Improving literacy skills through learning reading by writing: The iWTR method presented and tested. Computers and Education, 67, 98–104. doi: https://doi.org/10.1016/j.com pedu.2013.03.007 Greenstein, L. (2012). Assessing 21st century skills: A guide to evaluating mastery and authentic learning. California United State of America: Corwin Press. Retrieved from https://us.corwin.com/en-us/nam/asse https://doi.org/10.1016/j.learninstruc.2016.12.006 https://doi.org/10.1016/j.learninstruc.2016.12.006 https://doi.org/10.1080/00098650903505415 https://doi.org/10.1080/00098650903505415 https://doi.org/10.1080/0969594X.2010.513678 https://doi.org/10.1007/978-94-007-2324-5_2 https://doi.org/10.1007/978-94-007-2324-5_2 https://doi.org/10.1016/j.lisr.2010.07.017 https://doi.org/10.1080/09500693.2017.1356942 https://doi.org/10.3233/EFI-2012-0924 https://doi.org/10.3233/EFI-2012-0924 https://doi.org/10.1177/0165551516655084 https://ojs.aishe.org/index.php/aishe-j/article/view/72 https://ojs.aishe.org/index.php/aishe-j/article/view/72 https://doi.org/10.15294/jpii.v5i1.5789 https://doi.org/10.15294/jpii.v5i1.5789 https://www.researchgate.net/publication/265036131_The_Impact_of_Information_Literacy_in_the_Academic_Education_Environment https://www.researchgate.net/publication/265036131_The_Impact_of_Information_Literacy_in_the_Academic_Education_Environment https://doi.org/10.15294/jpii.v6i1.7245 https://doi.org/10.15294/jpii.v6i1.7245 https://doi.org/10.12973/eurasia.2016.1575a https://doi.org/10.1016/j.lisr.2018.03.001 https://doi.org/10.7553/82-2-1627 https://doi.org/10.7553/82-2-1627 https://doi.org/10.1016/j.compedu.2013.03.007 https://doi.org/10.1016/j.compedu.2013.03.007 https://us.corwin.com/en-us/nam/assessing-21st-century-skills/book237748 JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 5, No. 3, November 2019, pp. 451-458 457 Saptasari et al (Information literacy skill …) ssing-21st-century-skills/book237748 Hansen, G., & Ringdal, R. (2018). Formative assessment as a future step in maintaining the mastery - approach and performance-avoidance goal stability. Studies in Educational Evaluation, 56, 59–70. doi: https://doi.org/10.1016/j.stueduc.2017.11.005 Harada, V. H., Kirio, C. H., & Yamamoto, S. H. (2008). Collaborating for project-based learning in Grades 9- 12. Linworth. Retrieved from https://www.abc-clio.com/ABC-CLIOCorporate/product.aspx?pc=A2441P Hooker, T. (2017). Transforming teachers’ formative assessment practices through ePortfolios. Teaching and Teacher Education, 67, 440–453. doi: https://doi.org/10.1016/j.tate.2017.07.004 Hulett, H., Corbin, J., Karasmanis, S., Robertson, T., Salisbury, F., & Peseta, T. (2013). Information literacy at university: A toolkit for readiness and measuring impact. Australian Academic and Research Libraries, 44(3), 151–162. doi: https://doi.org/10.1080/00048623.2013.813372 Julien, H., Detlor, B., Serenko, A., Willson, R., & Lavallee, M. (2009a). Learning outcomes of information literacy instruction at Business Schools. Journal of the American Society for Information Science, 60(1999), 2353–2361. doi: https://doi.org/10.1002/asi Julien, H., Detlor, B., Serenko, A., Willson, R., & Lavallee, M. (2009b). Outcomes of information literacy instruction for undergraduate Business Students. Proceedings of the ASIST Annual Meeting, 46. doi: https://doi.org/10.1002/meet.2009.145046026 Karimi, Z., Ashrafi-Rizi, H., Papi, A., Shahrzadi, L., & Hassanzadeh, A. (2015). Effect of information literacy training course on information literacy skills of undergraduate students of Isfahan University of Medical Sciences based on ACRL standards. Journal of Education and Health Promotion, 4, 76. doi: https://doi. org/10.4103/2277-9531.171789 Klucevsek, K. M., & Brungard, A. B. (2016). Information literacy in science writing: how students find, identify, and use scientific literature. International Journal of Science Education, 38(17), 2573–2595. doi: https:// doi.org/10.1080/09500693.2016.1253120 Laurian, S., & Fitzgerald, C. J. (2013). Effects of using rubrics in a university academic level Romanian Literature class. Procedia - Social and Behavioral Sciences, 76, 431–440. doi: https://doi.org/10.1016/j. sbspro.2013.04.141 Leedy, P. D., & Ormrod, J. E. (2019). Practical research: Planning and design (12th ed.). Pearson. Retrieved from https://www.pearson.com/us/higher-education/program/Leedy-Practical-Research-Planning-and-D esign-plus-My-Lab-Education-with-Pearson-e-Text-Access-Card-Package-12th-Edition/PGM1797597.ht ml McFarlane, D. A. (2013). Understanding the challenges of science education in the 21st Century: New opportunities for scientific literacy. International Letters of Social and Humanistic Sciences, 4, 35–44. doi: https://doi.org/10.18052/www.scipress.com/ILSHS.4.35 PISA. (2015). Draft science framework. Retrieved from https://www.oecd.org/pisa/pisaproducts/Draft PISA 2015 Science Framework.pdf Porter, J. A., Wolbach, K. C., Purzycki, C. B., Bowman, L. A., Agbada, E., & Mostrom, A. M. (2010). Integration of information and scientific literacy: Promoting literacy in undergraduates. CBE—Life Sciences Education, 9, 536–542. doi: https://doi.org/10.1187/cbe.10 Ranaweera, P. (2017). Importance of information literacy skills for an information literate society. National Institute of Library & Information Sciences, University of Colombo, 1–13. doi: https://doi.org/10.1017/CB O9781107415324.004 Rapchak, M. E., Brungard, A. B., & Bergfelt, T. W. (2016). What’ s the value of information literacy? Comparing learning community and non- learning community student learning outcomes. Learning Communities Research and Practice, 4(41). Retrieved from https://files.eric.ed.gov/fulltext/EJ111284 0.pdf Saglam, A. C., Cankaya, I., Ucer, H., & Cetin, M. (2017). The effect of information literacy on teachers’ critical thinking disposition. Journal of Education and Learning, 6(3), 31. doi: https://doi.org/10.5539/jel.v6n3p31 Saliba, R., Mussleman, P., Fernandes, M., & Bendriss, R. (2017). Promoting information literacy of pre- medical students through project-based learning: A pilot study. International Journal of Education and Literacy Studies, 5(4), 1–15. doi: https://doi.org/10.7575/aiac.ijels.v.5n.4p.1 Saptasari, M., Sunarmi, & Sulasmi, E. S. (2018). Pengaruh model pembelajaran berbasis proyek terhadap keterampilan literasi botani calon guru biologi. Jurnal Pendidikan Biologi, 9(2), 56–63. Retrieved from http://journal2.um.ac.id/index.php/jpb/article/view/4394/3251 Sinurat, Y. C., Zulharman, & Amtarina, R. (2017). Pola keterampilan literasi informasi dalam proses https://us.corwin.com/en-us/nam/assessing-21st-century-skills/book237748 https://doi.org/10.1016/j.stueduc.2017.11.005 https://www.abc-clio.com/ABC-CLIOCorporate/product.aspx?pc=A2441P https://doi.org/10.1016/j.tate.2017.07.004 https://doi.org/10.1080/00048623.2013.813372 https://doi.org/10.1002/asi https://doi.org/10.4103/2277-9531.171789 https://doi.org/10.4103/2277-9531.171789 https://doi.org/10.1080/09500693.2016.1253120 https://doi.org/10.1080/09500693.2016.1253120 https://doi.org/10.1016/j.sbspro.2013.04.141 https://doi.org/10.1016/j.sbspro.2013.04.141 from%20https:/www.pearson.com/us/higher-education/program/Leedy-Practical-Research-Planning-and-Design-plus-My-Lab-Education-with-Pearson-e-Text-Access-Card-Package-12th-Edition/PGM1797597.html from%20https:/www.pearson.com/us/higher-education/program/Leedy-Practical-Research-Planning-and-Design-plus-My-Lab-Education-with-Pearson-e-Text-Access-Card-Package-12th-Edition/PGM1797597.html from%20https:/www.pearson.com/us/higher-education/program/Leedy-Practical-Research-Planning-and-Design-plus-My-Lab-Education-with-Pearson-e-Text-Access-Card-Package-12th-Edition/PGM1797597.html https://doi.org/10.18052/www.scipress.com/ILSHS.4.35 https://www.oecd.org/pisa/pisaproducts/Draft%20PISA%202015%20Science%20Framework.pdf https://www.oecd.org/pisa/pisaproducts/Draft%20PISA%202015%20Science%20Framework.pdf https://doi.org/10.1187/cbe.10 https://doi.org/10.1017/CBO9781107415324.004 https://doi.org/10.1017/CBO9781107415324.004 https://files.eric.ed.gov/fulltext/EJ1112840.pdf https://files.eric.ed.gov/fulltext/EJ1112840.pdf https://doi.org/10.5539/jel.v6n3p31 https://doi.org/10.7575/aiac.ijels.v.5n.4p.1 http://journal2.um.ac.id/index.php/jpb/article/view/4394/3251 JPBI (Jurnal Pendidikan Biologi Indonesia) Vol. 5, No. 3, November 2019, pp. 451-458 458 Saptasari et al (Information literacy skill …) pembelajaran problem-based learning pada mahasiswa di Fakultas Kedokteran Universitas Riau. Jurnal Online Mahasiswa Fakultas Kedokteran, 4(2), 1–12. Retrieved from https://jom.unri.ac.id/index.php/J OMFDOK/article/view/15488 Soleymani, M. R. (2014). Investigating the relationship between information literacy and academic performance among students. Journal of Education and Health Promotion, 3, 95. doi: https://doi.org/10. 4103/2277-9531.139677 Stefani, L. (2009). Planning teaching and learning. A Handbook for Teaching and Learning in Higher Education. doi: https://doi.org/10.4324/9780203822524 Visande, J. C. (2014). Developing critical thinking skills among education students through formative education. International Journal for Cross-Disciplinary Subjects in Education (IJCDSE), 5(4), 1783– 1789. Retrieved from https://infonomics-society.org/wp-content/uploads/ijcdse/published-papers/volume -5-2014/Developing-Critical-Thinking-Skills-among-Education-Students-.pdf Wijaya, E. Y., Sudjimat, D. A., & Nyoto, A. (2016). Transformasi pendidikan Abad 21 sebagai tuntutan pengembangan sumber daya manusia di Era Global. In Prosiding Seminar Nasional Pendidikan Matematika 2016 (Vol. 1, pp. 263–278). Malang: Universitas Kanjuruhan Malang. Retrieved from http://repository.unikama.ac.id/840/32/263-278 TRANSFORMASI PENDIDIKAN ABAD 21 SEBAGAI TUNTUTAN PENGEMBANGAN SUMBER DAYA MANUSIA DI ERA GLOBAL.pdf Wilson, J., Roscoe, R., & Ahmed, Y. (2017). Automated formative writing assessment using a levels of language framework. Assessing Writing, 34, 16–36. doi: https://doi.org/10.1016/j.asw.2017.08.002 Wolf, K., & Stevens, E. (2007). The role of rubrics in advancing and assessing student learning. The Journal of Effective Teaching, 7(1), 3–14. Retrieved from https://files.eric.ed.gov/fulltext/EJ1055646.pdf Xiao, Y., & Yang, M. (2019). Formative assessment and self-regulated learning: How formative assessment supports students’ self-regulation in English language learning. System, 81, 39–49. doi: https://doi.org /10.1016/j.system.2019.01.004 Zainuddin, Z., Shujahat, M., Haruna, H., & Chu, S. K. W. (2020). The role of gamified e-quizzes on student learning and engagement: An interactive gamification solution for a formative assessment system. Computers and Education, 145. doi: https://doi.org/10.1016/j.compedu.2019.103729 https://jom.unri.ac.id/index.php/JOMFDOK/article/view/15488 https://jom.unri.ac.id/index.php/JOMFDOK/article/view/15488 https://doi.org/10.4103/2277-9531.139677 https://doi.org/10.4103/2277-9531.139677 https://doi.org/10.4324/9780203822524 https://infonomics-society.org/wp-content/uploads/ijcdse/published-papers/volume-5-2014/Developing-Critical-Thinking-Skills-among-Education-Students-.pdf https://infonomics-society.org/wp-content/uploads/ijcdse/published-papers/volume-5-2014/Developing-Critical-Thinking-Skills-among-Education-Students-.pdf http://repository.unikama.ac.id/840/32/263-278%20TRANSFORMASI%20PENDIDIKAN%20ABAD%2021%20SEBAGAI%20TUNTUTAN%20PENGEMBANGAN%20SUMBER%20DAYA%20MANUSIA%20DI%20ERA%20GLOBAL.pdf http://repository.unikama.ac.id/840/32/263-278%20TRANSFORMASI%20PENDIDIKAN%20ABAD%2021%20SEBAGAI%20TUNTUTAN%20PENGEMBANGAN%20SUMBER%20DAYA%20MANUSIA%20DI%20ERA%20GLOBAL.pdf https://doi.org/10.1016/j.asw.2017.08.002 https://files.eric.ed.gov/fulltext/EJ1055646.pdf https://doi.org/10.1016/j.system.2019.01.004 https://doi.org/10.1016/j.system.2019.01.004 https://doi.org/10.1016/j.compedu.2019.103729