Jo-ELT (Journal of English Language Teaching) Fakultas Keguruan dan Ilmu Pendidikan Program Studi Pendidikan Bahasa Inggris IKIP https://e-journal.undikma.ac.id/index.php/joelt Email: joelt@ikipmataram.ac.id June 2021, Vol.8 No.1 online: 2548-5865 print: 2355-0309 pp.74-82 doi:10.33394/jo-elt.v8i1.3788 Jo-ELT (Journal of English Language Teaching) Fakultas Pendidikan Bahasa dan Seni Program Studi Pendidikan Bahasa Inggris IKIP, June 2021. Vol.8 No.1 | Page 74 THE USE OF CLOZE TEST TO TEST READING COMPREHENSION OF NON-ENGLISH DEPARTMENT STUDENTS Sri Sukarni English Lecturer, FBMB, Universitas Pendidikan Mandalika, Indonesia Corresponding Author Email: srisukarni@undikma.ac.id A B S T R A C T S A R T I C L E I N F O This research aimed to describe the result of the non-English department students’ reading comprehension tested by using cloze test and the effect of using cloze test on non-English department students’ achievement on reading comprehension. This research is classified into pre-experimental research that used one group pre-test and post-test design. The population of this research is the non-English department students in the academic Year 2020/2021 with a total number of 107 students. The researcher used non-probability sampling type purposive sampling technique and there were 44 students taken as samples. The test is the instrument in this research. Data are taken from the result of pre-test and post-test then analyzed by using statistical technique. The analysis is used to find the significant difference in the students’ reading comprehension ability before and after the use of cloze test. In this research, the researcher used paired sample t-test through SPSS 17.0 to analyze the data. Based on data analysis, the mean score of the pre-test was 46.86 categorized as poor whereas the mean score of the post-test was 65.61 categorized as average to good. The mean score of the pre-test 46.86 smaller than 65.61 mean scores of the post-test. It meant that there was a difference mean score of students’ reading comprehension between the pre-test and post-test. This finding showed there was a different score before and after giving treatment. The result of paired samples t-test analysis showed the significance value Sig. (2-tailed) < alpha (0.000 < 0.05). Therefore, the alternative hypotheses which stated that there is an effect of using cloze test on improving non-English department students’ reading comprehension is accepted. It is concluded that there was an effect of cloze test on improving non-English department students’ reading comprehension. Article History: Received: May, 2021 Revised: May, 2021 Published: June, 2021 Keywords: Cloze test, Reading Comprehension, How to cite: Sukarni, S. (2021). The Use of Cloze Test To Test Reading Comprehension of Non-English Department Students. Jo-ELT (Journal of English Language Teaching) Fakultas Pendidikan Bahasa & Seni Prodi Pendidikan Bahasa Inggris IKIP, 8(1), 74-82. doi:https://doi.org/10.33394/jo-elt.v8i1.3788 INTRODUCTION In line with the status of the English language in Indonesia as the first foreign language, reading gets more proportion in the teaching and learning process. In the context of the goal of teaching English at a tertiary level of education especially for non-English department students is to improve their ability to use English for academic and professional purposes, especially for reading textbooks in their academic work. This implies that in the English language instruction, reading skill has been given the greatest prominence for helping students to learn effectively in their field of study. Eskey (2005) pointed out, many students of English as a foreign language (EFL), rarely speak English in their everyday life but may mailto:srisukarni@undikma.ac.id Sukarni The Use of Cloze ……… Jo-ELT (Journal of English Language Teaching) Fakultas Pendidikan Bahasa dan Seni Program Studi Pendidikan Bahasa Inggris IKIP, June 2021. Vol.8 No.1 | Page 75 need to read in order to access information recorded exclusively in the language. Therefore, assessment towards students’ reading comprehension ability aims to monitor students’ difficulties, students’ achievement, and students’ proficiency on English reading texts. However, there are some problems that English teachers find in testing reading comprehension. One of the problems is how to select a suitable testing technique according to skill and aspect of language to be measured. The testing technique will be used by the teachers should eliminate the opportunity of students to chat, guess, or predict the answers to questions. Based on the problems, it can be inferred that it is important to prepare a kind of tool for measuring students’ mastery on reading comprehension and understanding the purpose of reading comprehension. It also implies that when English teachers design a test for reading comprehension, they have to decide what they want to test and find a means of testing it. According to RAND Reading Study Group (2002), defined comprehension is the process of eliciting and making through interaction and involvement with written language. McNamara and Magliano (2009) emphasized that this process is a task of both reader and text factors that happen within a larger social context. Duke (2003) stated that comprehension is a process in which readers make meaning by interacting with the text through the combination of prior knowledge and previous experience, information in the text, and the views of readers related to the text. Kintsch (1988) stated that reading comprehension is defined as the process of creating meaning from text. The purpose is to get an understanding of the text rather than to acquire meaning from individual words or sentences. The outcome of reading comprehension is the mental representation of a text meaning that is combined with the reader’s previous knowledge. According to Olson and Diller (1982), what is meant by reading comprehension is a term used to identify skills needed to understand and apply information contained in written material. In this case, the students should be able to gain the information from reading text. Related to reading comprehension, Richard and Schmidt (2002) stated that reading is an activity of perceiving a written text in order to understand its contents. This can be done silently (silent reading). The understanding of the contents of reading is called reading comprehension. Based on the definitions it can be inferred that reading comprehension is a process of constructing meaning from a written text that involves the interaction of the reader's prior knowledge with the new given information. Some of the testing techniques that can assess reading skill according to Brown (2004) are written answer, short answer, summary, ordering the test, multiple-choice items, matching, gap-filling test, cloze test, and C test. Concerning the cloze test, Harmer (2002) stated that cloze, in its purest form, is the deletion of every n-th word in a text (somewhere between every fifth and tenth word). Brown (2000) said that close procedure is one of the tests that can help the teachers to teach reading comprehension. Through the test, the students are able to know the information in a text. Heaton (1998) said the most common purpose of the cloze test is to measure reading comprehension. He said so because it has long been argued that cloze measures textual knowledge: i.e an awareness of cohesion in a text, involving the interdependence of phrase, sentence, and paragraph within cloze test. He also stated that cloze test can be applied to the testing of reading comprehension at both levels elementary and more advanced levels. Moreover, cloze test is intended to such a degree to demonstrate if the testee is acquainted with the language and context of the text in a way that maintains the intended meaning of the author (Oller & Jonz, 1994). Likewise, cloze test assesses the testee’s ability to benefit from the text contextual clues to obtain meaning. Many researchers have conducted some researches about cloze test and its implication toward reading comprehension. Ema (2019) designed a test for reading comprehension. The result of her research showed that students got cloze test score higher than multiple-choice Sukarni The Use of Cloze ……… Jo-ELT (Journal of English Language Teaching) Fakultas Pendidikan Bahasa dan Seni Program Studi Pendidikan Bahasa Inggris IKIP, June 2021. Vol.8 No.1 | Page 76 score because most of them said that multiple-choice test is difficult than cloze test. Febriyanti (2017) did research and she found that there was a correlation between reading comprehension and students’ ability in answering cloze test. Wahdaniah, et all (2013) proved that students’ performances in reading comprehension is average to good, or in other words, the use of cloze test significantly improved reading comprehension. John Oller (2006) believed that the sort of competence related to second language proficiency measured by cloze test. Lu (2006) stated that cloze test used by teachers and for tests can be improved to facilitate students’ reading competence. In this research, the researcher wants to describe the result of the non-English department students’ reading comprehension tested by using cloze test and the effect of using cloze test on non-English department students’ achievement on reading comprehension. RESEARCH METHOD Research Design This research is classified into pre-experimental research that used one group pre-test and post-test design. One group pre-test and post-test design is a single group measured not only after being exposed to a treatment of some sort but also before a treatment. A pre-test provides a measure on some attribute or characteristic that is assessed in an experiment before a group gets a treatment, while a post-test measure on some characteristics that is assessed for participants in an experiment after a treatment. Creswell (2014) stated that an experimental design is used in which attitudes are assessed both before and after experimental treatment. The procedures of pre-experimental research that use one group pre-test and post-test design in this research can be described: 1) administering pre-test which purpose to measure non-English department students’ reading comprehension ability before applying treatment; 2) applying experimental treatment reading comprehension by using cloze test; 3) administering post-test which purpose of measuring non-English department students reading comprehension ability after applying treatment. Based on the purpose of this research, the effect of cloze test was known after finding out the significant difference between students’ achievement before using cloze test and those students who are tested after using cloze test by comparing pre-test and post-test score. Population and Sample This research is conducted at the non-English department of Mandalika University of Education. The population of this research is the non-English department students in the academic Year 2020/2021 with a total number of 107 students, the researcher took a portion of the population which is known as a sample. The researcher used a non-probability sampling type purposive sampling technique. As the process of sampling, the researcher finally chose some students in every non-English department by considering the factor that in the experimental stage, the samples have the average ability in English especially reading comprehension. In other words, the researcher took the typical sample. It was intended to reduce the extraneous variable that may appear since the design is pre-experimental research without using a control group. Determination of the number of samples in this research is based on Issac and Michel (1981) formula. The formula in figure 1. Sukarni The Use of Cloze ……… Jo-ELT (Journal of English Language Teaching) Fakultas Pendidikan Bahasa dan Seni Program Studi Pendidikan Bahasa Inggris IKIP, June 2021. Vol.8 No.1 | Page 77 Figure 1. The Formula of Determination of the Number of Samples Note: n = sample size N= population Z= significant level S= samples variation d= deviation degree Based on the calculation result of the formula, the researcher took 44 non-English department students as samples in this research. Instruments The research instrument was a test of testing techniques for reading comprehension. In collecting data, measurement is administered twice. First, the pre-test was intended to measure the students’ ability before giving treatment. Second, the post-test was intended to measure students’ ability after giving treatment. The aim of administering the pre-test is to get initial information on the groups before the experiment is conducted. The purpose of administering the post-test was to observe and to measure any changes in students’ reading comprehension ability after being tested by cloze test. In administering the pre-test the researcher took multiple-choice reading passages while for the post-test cloze test reading comprehension passages are applied. Those reading comprehension passages are taken from general English teaching material for non-English department students. Data Analysis In analyzing data collected, the researcher used quantitative data analysis so that the data were analyzed by using statistical techniques. The analysis is used to find the significant difference in the students’ reading comprehension ability before and after the use of cloze test. In this research, the researcher used paired sample t-test by SPSS 17.0 to analyze the data. RESEARCH FINDINGS AND DISCUSSION Research Findings This section described the result of students’ reading comprehension before and after giving a treatment by testing them using cloze test. Data analysis was done to know the different scores before doing the test and after doing the test. The researcher used a statistical test using Paired Samples t-test analyzed by SPSS 17.0 to ensure the effect of cloze test in testing students’ reading comprehension. The analysis result of students’ ability on reading comprehension before and after giving a treatment by cloze test can be seen in table 1. N Z 2 S 2 n= N d 2 +Z 2 S 2 Sukarni The Use of Cloze ……… Jo-ELT (Journal of English Language Teaching) Fakultas Pendidikan Bahasa dan Seni Program Studi Pendidikan Bahasa Inggris IKIP, June 2021. Vol.8 No.1 | Page 78 Table 1 Frequency Statistic PRE-TEST POST-TEST N Valid 44 44 Missing 0 0 Mean 46.89 65.61 Median 47.00 67.00 Mode 47 75 Std. Deviation 6.277 10.861 Based on table 1 showed that the number of samples in each group was 44 students. The mean score of the pre-test was 46.89 and the mean score of the post-test was 65.61. The median score for the pre-test was 47.00 and the median score for the post-test was 67.00. Mode score or value which has the highest frequency in the pre-test was 47 however mode score in the post-test was 75. The standard deviation of the pre-test was 6.277 while the standard deviation of the post-test was 10.861. Table 2 is the table of achievement levels by David P Harris (1979). Table 2 The Achievement Level Test Scores Classification 80-100 Good to Excellent 60- 79 Average to Good 50- 59 Poor to Average 0- 49 Poor Both of the mean scores are then classified into the achievement level classification so that students’ score on pre-test is classified as poor however students’ score on post-test is classified average to good. Table 3 Frequency of Pre-test Frequency Percent Valid Percent Cumulative Percent Valid 35 1 2.3 2.3 2.3 37 4 9.1 9.1 11.4 40 2 4.5 4.5 15.9 42 6 13.6 13.6 29.5 45 7 15.9 15.9 45.5 47 8 18.2 18.2 63.6 50 5 11.4 11.4 75.0 52 4 9.1 9.1 84.1 55 3 6.8 6.8 90.9 57 2 4.5 4.5 95.5 60 2 4.5 4.5 100.0 Total 44 100.0 100.0 Sukarni The Use of Cloze ……… Jo-ELT (Journal of English Language Teaching) Fakultas Pendidikan Bahasa dan Seni Program Studi Pendidikan Bahasa Inggris IKIP, June 2021. Vol.8 No.1 | Page 79 In table 3 showed that the lowest score in the pre-test was 35 and there was one student who got the score (2.3%), however, the highest score in the pre-test was 60 and there were two students who got the score (4.5%). Table 4 Frequency of Post-test Frequency Percent Valid Percent Cumulative Percent Valid 40 1 2.3 2.3 2.3 45 2 4.5 4.5 6.8 47 2 4.5 4.5 11.4 55 7 15.9 15.9 27.3 60 3 6.8 6.8 34.1 62 1 2.3 2.3 36.4 65 3 6.8 6.8 43.2 67 4 9.1 9.1 52.3 70 2 4.5 4.5 56.8 72 4 9.1 9.1 65.9 75 8 18.2 18.2 84.1 77 5 11.4 11.4 95.5 80 2 4.5 4.5 100.0 Total 44 100.0 100.0 In table 4 showed that the lowest score in the post-test was 40 and there was one student who got the score (2.3%), however, the highest score in the post-test was 80 and there were two students who got the score (4.5%). Table 5 Paired Samples Statistics Mean N Std. Deviation Std. Error Mean Pair 1 Pre-test 46.89 44 6.277 .946 Post-test 65.61 44 10.861 1.637 Based on the summary of the result of descriptive statistics in table 5 from both samples pre-test and post-test showed that the mean score of the pre-test was 46.89 while the mean score of the post-test was 65.61. The number of samples in the research was 44 non-English department. The standard deviation score of the pre-test was 6.277 and the standard deviation score of the post-test was 10.861. students. The standard error of the mean score of the pre- test was 0.946 and the standard error mean score of the post-test was 1.637. The mean score of pre-test 46.86 smaller than 65.61 mean score of post-test, meant that there was a difference mean score of students’ reading comprehension between pre-test and post-test. Table 6 Paired Samples Correlations N Correlation Sig. Pair 1 Pre-test & Post-test 44 .635 .000 Based on the analysis result on Paired Sample Correlation in table 6, showed correlation coefficient value was 0.635 with a significant value in the amount of 0.000. Therefore, value of Sig.