REiD (Research and Evaluation in Education) ISSN 2460-6995 REiD (Research and Evaluation in Education), 3(2), 2017, 144-151 Available online at: http://journal.uny.ac.id/index.php/reid Research Article Students’ literature achievement: Predictors investigation research Alita Arifiana Anisa Graduate School of Universitas Negeri Yogyakarta Jl. Colombo No. 1, Karangmalang, Depok, Sleman, Yogyakarta 55281, Indonesia Email: alita.arifiana.anisa@gmail.com Submitted: 22 December 2017 | Revised: 06 February 2018 | Accepted: 06 February 2018 Abstract This research is an expost facto research which aims to find out the exsistence of the mean dif- ference between gender in terms of achievement, and investigate the variables predicting stu- dents’ achievement in literature study including the direct/indirect effect. This research involved 90 students established ramdomly as the sample. The research used the quantitative data analysis to analyze the mean difference between groups and the direct/indirect effect of the predictors. The result of this research shows that: (1) girls have higher achievement in literature study com- pared to boys; (2) the predictors that are statistically proven as a direct significant predictor of students’ final test score are gender, second dummy variable for class and mid-term test, while the rest of predictors (except the first dummy variable of class) contribute indirectly to the pre- diction of students’ achievement in literature study; and (3) the magnitude of the predictors might be different when they are applied in different classes. Keywords: literature achievement, path analysis, gender, attendance How to cite item: Anisa, A. (2017). Students’ literature achievement: Predictors investigation research. REiD (Research and Evaluation in Education), 3(2), 144-151. doi:http://dx.doi.org/10.21831/reid.v3i2.17498 Introduction As a requirement to attain a bachelor degree in an institution in Ponorogo, East Ja- va, Indonesia, a final research project called thesis (or skripsi in Indonesian term) has to be conducted by students. The thesis took stu- dents’ time and energy, especially in reading as well as understanding the literature needed to support their idea and findings. In order to improve the students’ skill in understanding and citating relevant literature and studies, the institution conducts a compulsory course aim- ed at assisting the students in finding, under- standing, reviewing, and citating the idea from texts. The course is called Literature Study which has to be taken by every student in the institution before they take their final research or project (thesis). In the first semester of academic year of 2016/2017, there were ten classes consisting of approximately 350 students undertaking Literature Study. During the semester, the stu- dents have to (1) attend and actively partici- pate in 16 face-to-face meetings, and (2) com- ply with all of the evaluation requirements, in- cluding oject presentation and mid-term test. The issue is that although the subject is con- sidered to be very important for the success of their final research/project, the students seemed to think that the subject was not as important as their main subjects (the subjects directly connected to their major), so their a- chievement in the course was not satisfactory. The unsatisfying final score leads to the stake- holders’ anxiety related to the quality of the students’ final research/project (thesis). The poor quality of their thesis is one of the indi- http://dx.doi.org/10.21831/reid.v3i2.17498 REiD (Research and Evaluation in Education) 145 − REiD (Research and Evaluation in Education), 3(2), 2017 cations of the poor academic ability in inte- grating all of the knowledge that the students have earned in their four-year study. Phye (1995) states that learning and achievement are surely related, but they are different in significant ways. People start to learn anything consciously or even uncon- sciously to achieve their desired objectives. For example, when you saw someone playing a doll-fishing machine and found that he nev- er missed the doll, you were excited to know how he did such a good thing and started to observe every single thing he did in order to catch the doll. The observation you did to gain any information in doing doll fishing is a learning process and to be a good doll-fisher is your objective. After gaining information, you start to test whether the information works by challenging yourself to do doll fish- ing by yourself, and the result of your doll- fishing test represents your achievement. It could be good (you were successful in catch- ing the doll by using the information you have got from the learning process, i.e, observa- tion), but it could also be not too good (you missed the doll). The achievement (either to be good or not too good) shows whether the learning process you did earlier meets your objectives. Pritchard (2009), in Ways of Learning, mentions some definitions of learning, includ- ing: (1) a change in behaviour as a result of experience or practice, (2) the acquisition of knowledge, (3) knowledge gained through stu- dy, (4) gaining knowledge of, or skill in, some- thing through study, teaching, instructions, or experience, (5) the process of gaining knowl- edge, (6) a process by which one’s behaviour is changed, shaped or controlled, and (7) the individual process of constructing under- standing based on the experience from wide range of sources. Thus, learning is a process in gaining knowledge through experiences and proven by behavioural changes. The experi- ence means any kinds of experience, including educational experience through teaching and learning processes at school. Meanwhile, achievement is what you gain from learning processes. The definition of academic achievement by the Dictionary of Education in Phye (1995) is an accomplishment or proficiency of knowledge or skill. The a- chievement shows the increase of the learn- ers’ knowledge after experiencing learning. One of the ways to see the learners’ achieve- ment is by seeing their changes. In order to know their achievement as a result of learning process, teachers need to conduct assessment. American Educational Research Association (AERA, 1999) in Reynolds, Livingston, and Willson (2009) mentions that in general, as- sessment is any systematic procedure to col- lect the information to make inferences about the characteristics of people. In educational issue, assessment can be defined as a proce- dure to gain any information about students’ learning or value judgement concerning learn- ing process through observations, ratings of performance, project or tests (Miller, Linn, & Gronlund, 2009). Figure 1. The relationship among learning, achievement, and assessment (Cumming & Maxwell, 1999) There are some procedural questions which need to be answered in conducting an assessment: First, what are the learning objec- tives/goals which need to be achieved? Learn- ing leads to the changes of knowledge. Thus, the first step that the teacher needs to do to assess students’ learning achievement is decid- ing the specific learning objectives or identi- fying what the teacher wants the students to master after the learning process. Although Mueller in Berg (2006) mentions that it is not easy for a teacher to write good learning ob- jectives, it is essential to acquire a clarity of purpose, because with clear purposes in mind, assessment can be well designed to match the purposes (Phye, 1995). Second, what kind of assessment ap- proaches matches the learning objectives? Identification to determine the type of goals needs to be held. Is it cognitive changes REiD (Research and Evaluation in Education) Students’ literature achievement... - 146 Alita Arifiana Anisa which come as the result of content acquisi- tion? Is it motor changes in performing spe- cific task? Or is it behavioural changes? The identification process is important to help teachers to choose the best assessment ap- proaches and tools to meet their teaching ob- jectives. The assessment approaches to each learning objective are as follows. (1) Cognitive objectives include the building of knowledge base (Thorndike & Thorndike-Christ, 2010). In order to meet the cognitive changes as a result of content acquisition type of learning objectives, various types of test can be con- ducted, such as multiple-choice item, match- ing, true or false, essay, short answer or filling in the blank tests (Phye, 1995). (2) Perfor- mance objectives cover the motor changes and how the learners perform their knowl- edge in the form of action/skill in doing a specific task. In order to match the perfor- mance objectives, a task that requires students to demonstrate a specific action or project is appropriate, such as playing musical instru- ment, using software to analyse data, con- structing housing model, and making financial report. (3) Affective/behaviour objectives in- volve the development of attitudes, values, interest and personal or social attributes that teachers can assess through observation (and try to infer what lies behind the behaviour), peers’ or teachers’ rates, and also students’ self-reports (Thorndike & Thorndike-Christ, 2010). Third, after the set of operations that requires students to perform their cognitive, performance, and attitude changes has been accomplished, it is important to set the rule to value students’ responses. The rule which is called scale is crucial to decide the most suit- able number that is able to represent how much the objective is existing (Thorndike & Thorndike-Christ, 2010). There are four kinds of scale which are used in measurement theo- ries, namely: nominal scale (the number on the scale does not refer to the amount of any- thing), ordinal scale (the number on the scale tells the order of specific condition without knowing how much something is less or more than something else), interval scale (each number on the scale has equal difference, zero in this scale is not an absolute zero, and ratio scale (the scale that has an absolute ze- ro). The educational objectives are mea- sured by various types of instruments (the assessment tools) that are able to cover cog- nitive, performance, and affective objectives. The instrument is assumed to have equal amount of traits in every item. The equal dif- ferences in score indicate the equal differ- ences in traits, and, thus, they fulfil the re- quirement to use interval scale. In the interval scale, the absolute zero does not exist; it is suitable to the educational issues where the students are not assumed as an empty vehicle (the base knowledge existence assumed). Af- ter setting the specific rule to value students’ responses, the next step to do is scoring. The common mechanism to do a scoring is by cal- culating the relative achievement objective. Relative mastery involves estimating the per- centage of the domain that the students have mastered. For example, when students answer eight out of ten questions correctly, it indi- cates that the students have mastered 80% of the domain (Thorndike & Thorndike-Christ, 2010). The study related to the variables which can predict the final test score is beneficial to provide the stakeholder (lecturers and aca- demic authorities) of the institution an evi- dence to formulate the decision to perform a better package of treatments to assist the stu- dents in preparing themselves to face the final research through Literature Study course. By the study, the lecturers are able to decide what to be focused in order to optimize students’ literature achievement. The main purpose of the study is to identify the variables that are able to predict students’ achievement in Lit- erature Study. The study is significant since there has never been a study related to the final test score in Literature Study in Ponorogo, al- though the literature study is considered to be beneficial to students in conducting their final research/project (as one of the requirements to graduate from the bachelor degree). This study is able to provide the lecturers and aca- demic authorities an empiric evidence to give an appropriate treatment to help the students to reach their optimum achievement. REiD (Research and Evaluation in Education) 147 − REiD (Research and Evaluation in Education), 3(2), 2017 Method Population and Sample The population of the study was all of the students who are majoring in Islamic re- ligion education. They took literature study course in the academic year of 2016/2017. The sample of the study was 90 students from three classes of X, Y, and Z who are chosen randomly. Data Variables The data which were employed in this research included: (1) gender, (2) classes, (3) attendance, (4) project presentation score, (5) mid-term test score, and (6) final-test score or achievement. Table 1 shows the description of the data. Research Procedures This research is an expost facto re- search which studies about the variables that occured in the past. The research employed the quantitative research approach in order to investigate two independent variables and also four dependent variables. The research cover- ed: (1) a descriptive analysis for analyzing the frequency of the categorical data (gender and classes) and the central tendency, variance, standard deviation, skewness and kurtosis of the continuous data (attendance, project pres- entation, midterm test, and final test); (2) mean difference to analyze the mean differ- ence between genders in achievement; (3) a path analysis to analyze the direct and indirect effect in predicting the independent variable, its equation and the final model; and also (4) a path analysis for each class. Meanwhile, the hypothesis of the research model analyzed is presented in Figure 2. X1: Gender; X2: Classdummy1; X3: Classdummy2 Y1: Attendance; Y2: Project Presentation; Y3: Mid-term Test Y4: Final Achievement Figure 2. Hypothesis research model Findings and Discussion Findings The sample consists of 90 participants, more than half (64.44%, n = 58) of the par- ticipants are girls, and 35.56% of the samples are boys (n = 32). The samples are the stu- dents who are studying literature study in three different classes, in which 27.8% (n=25) are class X students, 37.8% (n=34) are class Y students, and the rest 34.4% (n=31) are class Z students. Table 1. Data descriptions Data Description Data Type Data Source Gender 1 = Male 0 = Female Categorical Student identity document Classes 1 = X 2 = Y 3 = Z Categorical Academic document Attendance The students’ attendance in 16 meetings. Continues Teacher-attendance report Group project presentation The average score of group and individual performance The score in 1 to 100. Continues Student performance report Mid-term test score The score is 1-100. Continues Mid-term test results Final test score The score is 1-100. Continues Final test result REiD (Research and Evaluation in Education) Students’ literature achievement... - 148 Alita Arifiana Anisa Figure 3 shows the distribution of the variables which are studied in this research. All of the variables are considered to be nor- mally distributed, with the skewness of less than ±2.0, and kurtosis of less than ± 7.0. Significantly, the data indicate that the atten- dance variable is ranging from 57 to 100 (M=93.91, s= 7.523), while the project varia- ble ranges from 52 to 89 with the average score (M) of 79.74 and standard deviation (s) of 5.867. Furthermore, the data also show that the average score of the students’ mid- test score is 71.10 (which is ranging from 50 to 98, s= 11.138), and the final test score is ranging from 50 to 100 (in which M=78.17, s=12.002). Figure 3. The distribution of the attendance, project, mid-term test and final test Analysis of Mean Difference Gender to Achievement. The independent sample t-test was conducted in order to reveal whether there is a significant mean difference between boys and girls in the Literature Study course achievement. The results indicate that girls have a greater mean score in the Lit- erature Study achievement. Table 2 presents the result of the mean difference analysis. Table 2. Mean difference analysis result Variable Gender N Mean S T Sig Girls 58 73.03 11.12 Final Boys 32 72.22 10.98 -3.74 .00 Girls 58 81.45 11.34 N= 90, p <.05 Path Analysis A regression analysis was conducted in order to investigate the predictors of atten- dance, project presentation, mid-term test, and also final test (dependent variable). There were two independent variables: gender and class. Both of the independent variables were categorical data; gender consisted of two cate- gories (boys and girls), while class consists of three categories (X, Y, and Z). The predictor that consisted of three categories could not be simply categorized into 0 and 1, so that a dummy variable needed to be created. A dum- my variable is a way to represent groups of people or condition using only zero and one, and the number of dummy variables is one less than the number of the groups recoded (Field, 2013). The final model is shown in Figure 4. P= Path Coefficient X1: Gender; X2: Classdummy1; X3: Classdummy2 Y1: Attendance; Y2: Project Presentation; Y3: Mid-term Test; Y4: Final Test Figure 4. Research’s final model Pedhazur (1997) explains that in simple regression, β is equal to correlation coefficient (r). He also mentions that the path coefficient from variable 1 to variable 2 is equal to β21, which can be estimated from the data by cal- culating r12. Thus, in this research, the coeffi- cient for each path is clearly presented in Table 3. REiD (Research and Evaluation in Education) 149 − REiD (Research and Evaluation in Education), 3(2), 2017 Table 3. Path coefficients Path Coefficient (P) Unstandardized Standardized (β) A B PY1X1 95.414 -4.226 X1 -.270 X1 PY2X1 47.513 -2.430 X1 -.199 X1 PY2Y1 + .352 Y1 .452 Y1 PY3Y2 15.146 + .702 Y2 .370 Y2 PY4X1 54.627 - 7.685 X1 -.308 X1 PY4X3 -6.499 X3 -.259 X3 PY4Y3 .401 Y3 .372 Y3 Gender and Classes on Attendance. The re- sult of the multiple regressions using the step- wise method to investigate the predictors of Attendance shows that gender is the only in- dependent variable that is statistically signifi- cant in predicting the attendance. There are 7.3% attendance variances explained by gen- der. The equation used to predict students’ at- tendance is as follows: Y1 = PY1X1 Gender, Classes and Attendance on Project Presentation. Investigation was conducted using multiple regressions to find out the variables which predict project presentation. The result shows that 29% variances of project presenta- tion are accounted by gender, classes, and at- tendance. The analysis found that gender and attendance are statistically significant to pre- dict the students’ project presentation score (<.05), while classes are not significant (>.05). Unlike the previous multiple regression equation, the equation used to predict the stu- dents’ project presentation considered both direct effect (gender on project presentation) and indirect effect (gender on project presen- tation through attendance) using the path ana- lysis. In the path analysis, the sum of the di- rect effect and indirect effect is called the total effect, or effect coefficient (Pedhazur, 1997). The equation to predict the students’ project presentation is as follows: Y2 = PY2X1 + (PY1X1 * PY2Y1) Gender, Classes, Attendance, and Project Presentation on Mid-term Test. Another multiple regression analysis was conducted in order to investigate the predictors of students’ mid- term test scores. The analysis result indicated that gender, classes, attendance, and project presentation are able to explain 13.7% vari- ances of students’ mid-term test score, but only project presentation is statistically signi- ficant in predicting mid-term test (<.05). The equation which was used to predict the stu- dents’ mid-term test score has no direct ef- fect, so the equation is constructed only by considering the indirect effects of: (1) gender on mid-term test through project presenta- tion, and (2) gender on mid-term test through attendance and project presentation. The e- quation is as follows: Y3 = (PY1X1 * PY3Y2) + (PY1X1 * PY2Y1 * PY3Y2) Gender, Classes, Attendance, Project Presen- tation, Mid-term Test on Final Test. The last mul- tiple regressions conducted was to find out which independent variables (gender, classes, attendance, project presentation, and mid- term test) are able to predict students’ final test score. The result shows that there are 33.4% variances of students’ final test scores which are accounted by gender, classes, atten- dance, project presentation, and mid-term test result, but only mid-term test, gender and also classdummy2 (second dummy coding variable for classes) that are statistically proven as a significant predictors of students’ final test scores. The equation was constructed by con- sidering the direct effects (gender on final test and classdummy2 on final-test) and indirect effects (gender on final test through project presentation and mid-term test, and also gen- der on final test through attendance, project presentation and mid-term test). The equation which is used to predict students’ final test score is as follows: Y4 = PY4X1 + PY4X3 + ((PY2X1 * PY3Y2 * PY4Y3) + (PY1X1 * PY2Y1* PY3Y2 * PY4Y3)) Predicting Final Test Score in Different Class- es. Every class has its own characteristics in- fluenced by the students’ environmental and academic background. The idea of the differ- REiD (Research and Evaluation in Education) Students’ literature achievement... - 150 Alita Arifiana Anisa ent characteristics of class leads to a further analysis to compare the contribution of each predictor in different classes. Table 4 shows the result of the multiple regressions using the enter method in each class. Table 4. Comparing the effects of gender, attendance, project, mid-term test on final test in different classes Predictors Final Test X Y Z Gender -.502* -.171 -.275 Attendance .067* .228 -.388 Project Presentation -.122 .102 .386 Mid-term test .399* .348 .317 R2 .495 .434 .337 E .505 .566 .663 N 25 34 31 P<.05 The result shows that in Class 1 (X), the biggest predictor is gender and the lowest one is attendance. In class Y, the biggest predictor of the students’ final test is mid-term test score, and the lowest predictor is project pres- entation. In class Z, the biggest predictor of students’ final test is attendance, while the lowest one is gender. The result proves that the predictors might predict the independent variable in different magnitude based on the class characteristics. Due to the different mag- nitude of the predictors, it is recommended that lecturers treat the classes differently. Discussion The research findings show that girls have a significantly greater mean score than boys in terms of Literature Study achieve- ment. In line with the mean difference ana- lysis result, the final model of this study also shows the contribution of gender to students’ final achievement. Two previous researchers, Downing (1977) and Droege (1967), mention that girls have greater facility in early reading skill. The evidence of girls’ reading ability is also revealed by Finucci, Gottfredson, and Childs (1985). Based on the reserach, women become better oral readers, buy more books, and read more pleasure than men. Beside the direct contribution to stu- dents’ achievement, gender is also found to be the predictor of students’ attendance rate and project persentation performance. Based on the lecturer reports, girls tend to attend the class more often than boys, and girls are more serious in doing their project persentation homework. In line with this, the research of Duckworth and Seligman (2005, p. 939) also explains that girls are more self-disciplined than boys in final grades, school attendance, and hours-spending homeworks. Unlike gender, the first dummy variable (X=0, Y=1, and Z=0) has no significant ef- fect on any independent variables. The se- cond dummy variable (X=0, Y=0, and Z=1) has a direct negative significant effect on stu- dents’ achievement. It means that class Z has significantly lower achievement compared to the other classess (X and Y). Based on the predictor analysis conducted for each class, the low achievement of class Z was due to the low score of students’ attendance. Students’ attendance, which is influ- enced by gender, is statistically proven as the predictor of the students’ project presentation performance. Attendance is also found to be the indirect predictor of final achievement through the project presentation and mid- term test score. The previous research also found a similiar phenomenon. The research of Deane and Murphy (2013) found that the students’ attendance is positively correlated with overall examination score. In addition, Louis, Bastian, McKimmie, and Lee (2016) also found the positive correlation between attendance and objective performance. Conclusion and Suggestions Conclusion Based on the findings, conclusions can be drawn as follows: (1) girls have higher a- chievement in Literarture Study compared to boys; (2) the predictors which are statistically proven as direct significant predictors of stu- dents’ final test score are gender, second dum- my variable for class, and mid-term test, while the rest of the predictors (except for the first dummy variable of class) contribute indirectly to predicting students’ achievement in Lit- erature Study; (3) the magnitude of the pre- dictors might be different in different classes. REiD (Research and Evaluation in Education) 151 − REiD (Research and Evaluation in Education), 3(2), 2017 Limitation of the Research The limitation of the research is that: (1) the research was conducted in an Islamic Institution, in which the references studied in the Literature Study course are those related to the Islamic religion education, prophetic character, and intellectual character; (2) every institution has their own policy related to what kind of academic activities that the stu- dents have to pass through during Literature Study course in one semester. Suggestions To achieve optimum final test score in Literature Study, the lecturers are suggested to: (1) consider gender, class, attendance, pro- ject presentation score, and mid-term test score to improve students’ final test score; (2) be concerned with the mid-term test results, because only mid-term test has a direct effect on the final test score; and (3) treat each class differently based on their own characteristics. References Berg, S. L. (2006). Two sides of the same coin: Authentic assessment. Community College Enterprise, 12(2), 7–21. Retrieved from https://www.questia.com/read/1 P3-1167542141/two-sides-of-the-same- coin-authentic-assessment Cumming, J. J., & Maxwell, G. S. (1999). Contextualising authentic assessment. Assessment in Education: Principles, Policy & Practice, 6(2), 177–194. https://doi. org/10.1080/09695949992865 Deane, R. P., & Murphy, D. J. (2013). Student attendance and academic performance in undergraduate obstetrics/gynecology clinical rotations. JAMA, 310(21), 2282–2288. https://doi.org/10.1001/ jama.2013.282228 Downing, J. (1977). How society creates reading disability. The Elementary School Journal, 77(4), 274–279. https://doi.org /10.1086/461058 Droege, R. C. (1967). Sex differences in aptitude maturation during high school. Journal of Counseling Psychology, 14(5), 407–411. Duckworth, A. L., & Seligman, M. E. P. (2005). Self-discipline outdoes IQ in predicting academic performance of adolescents. Psychological Science, 16(12), 939–944. https://doi.org/10.1111/j.14 67-9280.2005.01641.x Field, A. P. (2013). Discovering statistics using IBM SPSS statistics (4th ed.). Los Angeles, CA: Sage Publication. Finucci, J. M., Gottfredson, L. S., & Childs, B. (1985). A follow-up study of dyslexic boys. Annals of Dyslexia, 35(1), 117–136. https://doi.org/10.1007/BF02659183 Louis, W. R., Bastian, B., McKimmie, B., & Lee, A. J. (2016). Teaching psychology in Australia: Does class attendance matter for performance? Australian Journal of Psychology, 68(1), 47–51. https://doi.org/10.1111/ajpy.12088 Miller, M. D., Linn, R. L., & Gronlund, N. E. (2009). Measurement and assessment in teaching (10th ed.). Upper Saddle River, NJ: Pearson. Pedhazur, E. J. (1997). Multiple regression in behavioral research: Explanation and prediction (3rd ed.). Orlando, FL: Harcourt Brace College. Phye, G. D. (Ed.). (1995). Handbook of classroom assessment: Learning, achievement, and adjustment. Ames, IA: Academic Press. Pritchard, A. (2009). Ways of learning: Learning theories and learning styles in the classroom (2nd ed.). Oxford: Routledge. Reynolds, C. R., Livingston, R. B., & Willson, V. L. (2009). Measurement and assessment in education (2nd ed.). Upper Saddle River, NJ: Pearson. Thorndike, R. M., & Thorndike-Christ, T. M. (2010). Measurement and evaluation in psychology and education (8th ed.). Boston, MA: Pearson Education.