Engineering, Technology & Applied Science Research Vol. 7, No. 4, 2017, 1870-1873 1870 www.etasr.com Yousefian et al.: Case Study of Effectiveness Evaluation of Staff Training Courses in Refah Bank Case Study of Effectiveness Evaluation of Staff Training Courses in Refah Bank Ebrahim Yousefian Department of Humanities Sciences Faculty of Public Management Khorasgan Branch, Islamic Azad University, Khorasgan, Isfahan, Iran Ali Chitsaz Department of Management University of Isfahan Isfahan, Iran Beheshteh Karimpour Department of English Teaching Khorasgan Branch, Islamic Azad University Khorasgan, Isfahan, Iran Abstract—One of the newest and most well-known train patterns for evaluating the effectiveness of in-service staffs training is Kircpatrick model. In this paper, the effectiveness of staff training courses of Refah-bank is evaluated. A questionnaire consisted of five components which include: reaction, learning, of behavior, the results and the innovation in role of confounding factors is handed out. The survey results show that three factors (reactions, behavior and innovation) have a significant effect on the teachings effectiveness according to Kircpatrick model. And that two factors (learning and results of the courses) have not a significant effect. Keywords-Kircpatrick model; Mebbliav; Training; staff I. INTRODUCTION The fundamental problem in many training programs is that imparting training to work doesn't move well. The well known Kirkpatrick Model is the worldwide standard for evaluating the effectiveness of training [1]. The variables in this study consist of five cases. Learning model components include response factor (satisfaction and organization of courses and facilities) and learning factors (learner readiness, self-efficacy and performance), behavioral factors (expectations of performance improvement and enhance one's knowledge and changes in behavior and attitudes improvement and enhance one's ability), results elements (results and efficiency training of colleagues, supervisor support, positive individual results, negative individual results, the administrator license, freedom to change and feedback) and innovation factors including (persistent, improvement in work, coordination of training methods and budget with innovation of staff). The main question in this research is that has in-service training courses held synonymous with innovation been effective based on the transition of the model? In this regard, the transition model is one of the newest and the most popular patterns in the evaluating literature of the effectiveness of staff's in-service training that can be used as a convenient and comprehensive tool to assess the effectiveness of in-service staff training. This model with four levels: 1) Reaction 2) Learning 3) behavior 4) Results 5) innovation factors examine the effectiveness of the transition of education. Eventually, the condition of persistence training staffs depends on the level of innovation. If in-service trainings are not properly, results will not be satisfactory. In [2], authors investigated the relationship between the transmitted training and performance of service organizations in case of Saipa. The results show that all the factors studied on the Halton transition model is desirable. In [3], authors investigated the transition of education in Malaysia's National Automotive Company. Results showed that Halton model in the course of transmission is desirable this has facilitated a positive transition to work and education transfer occurred. In [4], authors evaluated the transition of education in the public administration of Catalonia. Results showed that the motivational elements are the most valuable one followed by work environment factors and transfer of control. The Refah-kargaran Bank is as an old and reputable bank in Iran that intends to create major developments in staff education and improvement. The aim of the current study is to investigate the effect of in-service training on employee's performance with the interventionist role of innovation based on Kirkpatrick model. II. RESEARCH METHODOLOGY The study population included all employees of Refah Bank who have completed in-service training (165 people) and 113 are selected. A questionnaire was used as a measuring tool [4]. The first part of the questionnaire included demographic characteristics of respondents such as gender, education, and work experience and organizational position. The second part included 43 knowledge transfer questions. The learning model used includes components such as response factors (satisfaction organizing courses and facilities), learning factors (learner readiness, self-efficacy and performance), behavioral factors (expectations about behavior changes to improve the performance of one's knowledge, improve attitudes promotion and Raising ability), results (results and efficiency training of colleagues, supervisor support, positive individual results, negative Individual results, the administrator license, Freedom to change and feedback) and innovation factors (persistence, work improvement, coordination of training methods and budget) (Table I and Figure 1). The learning component has earned the most points and this means that in-service training of employees has the greatest impact on learning. Male respondents scored higher than female and they showed more confidence and more belief to Engineering, Technology & Applied Science Research Vol. 7, No. 4, 2017, 1870-1873 1871 www.etasr.com Yousefian et al.: Case Study of Effectiveness Evaluation of Staff Training Courses in Refah Bank the effectiveness of in-service training. Younger participants scored higher that the older ones. Interestingly, the innovative component allocated its maximum amount to the much younger group (under 25 years). Graduates also scored higher compared to non-graduates. In fact, bachelor respondents' have shown more confidence and more belief to the effectiveness of in-service training. In terms of innovation, diploma holders scored higher. However, Diploma holders and low literate people scored the lowest in terms of Results for-service training. Experienced respondents (over 21 years of experience) have shown more trust and belief in the effectiveness of in-service training. TABLE I. CATEGORIES OF INDICATORS ASSOCIATED WITH EACH VARIABLE FOR INVENTORY studied Variables Index number Cronbach's alpha questions Reactive agents (Satisfaction and organization of courses and facilities) 9 0.74 1-2-3-4-5-6-7-14-15 Learning factors (learner readiness, self-efficacy and performance) 8 0.55 11-12-13- 22-23-24- 25-26 Elements behavior (expectations about behavior changes to improve performance and enhance the ability of the individual) 12 0.71 8-9-10-30- 31-32-33- 34-35-36- 37-38 Results (Returns Teaching Fellow, supervisor support, positive individual results, negative personal consequences, Administrator privileges, freedom to change and feedback) 9 0.78 16-17-18- 19-20-21- 27-28-29 Innovation Factors (Survival, improvement in working and coordinating with innovative teaching methods and Budget staff) 5 0.69 39-40-41-42-43 Fig. 1. Results of elements such as innovation agents, learning agents and reactive agents III. THE RESULTS OF THE SURVEY The results show that there is a significant difference between the mean response element and the effectiveness of the training course. In other words there is a significant relationship between the independent variable (response elements) and the dependent variable (effect of the course). Also, there is a significant relationship between the variables of innovation (as a confounding variable) and the dependent variable (effect of the course). (Significant value=0.001 is less than 0.05=α). Auxiliary variables as a moderating variable affect the reactive element to the variable relationship between the variables in the efficacy period (Table II). The results also showed that there is a significant difference between the mean element of learning and the effectiveness of the training course. In other words, there is a significant relationship between the independent variable (the learning element) and the dependent variable (effect of the course). There is a significant relationship between innovation auxiliary variables (as confounding variables) and the dependent variable (the effectiveness of the training course). (Significant value=0.73 is greater than 0.05=α). Auxiliary variables as a moderating variable influenced the effectiveness of the course and relationships between learning element to the variable (Table III). Further, there is a significant difference between the behavior elements and the effectiveness of the training course. In other words there is a significant relationship between the independent variable (behavior elements) and the dependent variable (effect of the course). There is a significant relationship between the Innovation auxiliary variables (as an intervening variable) and the dependent variable (effect of the course). Auxiliary variables as a moderating variable affected the behavior element to the variable relationship (Table IV). There is also a significant difference between the elements of the results and effectiveness of the training course. In other words there is a significant relationship between the independent variable (element results) and the dependent variable (effect of the course). (Significant value=0.00 is smaller than the 0.05=α). There is a significant relationship between innovation auxiliary variables (as confounding variables) and the dependent variable (the effectiveness of training). Auxiliary variables as a moderating variable does not affect result element to effectiveness of variable the efficacy period (Table V). Table VI focuses on the innovation relationship between Refah bank's employees in Isfahan province with the effectiveness of in-service training. The results show that, since the amount is significantly less than 5 percent H0, is rejected and as a result, the correlation between claims (H1) will be accepted. Due to its meaningful value 0.03<0.05) the hypothesis is rejected. This means that there is a significant correlation between effectiveness and innovation. In fact, the innovation doesn't have linear relationship with effectiveness of educational. Engineering, Technology & Applied Science Research Vol. 7, No. 4, 2017, 1870-1873 1872 www.etasr.com Yousefian et al.: Case Study of Effectiveness Evaluation of Staff Training Courses in Refah Bank TABLE II. TEST OF EFFECT ON THE EFFECTIVENESS OF THE MEDIATION INNOVATION VARIABLE BY REACTIVE ELEMENT THE DEPENDENT VARIABLE: THE EFFECTIVENESS OF PERIOD a. R2 =. 687 (justified R2 =. 614) TABLE III. TEST THE EFFECT OF LEARNING ON THE EFFECTIVENESS OF THE MEDIATION INNOVATION VARIABLE ELEMENT THE DEPENDENT VARIABLE: THE EFFECTIVENESS OF PERIOD. Factors Sum of Squares Degrees of freedom Average of squares F Meaningful The corrected version 5.077 a 12 0.423 12.352 0.000 Intercept 17.024 1 17.024 497.063 0.000 Innovation 0.004 1 0.004 0.115 0.736 Reaction 4.654 11 0.423 12.354 0.000 Error 2.123 62 0.034 Total 1053.415 75 The corrected total 7.200 74 a. R2 =. 705 (justified R2 =. 648) TABLE IV. THE TEST OF THE BEHAVIORAL IMPACT OF ON THE EFFECTIVENESS OF THE MEDIATION INNOVATION VARIABLE THE DEPENDENT VARIABLE: THE EFFECTIVENESS OF THE PERIOD. Factors Sum of Squares Degrees of freedom Average of squares F Meaningful The corrected version 4.856 a 17 0.286 6.947 0.000 Intercept 15.562 1 15.562 378.463 0.000 Innovation 0.094 1 0.094 3.291 0.014 Reaction 4.434 16 0.277 6.739 0.000 Error 2.344 57 0.041 Total 1053.415 75 The corrected total 7.200 74 a. R2 =. 674 (justified R2 =. 577) TABLE V. TEST RESULTS ON THE EFFECTIVENESS OF THE MEDIATION INNOVATION VARIABLE ELEMENT EFFECT THE DEPENDENT VARIABLE: THE EFFECTIVENESS OF THE PERIOD Factors Sum of Squares Degrees of freedom Average of squares F Meaningful The corrected 5.991a 17 0.352 16.609 0.000 version 13.358 1 13.358 629.583 0.000 Intercept 0.005 1 0.005 0.251 0.618 Innovation 5.568 16 0.348 16.403 0.000 Error 1.209 57 0.021 Total 1053.415 75 The corrected total 7.200 74 a. R2 =. 832 (justifiedR2 =. 782) TABLE VI. CORRELATION COEFFICIENT BETWEEN INNOVATION AND EFFECTIVENESS Effectiveness Innovation Pearson Effectiveness Significantly. (2-sided) number 1 0.242* 0.036 75 75 Pearson Effectiveness Significantly .(2-sided) number 0.242* 1 0.036 75 75 A. Variable relationship between gender and questionnaire components Since a significant amount of the element behavior and efficacy is less than 5% H0 is rejected. This happens to behavior elements and component of effectiveness of training courses.it means that there is a significant relationship between gender and effectiveness and behavior. However, in reaction, learning, and result elements which are derived from the questionnaires significantly more than 5% H0 is not rejected. In fact, these elements don’t relate to gender (Table VII). TABLE VII. CORRELATION COEFFICIENT OF TRANSFER MODELS AND GENDER Reaction Behavioral Results Innovation Effectiveness Pearson gender -.050 -.250* -.223 -.217 -.257* Significantly. (2-sided) .669 .030 .054 .062 .026 number 75 75 75 75 75 B. Relationships between age and questionnaire components Since a significant amount of reactive, results and effectiveness of element is less than 5% H0 is rejected. This happens to behavior elements and component of effectiveness of training courses. It means that there is a significant correlation with age between effectiveness and behavior. In fact, these elements have a linear relationship with age. On the other hand in the behavioral elements and innovations which is derived from the questionnaires, there is significantly greater than 5% H0 and is not rejected. In fact, these elements are not correlated with age (Table VIII). TABLE VIII. CORRELATION COEFFICIENT OF TRANSMISSION MODEL AND AGE Reaction Behavioral Results Innovation Effectiveness Pearson age 0.247* 0.153 0.349** 0.020 0.299** Significantly. (2-sided) 0.033 0.191 0.002 0.862 0.009 number 75 75 75 75 75 C. The relationships between the education and the components of the questionnaire Since a significant amount of all elements of the questionnaire is more than 5% H0 it is not rejected. It happens to the entire questionnaire. This means that there is no significant correlation between the components of the questionnaire and education (Table IX). Factors Sum of Squares Degrees of freedom Average of squares F Meaningful The corrected version 4.948 a 14 0.353 9.418 0.000 Intercept 10.827 1 10.827 288.490 0.000 Innovation 0.498 1 0.498 13.268 0.001 Reaction 4.526 13 0.348 9.277 0.000 Error 2.252 60 0.038 Total 1053.415 75 The corrected total 7.200 74 Engineering, Technology & Applied Science Research Vol. 7, No. 4, 2017, 1870-1873 1873 www.etasr.com Yousefian et al.: Case Study of Effectiveness Evaluation of Staff Training Courses in Refah Bank TABLE IX. CORRELATION COEFFICIENT OF TRANSFER MODEL AND EDUCATION Reaction Behavioral results Innovation effectiveness Pearson education 0.065 0.023 0.101 0.173 0.069 Significantly. (2-sided) 0.577 0.842 0.390 0.138 0.554 number 75 75 75 75 75 D. The relationships between the work experience and the components of the questionnaire Since a significant amount of elements such reactions, results and effectiveness is less than 5% H0 is rejected and As a result, behavioral, result and effectiveness of the training components occurs. There is a relationship between effectiveness and behavior with significant work experience. On the other hand an innovative element derived from the questionnaire responses and significantly higher than the 5 percent H0 is not rejected. In fact, these elements don’t relate to work experience (Table X). TABLE X. CORRELATION COEFFICIENT OF WORK EXPERIENCE AND COMPONENTS OF THE QUESTIONNAIRE Reaction Behavioral Results Innovation Effectiveness Work exp. Pearson 0.170 0.229* 0.262* 0.067 0.299** Significantly (2-sided) 0.144 0.048 0.023 0.569 0.009 number 75 75 75 75 75 E. The relationship between inventory positions and the components of the questionnaire Since a significant amount more than 5% in all elements of the questionnaire H0 is not rejected. And there is no significant relationship among the components of the questionnaire and organizational posts (Table XI). TABLE XI. CORRELATION COEFFICIENT TRANSFER MODEL ELEMENTS AND ORGANIZATIONAL POST Reaction Behavioral Results Innovation Effectiveness Organiz. position Pearson 0.125 0.096 0.166 0.024 0.140 Significantly (2-sided) 0.284 0.414 0.155 0.835 0.230 number 75 75 75 75 75 IV. PRACTICAL SUGGESTIONS  Training experts can put the metacognitive strategies training program as a part of the Career Points those Employees using them to boost their capabilities in the study.  Creativity and innovation are the basis of planning educational services So that the understanding of employees and Director goes up in the expertise and competence of education. REFERENCES [1] http://www.kirkpatrickpartners.com/Our-Philosophy/The-Kirkpatrick- Model [2] F. Rahimian, C. Moller, “Global ERP Implementations and Harmonization of Practices in Multinational Corporations: A Conceptual Framework”, Nineteenth Americas Conference on Information Systems, Chicago, Illinois, August 15-17, 2013. [3] A. Ahmad, Effectiveness of learning transfer in national dual training system (NDTS), PhD Thesis, Universiti Tun Hussein Onn Malaysia, 2011 [4] C. Quesada-Pallares, “Training transfer evaluation in the Public Administration of Catalonia: the MEVIT factors model”, Procedia- Social and Behavioral Sciences, Vol. 46, No. 1, pp. 1751-1755, 2012 [5] R. R. Kazbour, H. M. McGee, T. Mooney, L. Masica, R. O. Brinkerhoff, “Evaluating the Impact of a Performance-Based Methodology on Transfer of Training”, Performance Improvement Quarterly, Vol. 26, No. 1, pp. 5-33, 2013