Competency-Based Assessment in Entrepreneurship Education in Kenya’s Tertiary Institutions Rose Moindi & Bernard Nyatuka Kisii University, Kenya. Abstract Education systems worldwide are shifting to knowledge-based curricula with emphasis on the learners’ acquisition of relevant competencies. Entrepreneurship education was introduced in tertiary institutions in Kenya in 1999 to produce entrepreneurs, including preparing graduates for the world of work. However, limited studies have focused on the assessment of acquisition of such competencies, especially in entrepreneurship education. This study was designed to examine the effectiveness of assessment modes used in entrepreneurship education in imparting requisite competencies among students in tertiary institutions in the country. The study adopted a cross-sectional research design. A total of 412 students selected from three tertiary institutions were involved in the study. Data were collected using questionnaires and analysed quantitatively using descriptive and inferential statistics. The study showed that written examinations were the most commonly used mode of assessment of entrepreneurship education, followed by projects and attachment. The study revealed that there is no significant difference in the influence of the mode of assessment as adopted in the different tertiary institutions in fostering the acquisition of competencies (F Ratio 0.05 suggest that MoE1, MoE2, and MoE3 (ideas and opportunities, resources, and into-action) are significant in explaining the effect of mode of assessment on the acquisition of the requisite competencies. The R2 value of 92.7% change in CMoE (mode of assessment) can be explained by changes in ideas and opportunities, resources, and into-action (MoE1, MoE2, and MoE3). This means that 92.7% of changes in the mode of assessment can be explained by MoE1, MoE2, and MoE3 (changes associated with ideas and opportunities, resources, and into-action). The regression analysis results show a very strong positive relationship (R = 0.96) between the mode of assessment and fostering entrepreneurial competencies (MoE1, MoE2, and MoE3). This indicates that an improvement in the mode of assessment will positively foster the student’s entrepreneurial competencies. Ho1. There is no significant difference in the influence of modes of assessment of entrepreneurship education in fostering students’ acquisition of the requisite competencies. Rose Moindi & Bernard Nyatuka AJOTE Vol.11 No.1 (2022), 100-120 112 To assess the first hypothesis, an ANOVA was carried out to determine the extent to which the mode of assessment fosters the acquisition of the acquired competencies. The results of this analysis are presented in Table 2. Table 2 Mode of Assessment in fostering Competency areas df SS MS F F crit Regression 3 1379.86 459.95 1622.74 0.00 Residual 378 107.14 0.28 Total 381 1487 Source: Current Study From the results in Table 2 above, (F ratio > F critical) [F 3, 378) =1622.95 > 0.00]. This shows that there is a significant difference in the extent to which mode of assessment of entrepreneurship education was effective in fostering the acquisition of the requisite competencies (ideas and opportunities, resources, and into-action competencies). This suggests that the modes of assessment adopted fostered the acquisition of competencies differently. Ho2. There is no significant difference in the modes of assessment of entrepreneurship education adopted in the different tertiary institutions in fostering students’ acquisition of the requisite competencies. To examine effectiveness of assessment modes among the three institutions, an ANOVA for the average responses was carried out. The results that were obtained from the respondents are presented in Table 3. Table 3 Effectiveness of Mode of Assessment per Institution Source of Variation SS df MS F P-value F crit Between Groups 1.244 2 0.622 0.835 0.435 3.02 Within Groups 281.439 378 0.745 Total 282.682 380 Source: Current Study From the results in Table 3, the F value is less than F critical (0.835 < 3.02) implying that there is no significant difference in the mode of assessment in the three institutions. This means that although students were exposed to different modes of examinations, CATs, assignments, attachment, and project writing, there was no significant difference in the extent Competency-Based Assessment in Entrepreneurship Education in Kenya’s Tertiary Institutions AJOTE Vol.11 No.2 (2022), 100-120 113 to which these modes of assessment adopted in the three institutions fostered the acquisition of competencies. The P-Value (0.435 > 0.05) was greater than 0.05, hence it can be concluded that the modes of assessment in the three institutions (KSU, KNP, and KTI) are not statistically significantly different at 5% significance level (P < 0.05). Therefore, despite the fact that different modes of assessment adopted in the three institutions, there was no significant difference in their influence in fostering acquisition of competencies. Discussion The modes of assessment adopted in the three institutions ranged from the use of Continuous Assessment Tests (CATs), assignments, examinations, and attachment to project writing. While CATs and assignments were adopted as formative modes of assessment in KNP and KTI, in KSU, CATs and assignments were used for both formative as well as summative assessment. This is because in KNP and KTI, assignments and CATs were used to measure how much the students had learned so that they could be assisted to improve their learning, a situation that was described as an “assessment for learning” (Bhatti, Doghan, Saat, Johari & Alshagawi, 2021; Shirandula, 2021) In KSU, the CATs and assignment marks were not only used to improve the student’s learning but were also included in the final score for grading purposes. This inferred that in KSU, formative assessment or “assessment of learning” was adopted right from the beginning of the unit. Regression analysis of the second objective showed that the modes of assessment adopted in the three institutions played a significant role in assessing entrepreneurial competencies R2=92.7% and an R-value of 0.96. This implies that 92.7% of the aspects of assessment of entrepreneurship education influence the acquisition of entrepreneurial competencies. However, analysis of the three competence areas as described in the EntreComp model (McCallum, Weicht, McMullan, & Price, 2018) showed that the modes of assessment adopted influenced the acquisition of competencies on ideas and opportunities (0.313 units) and resources (0.364units) competencies more compared to into-action competencies (0.249 units). This implies that the modes of analysis favoured assessment of recall aspects of learning which comprised of ideas and opportunities as well as resources compared to the manipulative aspects (into-action). This would affect acquisition of into-action set of competencies which is important in creating a competent entrepreneur to the job market (Boldureanu, Ionescu, Bercu, Bedrule-Grigorut,ă & Boldureanu, 2020; McCallum, Weicht, McMullan, & Price, 2018). Rose Moindi & Bernard Nyatuka AJOTE Vol.11 No.1 (2022), 100-120 114 In KNP and KTI, the final examination comprised of marks from project writing and from industrial assessment in addition to the last examination that was conducted by KNEC. Thus, while in KSU CATs and examination marks provided a final score in entrepreneurship education, sit-in examination, industrial attachment and project writing scores provided the final tally in entrepreneurship education assessment in both KTI and KNP. This difference in the modes of assessment adopted showed a significant difference in the acquisition of entrepreneurial competencies in the three institutions (ideas and opportunities, resources and into action) {(F value > F critical) (1622.74>0.00)} in these institutions. ANOVA of student responses showed that the P-Value was {(P-value > 0.05), (0.435>0.05)}. This suggests that despite the students being exposed to different examinations by KNEC and the respective universities, the extent to which these modes of assessment fostered acquisition of competencies in the three institutions were similar. This is because there was no significant difference in the extent to which the modes of assessment influenced the acquisition of competencies. This implies that there is a need to not only include more aspects of assessment, but also improve on the current modes used to enable the students view assessment as a learning process. More often than not, students consider passing examinations as the ultimate purpose of assessment (Kadir, Abidin, Junid, Kamaruddin, Lajin, Buyong, & Bakri, 2015). There was need to adopt exhibitions as a mode of assessment to enable students to showcase their unique competencies in entrepreneurship education. Limitations and Recommendations of the Study In this study, data was collected by use of questionnaires. However, whilst questionnaires are appropriate in drawing information from a large number of respondents, individualised information from the respondents cannot be obtained (Creswell, 2014). Additionally, the scope of the study was confined to students in the business and ICT departments in three tertiary institutions in a county in Kenya. Furthermore, the study was limited to the influence of the modes of assessment of entrepreneurship education in fostering acquisition of competencies in three competence areas. To foster acquisition of the requisite competencies among students, the study recommends that different appropriate modes of assessment in entrepreneurship education be used. The following recommendations for further studies are made: 1. Assess the effectiveness of the modes of assessment of entrepreneurship education adopted in fostering acquisition of competencies not covered in this study. Competency-Based Assessment in Entrepreneurship Education in Kenya’s Tertiary Institutions AJOTE Vol.11 No.2 (2022), 100-120 115 2. Assess the effectiveness of modes of assessment as adopted in other courses which were not included in this study. 3. Conduct a similar study to a broader geographical area, population as well as using a combination of instruments. Author contribution • Dr Rose Moindi was responsible for writing the literature review component of the study as well as the collection of the data from the study respondents. She was also involved in the analysis and reporting of the data. • Dr Bernard Nyatuka was responsible for ensuring that the study complied with the relevant study ethical considerations and/or policies as well as regulations. He was also responsible for ensuring the validity and reliability of the research instruments as well as data collected. Rose Moindi & Bernard Nyatuka AJOTE Vol.11 No.1 (2022), 100-120 116 References Ait Haddouchane, Z., Bakkali, S., Ajana, S., & Gassemi, K. (2017). The Application of the Competency-Based Approach to Assess the Training and Employment Adequacy Problem. International Journal of Education (IJE) Vol.5(1), DOI : 10.5121/ije.2017.5101 Bacigalupo, M. Kampylis, P. Punie, Y. & Van den Brande, L.V. (2016).EntreComp: The Entrepreneurship Competencies Framework. Luxembourg: Publication office of the European Union. doi:10.2791/593884 Barrett, M. (2006). Practical and Ethical Issues in Planning Research. In G. M.Breakwell, S. Hammond, C. F. Schaw & J. A. Smith (Eds.).Research Methods in Psychology. Los Angeles: SAGE Publications. Bhatti, M., Doghan, M. A., Saat, S. A., Johari A. S & Alshagawi, M. (2021) Entrepreneurial intentions among women: does entrepreneurial training and education matters? (Pre- and post-evaluation of psychological attributes and its effects on entrepreneurial intention. Journal of small Business and Enterprise Development: https://www.researchgate.net/publicatio/349042732 Boldureanu, G., Ionescu, A. M., Bercu, A., Bedrule-Grigorut,ă , M. V., & Boldureanu, D. (2020) Entrepreneurship Education through Successful Entrepreneurial Models in Higher Education Institutions. Sustainability 2020, 12, 1267; doi:10.3390/su12031267 Bray, M. & Kai, J. (2014). Comparing Systems. In M. Bray, B. Adamson, & M. Mason, (Eds.). Comparative Education Research: Approaches and Methods (2nd Ed, pp309-331) Comparative Education Research Centre. DOI 10.1007/978-3-319-05594-7 Calhoun, J. G., Davidson, P. L., Sinioris, M. E., Vincent, E. T. & Griffith, J. R. (2002). Towards an Understanding of Competence Identification and Assessment in health care management. Quality Management Health Care, 11(1), 14-38. Christodoulou, E., Kalokairinou, A., Koukia,E., Intas, G., Apostolara, P., Dalas, A., and Zyga, S. (2015) The Test-Retest Reliability and Pilot Testing of the “New Technology and Nursing Students’ Learning Styles” Questionnaires. International Journal of Caring Sciences, 8(3), 567-575. www.internationaljournalofcaringscienes.org Chukwurah, C. & Akpo, A. C., (2019). Influence Of Student-Teacher Relationship and Instructional Facilities on Employability Skills Acquisition among Business Education https://www.researchgate.net/publicatio/349042732 http://www.internationaljournalof/ Competency-Based Assessment in Entrepreneurship Education in Kenya’s Tertiary Institutions AJOTE Vol.11 No.2 (2022), 100-120 117 Students in Tertiary Institutions in Cross River State, Nigeria. British international Journal of Education and Social Sciences. 6 (5) Creswell, J. W. (2014). Research Design: Qualitative, Quantitative and Mixed Methods Approaches, Los Angeles: SAGE Publications Ltd. Deshpande, B & Grime, A. (2019). Sampling Technics. Advances and Applications in Mathematical Sciences, 18(10), 1058-1062. Doi.1021149323aams_vol_1810_august_2019_a7_p1055-1062 Etzkowitz, M. & Viale, R. (2010). Polyvalent Knowledge and the Entrepreneurial University: Third Academic Revolution? Critical Sociology, 36 (4), 595-609. doi.prg/10.1177/0896920510365921 European Union (EU), (2017). EntreComp: The Entrepreneurship Competence Framework. Belgium: Luxembourg. Doi: 10.2767/762330 Farstad, H. (2002). Integrated Entrepreneurship Education in Botswana, Uganda and Kenya. World Bank. Oslo, Norway: National Institute of Technology, Gibb, A. (2005). Creating Conducive Environments for learning and entrepreneurship: Leaving with, dealing with, creating and enjoying, uncertainty and complexities. Industry and Higher Education, 16(3). doi:10.5367/000000002101296234 Glenn, I. (2012). Determining Sample Size. IFAS Extension: University of Florida. Available at https://www.tarleton.edu/academicassesment/document/samplesize.pdf Retrieved on 10 December 2018 Hassanein, O. H. S., (2021), Investigating Competency‐Based Learning Implementation at the Northern Border University (NBU): A Descriptive Analytical Study. Arab World English Journal. Vol12 No2 pg 3-21 Jamli, N. F. A., & Salim, S. S. S. (2019). Development of an Instrument to Evaluate Emotional Intelligence and Leadership Style of Headmasters across Primary Schools in Malaysia. International Journal of Academic Research in Business and Social Sciences, 9(7), 988–993. DOI: 10.6007/IJARBSS/v9-i7/6197 Kaane, H. L, (2014, July 21-23rd) How to Improve, Through Skills Development and Job Creation, Access of African Youths to the World of Work. Paper Presented at the Kenya https://doi.prg/10.1177/0896920510365921 https://www.tarleton.edu/academicassesment/document/samplesize.pdf Rose Moindi & Bernard Nyatuka AJOTE Vol.11 No.1 (2022), 100-120 118 Country Report for the 2014 Ministerial Conference on youth Empowerment Abidjan Cote d’ Voire Retrieved from Error! Hyperlink reference not valid. Kesmodel, U. S. (2018). Cross-sectional studies – what are they good for? Acta Obstet Gynecol Scand, 97, 388–393; Doi: 10.1111/aogs.13331 Kenya Institute of Curriculum Development (KICD), (2016). Report on Needs Assessment for ECDE School Curriculum Reform in Kenya. Kenya, Government printer. Kenya Institute of Curriculum Development (KICD). (2017). Basic Education Curriculum Framework. Retrieved from: https://kicd.ac.ke/wp- content/uploads/2017/10/CURRICULUMFRAMEWORK.pdf Lile R & Bran C. (2014). Assessment of learning outcomes. Social and Behavioral Sciences 163 (2014 ) 125 – 131 Lokoko, A., Rankhumise, E. M., & Ras, P. (2012). The effectiveness of Entrepreneurship education: What matters most? African Journal of Business Management, 6(51), 12023- 12033. Maninder, S. S. (2016). Methodology series Module 3: Cross Sectional Studies. Indian Journal of Dermatology, 61(3), 261-264. doi. 10.4103/0019-5154.182410 Masemola, M. E. (2013). UNISA Small business development hub market scoping analysis. Pretoria, Bureau of Market Research McCallum E., Weicht R., McMullan L., & Price A. (2018). EntreComp into Action: get inspired, make it happen (M. Bacigalupo & W. O’Keeffe Eds.), EUR 29105 EN, Publications Office of the European Union, Luxembourg. ISBN 978-92-79-79360-8, doi:10.2760/574864, JRC109128. Mshenga, P. M, Okello, D. O, Ayuya, O. I, Mwangi, D & Ouma, J. J (2020). Influence of entrepreneurship education on Egerton University’s graduates’intention to start a business. Africans Crop Science Journal. Vol 28 (1) DOI: 10.4314/acsj.v28i1.22S Mwasalwiba, E. S. (2010). Entrepreneurship Education: A Review of Its Objectives, Teaching Methods and Impact Indictors. Education and Training, 52, 20-47. http://dx.doi.org/10.1108/00400911011017663 Ngigi, B.W., Gichunge, D.E.M. & Orero, D.R. (2020). Self-Actualization and Entrepreneurship Education among Undergraduate University Students in https://kicd.ac.ke/wp-content/uploads/2017/10/CURRICULUMFRAMEWORK.pdf https://kicd.ac.ke/wp-content/uploads/2017/10/CURRICULUMFRAMEWORK.pdf https://doi.org/10.4314/acsj.v28i1.22S Competency-Based Assessment in Entrepreneurship Education in Kenya’s Tertiary Institutions AJOTE Vol.11 No.2 (2022), 100-120 119 Kenya. Journal of Entrepreneurship and Project Management. 5, 1 (Mar.2020), 1–14. DOI: https://Doi.org/10.47941/jepm.387 Proitz, T.S. (2010). Learning outcomes: What are they? Who defines them? When and where are they defined? Educational Assessment, Evaluation and Accountability. 22, 119– 137 https://doi.org/10.1007/s11092-010-9097-8 Rahayu, W. P., Wijijayanti, T. & Agustina Y. (2019) The Failure of Entrepreneurship Education of Vocational High School Students and College Students: Perspective of Evaluation Instrument of Learning Results, Journal of Entrepreneurship Education, 22(1). https://www.researchgate.net/publication/331729953 Rahim, N. A., Mohamed, Z. B., Masrom M. & Amrin, A. (2018). Construct Validity in Pilot study: Application in Academic Entrepreneurship Research. Advanced Science Letters, 24(5), 3224-3228. Doi:10.1166/asl.2018.11347. Rahim,H. L., Kadir, M. A. B. A., Abidin, Z. Z., Junid, J. Kamaruddin, L. M., Lajin, N. F., Buyong , S. Z., & Bakri, A. A. (2015). Entrepreneurship Education in Malaysia: A Critical Review. Journal of Technology Management and Business, 02(02), 2015 ISSN: 2289-7224 Republic of Kenya. (1988). The Presidential Session Paper. Kamunge Report. Nairobi: Government printer. Republic of Kenya. (1999). Totally Integrated Quality Education and Training (TIQET) Report of the Commission of Inquiry into the Education system of Kenya (Koech Report). Nairobi: Government Printer. Republic of Kenya. (2005). Session Paper number 1 of 2005 on Policy Frameworks for Education, Training and Research. Ministry of Education Science and Technology Republic of Kenya. (2012a). Session Paper No. 14 of 2012 on Reforming Education and Training Sectors in Kenya. Nairobi: Government Printer. Republic of Kenya. (2012b). Universities Act Chapter 210B.Nairobi: Government Printer. Republic of Kenya. (2013). Science, Technology and Innovation Act Number 28 of 2013. Nairobi, Government Printer. https://doi.org/10.47941/jepm.387 https://doi.org/10.1007/s11092-010-9097-8 Rose Moindi & Bernard Nyatuka AJOTE Vol.11 No.1 (2022), 100-120 120 Republic of Kenya (2014). Ministry of Education, Science and Technology, State Department of Science and Technology. Technical and Vocational Education and Training (TVET) Policy. Nairobi: Government printers Republic of Kenya. (2016). Kenya National Examination Council, KNEC Act number 29 of 2012.Nairobi: Government Printer. Republic of Kenya. (2018). Kenya National Qualification Framework number22 of 2014. Nairobi: Government Printer. Republic of Kenya. (2019). Ministry of Education sessional paper No.1 of 2019 on policy framework for reforming education and training for sustainable development in Kenya. Nairobi: Government Printer. Shirandula, D. (2021). Evaluation Methods of Entrepreneurship Education and Acquisition of Entrepreneurial Skills among Hospitality Students. Journal of Technical Education and Training.V13(4) Teneva, I. (2018). Entrepreneurial Competences: Comparison of Proacademy and EntreComp. [Master’s thesis in Educational Leadership, Tampere University of Applied Sciences]. https://www.thenesus.f1/bitstream/handle/10024/158476Teneva_Irena.pdf United Nations Development Programme UNDP, (2009). Human Development Report 2009. Overcoming Barriers. Retrieved from http://hdr.ufp.org. Yusoff, M. N. H., Zainol, F. A., & Ibrahim, M. D. (2015). Entrepreneurship Education in Malaysia’s Public Institutions of Higher Learning—A Review of the Current Practices. International Education Studies, 8(1), 2015 ISSN 1913-9020 E-ISSN 1913-9039 Wang, S., Yueh, H. & Wen, (2019), How the New Type of Entrepreneurship Education Complements the Traditional One in Developing Entrepreneurial Competencies and Intention. The Psychology and Education of Entrepreneurial Development. Psychol., 13 September 2019 | https://doi.org/10.3389/fpsyg.2019.02048 Zimmerman, B. J. (2013). From Cognitive modelling to Self-regulation: Social Cognitive Career Path. Educational Psychologist, 49(3), 135-147. Doi:10.1080/00461520.2013.794676. https://www.thenesus.f1/bitstream/handle/10024/158476Teneva_Irena.pdf http://hdr.ufp.org/ https://doi.org/10.3389/fpsyg.2019.02048