International Journal of Interactive Mobile Technologies (iJIM) – eISSN: 1865-7923 – Vol. 14, No. 14, 2020 Paper—Putting ePortfolios into Practice: Willingness of School Principals to Use the ePortfolio as… Putting ePortfolios into Practice Willingness of School Principals to Use the ePortfolio as a Hiring Tool in Poland and Spain https://doi.org/10.3991/ijim.v14i14.15075 Monika Ciesielkiewicz (*) Villanueva-Complutense University of Madrid, Spain mciesielkiewicz@villanueva.edu Claire Frances Bonilla Madrid Open University (UDIMA), Madrid, Spain Carlos Olave López de Ayala Global HR at LG Electronics, Seoul, South Korea Abstract—The ePortfolio has been used extensively in education in various countries and for diverse career paths. It is a dynamic platform that students can use to compile and formulate a digital presentation using different types of media which can be updated and adapted for distinct purposes and audiences. Because the ePortfolio is, by nature, flexible and adaptable, it can be developed over the course of a student’s studies and be easily incorporated into professional networking platforms as a job search tool. The objective of this study was to assess and compare the willingness of school principals from Poland and Spain to use the ePortfolio as a hiring tool. The authors also sought to ascertain whether the number of employees in the participants’ schools or previous contact with ePortfolio affected their opinion of it as a hiring tool. Participants took a survey after reviewing examples of career ePortfolios, and their answers were tabulated and analyzed. The results show that principals from both countries would be inclined to use the ePortfolio as a hiring tool, and that neither previous contact nor number of employees significantly affected their opinion. These results are significant as they demonstrate a broad willingness to implement the ePortfolio as a hiring tool, that was not significantly affected by country or size of school. It is also relevant that this broad support was shared by principals who were unfamiliar with the ePortfolio before participating in this study. Keywords—ePortfolio, hiring tool, employability, educational technology. iJIM ‒ Vol. 14, No. 14, 2020 109 Paper—Putting ePortfolios into Practice 1 Introduction The ePortfolio has been used extensively in higher education in diverse countries [1][2] and is widespread in many disciplines, such as pre-service teacher education [3- 6], musical education [7], fine arts [8], vocational higher education training [9], occupational therapy [10], nursing [11], social work [12], accounting [13] and business studies [2][14]. As stated in Ref. [2], the ePortfolio is defined as “an electronic collection of meaningful artefacts which provides evidence of learning, competencies and employability” (p. 16). The ePortfolios was also credited with promoting students’ learning and helping them to become self-reflective critical thinkers and lifelong learners [2]. As confirmed in Ref. [15], the ePortfolio assists students in developing crucial cognitive skills, as well as a disciplined mind. Additionally, graduate students who used ePortfolio in their capstone courses developed critical thinking, self-directed learning and leadership skills [16]. The participants of this study also acknowledged that the ePortfolio “provided lenses through which to reflect on their own professional development and accomplishments in new ways” (Ref. [16], p. 69). Furthermore, a study on ePortfolio use among students who took business communication courses, revealed that the ePortfolio fosters self-awareness and active learning, as well as professional identity [17]. Moreover, several researchers identified skills and competences that can be developed through ePortfolios such as goal setting, collaborative learning, autonomous learning, self-assessment skills, reflective skills, digital literacy, digital identity, work readiness, professional identity, self- management, and lifelong learning [18-24]. Other potential benefits of the ePortfolios for students are: “enhanced learning experiences and outcomes; enhanced employability; enhanced career development; enhanced professional identity and judgement making” (Ref. [2], p. 24). 1.1 Research questions The purpose of this paper is to examine whether school principals in Poland and Spain would use an ePortfolio for recruitment purposes. The following research questions were explored: RQ1. Would school principals use an ePortfolio to select candidates for a job at some stage of the recruitment process? RQ2. Would school principals make the effort to review only the ePortfolio of the best candidate for a job? RQ3. Would school principals make the effort to review the ePortfolio of the three best candidates for a job? RQ4. Would school principals make an effort to review the ePortfolios of all candidates to select the best one for a job? RQ5. Do school principals consider the ePortfolios a useful tool to obtain wider and more detailed information on candidates who apply for a job? 110 http://www.i-jim.org Paper—Putting ePortfolios into Practice 1.2 The ePortfolio as a hiring tool Even though there is not a long history of the ePortfolio being used as a hiring tool [25], there have been a number of interesting studies that point to a promising future in this domain. There is evidence that students getting ready to enter the workforce benefit from the process of making their career ePortfolio. The reflection necessary to develop an ePortfolio can help students make better educational and career-related decisions [24]. Likewise, by organizing their skills and achievements into an ePortfolio the students not only have digital artefacts of their learning, but also formulate how to explain or present their qualifications to a prospective employer [26]. Additionally, students that used an ePortfolio performed better in mock interviews because they could effectively communicate their achievements [27]. Interest in the ePortfolio from the business world is growing [28][14]. In research performed for the American Association of Colleges and Universities (AAC&U) more than 80% of the employers interviewed considered the ePortfolio a useful hiring tool [29]. Subsequent to the publication of the aforementioned AAC&U study, Human Resources recruiters from large employers were recruited for a focus group, in which it was discovered that 72% of these recruiters considered the ePortfolio to be a valuable hiring tool [30]. Employers can use the ePortfolio in multiple ways. As research in Ref. [31] shows, employers were found to be far more likely to use the ePortfolio for initial screening of potential new hires, than for post interview in-depth analysis. Still other research shows that the ePortfolio could offer insights into candidates’ creativity and personality, as well as to whether or not the candidate would be able to form part of a team [32]. Ninety percent of professional recruiters interviewed in one study indicated that they would view an ePortfolio if a link were sent in a followup email [30]. These recruiters considered ePortfolio te be a valuable recruiting tool, however, they also stated that it was secondary to excellent interview skills [30]. Furthermore, the some recruiters pinpoint the following advantages of ePortfolios over traditional recruitment methods: “personalised body of learning evidence; examples of skills; learning style and preferences; the lens through which they view the world/life; communication tool; ‘richer’ format of evidence; helps make connections; a greater sense of softer skills” ([14], p. 28). Additionally, ePortfolios offer more personalization and a more complete view of a job applicant than a traditional resumé [17]. On the other hand, time constraint is reported as one of the major complaints about the use of ePortfoilio as a recruiting tool [14][31][33][34]. It has been suggested that Learning Analytics could be used to mitigate the time investment that is considered by some to be prohibitive, thereby unlocking the ePortfolio‘s full potential [35]. Lanalytics could be used to analyze and assess artefacts included in an ePortfolio, which could generate feedback regarding acquisition of key competences [1]. The implications of this type of analysis is that it would allow an automated scan of artefacts created by the student or job candidate, in order to determine if there is evidence of concrete competences. As such, this could, in part, resolve the argument that reviewing ePortfolios for job candidates is a time consuming process. It must be iJIM ‒ Vol. 14, No. 14, 2020 111 Paper—Putting ePortfolios into Practice noted that this type of assessment for decision making could give rise to ethical concerns [36]. Though there is no consensus as to what stage of the recruitment process employers would consult candidates’ ePortfolios, there is consistent interest in this tool for hiring purposes. As has been observed, the ePortfolio generates a substantial and steady interest among employers and seems set for a promising future [28][37]. 2 Methodology 2.1 Participants The participants were 56 school principals from Spain (n = 23) and Poland (n = 33). They anonymously participated in this study during 2016 (Spanish group) and 2017 (Polish group). The participants were principals of private schools that belong to a Spanish educational organization founded in 1963 and operate primary and secondary schools in Spain and in various countries around the world. This organization began opening schools in Poland relatively recently. 2.2 Instrument and procedures At the beginning of the survey, participants were given links to four different career ePortfolios. All four ePortfolios were from the United States where 54% of students used some sort of ePortfolio [38]. Two of the ePortfolios belonged to recent graduates, who were starting their professional careers and the other two ePortfolios belonged to established professionals. Once having viewed these career ePortfolios, the participants responded to a seven-item survey that gathered information about the number of employees at their school, whether they had had previous contact with ePortfolio, their willingness to use an ePortfolio as part of their recruitment process for new hires and their opinion about the usefulness of the ePortfolio as a hiring tool. This last section was comprised of five closed-ended questions that asked participants to gauge their agreement with a statement on a seven-point Likert-type scale, ranging from strongly disagree (1) to strongly agree (7). These items were chosen and adapted from surveys that had been validated in previous research [29][39]. 3 Results The school principals were asked to indicate how many employees were in their respective schools. The answers ranged from five to 250 employees. To facilitate statistical analysis, responses were grouped in increments of 25, ranging from 1-25 to 226-250. Figure 1 shows the responses grouped by country. It is interesting to note that 57.6% of the Polish principals represented schools with 25 employees or less, 112 http://www.i-jim.org Paper—Putting ePortfolios into Practice which may be due to the fact that the aforementioned educational organization had just recently begun operating in Poland. See Figure 1. Fig. 1. Number of employees in schools of participants The next question asked the participants if they had ever seen an ePortfolio before participating in the survey. The majority of respondents had not had previous contact with the ePortfolio, though the Polish educators (67%) were somewhat less familiar with the ePortfolio than their Spanish counterparts (57%). Figure 2 displays the breakdown of the responses. Fig. 2. Previous contact with ePortfolio iJIM ‒ Vol. 14, No. 14, 2020 113 Paper—Putting ePortfolios into Practice The next item asked respondents about their willingness to use an ePortfolio to select a successful job candidate. Eighty-six percent of all respondents agreed to some degree (including those who somewhat and strongly agreed) that they would use an ePortfolio to choose a job candidate. There were no statistically significant differences between responses based on either country or previous contact with the ePortfolio. The following item asked if the school principals would be willing to make the effort to review the ePortfolios of all the candidates. It is interesting to note that 35% of the Spanish principals disagreed to some extent with reviewing all of the candidates’ portfolios, while only 18% of the Polish directors expressed the same lack of agreement. These responses were not significantly influenced by previous contact (or lack thereof) with ePortfolio. See Figure 3. Fig. 3. Willingness to review the ePortfolios of all candidates Though reviewing ePortfolios of job candidates is considered by some to be time consuming [14][31][33][34], our data revealed that the directors of the two schools with the most employees (one from Spain and the other from Poland) either strongly agreed or somewhat agreed with reviewing the ePortfolios of all candidates. Next the respondents were asked to rate their agreement with reviewing the ePortfolios of only the top three candidates. As can be seen in Figure 4, the responses are heavily skewed to the right, showing a very clear willingness to review the ePortfolio of the three best candidates for a position. 114 http://www.i-jim.org Paper—Putting ePortfolios into Practice Fig. 4. Willingness to review ePortfolios of the three best candidates. When the data are reviewed by school size, the results are also clear. Respondents from almost every size school would be willing to analyze at the ePortfolios of the top three contenders. See Figure 5. Fig. 5. Willingness to review ePortfolios of the three best candidates by number of employees iJIM ‒ Vol. 14, No. 14, 2020 115 Paper—Putting ePortfolios into Practice The item that followed asked respondents if they would make the effort to review the ePortfolio of only the top candidate. Once again, school principals clearly answered in the affirmative, as respondents from both countries (67% Poland and 78% Spain) agreed, somewhat agreed or strongly agreed they would make the effort to examine the ePortfolio of the best candidate. The last item on the questionnaire asked the principals to rate their level of agreement or disagreement with the statement, “The ePortfolio seems like a useful tool to obtain more, and more detailed information about candidates for a position.” There was only one respondent that disagreed with this statement, while 43% percent of all respondents strongly agreed. See Figure 6. Neither previous contact with the ePortfolio nor the number of employees significantly affected the distribution of responses. Fig. 6. The ePortfolio seems like a useful tool to obtain more, and more detailed information about candidates for a position 4 Discussion and Conclusions In this research, school principals from Poland and Spain, from schools of varied sizes, with and without previous contact with ePortfolios, indicated a willingness to use the ePortfolio as a hiring tool. These findings coincide with the previously published research [14][29][31][34][37][39]. It was evident that there was less exposure to the ePortfolio among those respondents from Poland. However, respondents from both countries that had no previous contact with ePortfolio seem to have been sufficiently impressed by the examples of the career ePortfolios given at the beginning of the survey to 116 http://www.i-jim.org Paper—Putting ePortfolios into Practice recognize the value of the ePortfolio as a tool for hiring qualified applicants. The fact that these professional educators could appreciate this, even with only a very brief contact with example ePortfolios, is telling, especially when considering that the positive appraisals were unaffected by country, school size, or previous contact. This is coherent with the findings published in Ref. [2]. It was interesting to note that 62.5% of all respondents (67% of Polish participants, and 57% of Spanish participants) had not had previous contact with the ePortfolio, neither educational nor career versions. Certainly, these participants, in particular, could benefit from learning the best practices related to using the ePortfolio as a recruitment tool so they can leverage all of the benefits it has to offer. Previous research has pointed out the need for those responsible for the selection and hiring process to be informed and trained in the use and benefits of the ePortfolio in order to capitalize on the unique benefits that it has to offer [34][14]. Perhaps there could be a residual benefit of providing ePortfolio training to school principals, who may be responsible for hiring faculty and staff at their institution, but are also professional educators, as this could be a catalyst for implementing a student ePortfolio program as well. Future research might include a qualitative and quantitative study on the effectiveness of ePortfolios as a hiring tool conducted among school principals and job applicants. It would also be valuable to analyze in what format and stage of the hiring process the school principals would consult candidates’ ePortfolios. 5 References [1] Ifenthaler, D. (Ed.). (2018). Digital workplace learning: Bridging formal and informal learning with digital technologies. Springer. [2]Watty, K., Kavanagh, M., McGuigan, N., Leitch, S., Holt, D., Ngo, L., & McKay, J. (2016a). Realising the potential: assessing professional learning through the integration of ePortfolios in Australian business education-final report. Retrieved 19/09/2019, from https://ltr.edu.au/resources/ID13_2888_Watty_Report_2015.pdf. https://doi.org/10.14742/ ajet.2666 [3]Carl, A., & Strydom, S. (2017). e-Portfolio as reflection tool during teaching practice: The interplay between contextual and dispositional variables. South African Journal of Education, 37(1). https://doi.org/10.15700/saje.v37n1a1250 [4]Ciesielkiewicz, M. (2019). The use of e-portfolios in higher education: From the students' perspective. Issues in Educational Research, 29(3), 649-667. [5] Lim, C. P., Lee, J. C. K., & Jia, N. (2016). E-portfolios in pre-service teacher education: Sustainability and lifelong learning. In Quality and Change in Teacher Education (pp. 163-174). Springer, Cham. https://doi.org/10.1007/978-3-319-24139-5_10 [6] Oakley, G., Pegrum, M., & Johnston, S. (2014). Introducing e-portfolios to pre-service teachers as tools for reflection and growth: lessons learnt. Asia-Pacific Journal of Teacher Education, 42(1), 36-50. https://doi.org/10.1080/1359866x.2013.854860 [7]Taylor, J., Dunbar-Hall, P., & Rowley, J. L. (2012). The e-portfolio continuum: Discovering variables for e-portfolio adoption within music education. Australasian Journal of Educational Technology, 28(8). https://doi.org/10.14742/ajet.776 iJIM ‒ Vol. 14, No. 14, 2020 117 Paper—Putting ePortfolios into Practice [8] Wuetherick, B., & Dickinson, J. (2015). Why ePortfolios? Student Perceptions of ePortfolio Use in Continuing Education Learning Environments. International Journal of ePortfolio, 5(1), 39-53. [9] Winberg, C., & Pallitt, N. (2016). “I am trying to practice good teaching”: Reconceptualizing ePortfolios for professional development in vocational higher education. British Journal of Educational Technology, 47(3), 543-553. https://doi.org/10. 1111/bjet.12440 [10] Hinojosa, J., & Howe, T. H. (2016). EPortfolio: The scholarly capstone for the practice doctoral degree in occupational therapy. The Open Journal of Occupational Therapy, 4(3), 10. https://doi.org/10.15453/2168-6408.1203 [11] Chang, C. P., Lee, T. T., & Mills, M. E. (2017). Clinical nurse preceptors' perception of e- portfolio use for undergraduate students. Journal of professional nursing, 33(4), 276-281. https://doi.org/10.1016/j.profnurs.2016.11.001 [12] Venville, A., Cleak, H., & Bould, E. (2017). Exploring the potential of a collaborative web-based E-portfolio in social work field education. Australian Social Work, 70(2), 185- 196. https://doi.org/10.1080/0312407x.2017.1278735 [13] Mihret, D. G., Abayadeera, N., Watty, K., & McKay, J. (2017). Teaching auditing using cases in an online learning environment: The role of ePortfolio assessment. Accounting Education, 26(4), 335-357. https://doi.org/10.1080/09639284.2017.1292466 [14] Watty, K., McKay, J., Ngo, L., Holt, D., McGuigan, N., Leitch, S., & Kavanagh, M. (2016b). EPortfolios in business education. Sydney: Chartered Accountants Australia and New Zealand. [15] Luchoomun, D., McLuckie, J. & VanWesel, M. (2010). Collaborative e-learning: e- portfolios for assessment, teaching and learning. Electronic Journal of e-Learning. (8)1, 21-30 [16] Hyland, N. & Kranzow, J. (2012). The e-portfolio: A tool and a process for educational leadership. Journal on Excellence in College Teaching. (23)2. 69-91. [17] Okoro, E. A., Washington, M. C., & Cardon, P. W. (2011). EPortfolios in business communication courses as tools for employment. Business Communication Quarterly, 74(3), 347-351. https://doi.org/10.1177/1080569911414554 [18] Johnsen, H. L. (2012). Making Learning Visible with ePortfolios: Coupling the Right Pedagogy with the Right Technology. International Journal of ePortfolio, 2(2), 139-148. [19] Kabilan, M. K., & Khan, M. A. (2012). Assessing pre-service English language teachers’ learning using e-portfolios: Benefits, challenges and competencies gained. Computers & Education, 58(4), 1007-1020. https://doi.org/10.1016/j.compedu.2011.11.011 [20] Koraneekij, P., & Khlaisang, J. (2019). Students' Beliefs Regarding the Use of E-portfolio to Enhance Cognitive Skills in a Blended Learning Environment. International Journal of Emerging Technologies in Learning, 14(2), 85-104. https://doi.org/10.3991/ijet.v14i02.82 88 [21] Lopez-Fernandez, O., & Rodriguez-Illera, J. L. (2009). Investigating university students’ adaptation to a digital learner course portfolio. Computers & Education, 52(3), 608-616. https://doi.org/10.1016/j.compedu.2008.11.003 [22] Lowenthal, P., White, J. W., & Cooley, K. (2011). Remake/Remodel: Using ePortfolios and a System of Gates to Improve Student Assessment and Program Evaluation. International Journal of ePortfolio, 1(1), 61-70. [23] Mummalaneni, V. (2014). Reflective essay and e-portfolio to promote and assess student learning in a capstone marketing course. Marketing Education Review, 24(1), 43-46. https ://doi.org/10.2753/mer1052-8008240107 118 http://www.i-jim.org Paper—Putting ePortfolios into Practice [24] Wetcho, S., & Na-Songkhla, J. (2019). The Different Roles of Help-Seeking Personalities in Social Support Group Activity on E-Portfolio for Career Development. International Journal of Emerging Technologies in Learning, 14(2), 124-138. https://doi.org/10.3991/ij et.v14i02.8718 [25] Leahy, R. L., & Filiatrault, A. (2017). Employers' Perceptions of the Benefits of Employment Electronic Portfolios. International Journal of ePortfolio, 7(2), 217-223. [26] Fung, D., & Wong, P. S. (2012). Using career education and career services to enhance employability: A case of the Hong Kong Polytechnic University. Asian Journal of Counselling,19(1),75-96. [27] Ring, G. L., Waugaman, C., & Brackett, B. (2017). The Value of Career ePortfolios on Job Applicant Performance: Using Data to Determine Effectiveness. International Journal of ePortfolio, 7(2), 225-236. [28] Ciesielkiewicz, M., Bonilla, C., & Olave López de Ayala, C. (2020). The Potential of the ePortfolio as a Recruitment Tool: From the Perspective of HR Directors. International Journal of Interactive Mobile Technologies (iJIM), 14(03), 95-106. https://doi.org/10.39 91/ijim.v14i03.11557 Hart Research Associates. (2013). It takes more than a major: employer priorities for college learning and student success. Liberal Education., 99. Retrieved 19/09/2019, from http://www.aacu.org/sites/default/files/files/LEAP/2013_EmployerSur vey.pdf [29] Ambrose, A. (2013). Focus group report: What do ND’s top recruiters say about Career ePortfolios. [30] Ward, C., & Moser, C. (2008). e-Portfolios as a hiring tool: Do employers really care? Educause Quarterly, 31(4), 13-14. [31] Weber, K. (2018). Employer Perceptions of an Engineering Student’s Electronic Portfolio. International Journal of ePortfolio, 8(1), 57-71. [32] Theel, R. K., & Tallerico, M. (2004). Using portfolios for teacher hiring: Insights from school principals. Action in Teacher Education, 26(1), 26-33. https://doi.org/10.1080/0162 6620.2004.10463310 [33] Werschay, E.L. (2012), “Electronic portfolios as job search tools: perspectives from students, career counselors, and human resource professionals”, doctoral dissertation, Minnesota State University, Mankato. [34] Van der Schaaf, M., Donkers, J., Slof, B., Moonen-van Loon, J., van Tartwijk, J., Driessen, E., & Ten Cate, O. (2017). Improving workplace-based assessment and feedback by an E- portfolio enhanced with learning analytics. Educational Technology Research and Development, 65(2), 359-380. https://doi.org/10.1007/s11423-016-9496-8 [35] Prinsloo, P., & Slade, S. (2017). Big data, higher education and learning analytics: Beyond justice, towards an ethics of care. In Big data and learning analytics in higher education (pp. 109-124). Springer, Cham. https://doi.org/10.1007/978-3-319-06520-5_8 [36] Yu, T. (2011). E-portfolio, a valuable job search tool for college students. Campus-Wide Information Systems, 29(1), 70-76. https://doi.org/10.1108/10650741211192064 [37] Dahlstrom, E., Dziuban, C. Y Walker, J. D. (2013). ECAR Study of Undergraduate Students and Information Technology. Research Report. Louisville, CO: EDUCAUSE Center for Applied Research. [38] Australian ePortfolio Project (2009). Concept guides/AEP survey instruments. Retrieved 19/09/2019, from https://research.qut.edu.au/eportfolio/australian-eportfolio-toolkit/ iJIM ‒ Vol. 14, No. 14, 2020 119 Paper—Putting ePortfolios into Practice 6 Authors Monika Ciesielkiewicz, Ph.D., Associate Professor, School of Education, Department of Applied Didactics; Villanueva Complutense University of Madrid, Spain. Address: Villanueva-Universidad Complutense Madrid. Costa Brava 2, 28034. Madrid, Spain. Email: mciesielkiewicz@villanueva.edu Claire Frances Bonilla, MSc in Education and New Technologies, Contributor Researcher, Department of Computer Science, UDIMA – Universidad a Distancia de Madrid. Madrid, Spain. Email: clairefbonilla@gmail.com Carlos Olave López de Ayala, Global Head of HR at LG Electronics, LG Twin Towers, 128 Yeoui-daero, Yeongdeungpo-gu, Seoul, 07336 Korea. Email:carlos.ol ave@lge.com Article submitted 2020-04-21. Resubmitted 2020-05-22. Final acceptance 2020-05-24. Final version published as submitted by the authors. 120 http://www.i-jim.org