Journal of Learning Development in Higher Education ISSN: 1759-667X Special Issue 22: Compendium of Innovative Practice October 2021 ________________________________________________________________________ Authentic assessment during Covid-19: an Australian postgraduate computing degree program example Rabiul Hasan University of Sydney, Australia Sabina Cerimagic University of Sydney, Australia Keywords: assessment design; assessment transformation; Covid-19; emergency remote learning; change management. The challenge This case study outlines the challenges faced during the Covid-19 pandemic in relation to transforming assessment design. It focuses on a core study unit with an approximate class size of 300 students in the Master of Information Technology (MIT) degree programme at an Australian university. When the Covid-19 outbreak first affected our education delivery in March 2020, we had little time to plan and transform assessments, instead addressing emergency remote learning (Khlaif, Salha and Kouraichi, 2021). With very short-notice (fewer than two weeks), we were expected to update our unit of study outline, including the redesign of different types, modes, and implementation of assessment. In addition to this challenge, change management was a crucial issue in our micro-level decision-making because we had already published the course outline and were about to start face-to-face delivery of classes and tutorials. We had insufficient information on unit delivery plans and assessment implementation options, including whether to go online for the entire semester or only the first half. About 80% of the students enrolled in the unit of the study were based overseas, and many of them experienced border closures or travel restrictions (Champagne and Granja, 2021) around the beginning of semester one in March 2020. Moreover, it was challenging to decide on the right tools to implement assessments apart from using Canvas (our university’s LMS). Hasan and Cerimagic Authentic assessment during Covid-19: an Australian postgraduate computing degree program example Journal of Learning Development in Higher Education, Issue 22: Compendium October 2021 2 We had inadequate information on the constraints associated with the available tools, including their usability and accessibility. The most critical challenge in the transformation of our teaching was the design of the assessments in crisis. Studies suggest that authentic assessment activities connect classroom learning to real-world experiences (Ashford-Rowe, Herrington and Brown, 2014; Villarroel et al., 2020), reflect practical task situations (Palm, 2008; Fook and Sidhu, 2010; Villarroel et al., 2018; Sotiriadou et al., 2020; Karunanayaka and Naidu, 2021), and demonstrate students’ capability to analyse and synthesise the tasks in meaningful contexts (Swaffield, 2011; Ashford-Rowe, Herrington and Brown, 2014). However, as part of our emergency response in the midst of the pandemic, quickly creating authentic assessment online was challenging, especially with reduced staffing resources and an uncertain environment where both students and staff were under increasing amounts of stress. The response In the process of designing assessments, we first reviewed existing assessment contexts within the unit of study. It helped us to strategise change implementation and management and make informed decisions on different assessment perspectives in which change was necessary. As the study unit was built into authentic assessments for face-to-face delivery to keep students motivated and engaged (Ellis et al., 2020; Villarroel et al., 2020; Schultz et al., 2021; Sokhanvar, Salehi, and Sokhanvar, 2021) and to support them to develop graduate qualities for employability (Villarroel et al., 2018; Karunanayaka and Naidu, 2021), we wanted to mirror this approach and retain good practice in relation to authentic assessments (Joy Cumming and Maxwell, 1999) for the move online. We had set all assessments online using synchronous and asynchronous participation methods depending on the nature of the assessment. We either changed specific assessment types or removed them where required. We reviewed all assessments of the unit, including online quizzes, in-class tests, individual and group assignments, presentations, and the final exam. We selected a few in-class tests and converted them to assignment-oriented assessments requiring a file submission from a student or group using the Canvas system. In terms of assessment distribution, we designed some of them Hasan and Cerimagic Authentic assessment during Covid-19: an Australian postgraduate computing degree program example Journal of Learning Development in Higher Education, Issue 22: Compendium October 2021 3 to accommodate a delay in implementation in the first six weeks of the 13-week semester to allow students time to settle down before actively engaging with their study. Giving students more time to start doing the assessments was necessary because many of them had to go through a tough time preparing for a good start of the semester, maintaining their mental health and well-being during the Covid-19 outbreak. Thus, we offered flexible time in the commencement of some assessments to support their learning in crisis. Regarding assessment design, we constructed assessments based on real-world scenarios and case analyses. We implemented them online, requiring students to use critical thinking and analytical skills because these are vital components of the unit's learning outcomes and the university’s graduate qualities. We removed Multiple-Choice Questions (MCQs) and Short Answer Questions (SAQs) in the unit of study to give the students a taste of challenges in real-life contexts. However, we did not remove the final exam because our school has a practice whereby most units must have a final exam to offer individual students an exam experience. The exam must carry at least about half of the total weightage of the study unit. Designing an online take-home final exam offered opportunities for students to reflect real-world context and classroom knowledge and respond to analytical and self-reflective questions. We continually improved authentic assessment design and implementation by analysing what went right and what did not in the unit of study as the pandemic progressed. Recommendations While adhering to wider university policy with the final exam, we still made the most of the freedom to ensure authentic assessment. We suggest that educators strive to produce assessments that are engaging, considerate, have synchronous and asynchronous features and focus on real-life scenarios. We also recommend that the authentic assessment strategy serve the purposes of the unit of study and be supported by a balanced alignment between learning activities, assessments, and learning outcomes, aiming to create real-world impact by producing authentic graduate qualities. We realised that adequate support and resources from the faculty level Education Design team and the university’s central Educational Innovation team in transforming assessments during emergency circumstances is crucial. To design an authentic Hasan and Cerimagic Authentic assessment during Covid-19: an Australian postgraduate computing degree program example Journal of Learning Development in Higher Education, Issue 22: Compendium October 2021 4 assessment, one should have educational leadership and a desire to ensure that the unit of study contributes to graduate employability (Sotiriadou et al., 2020; Villarroel et al., 2020). Future research on assessment design, especially in a postgraduate computing degree program or STEM domain, may encompass the findings from this case study to better design assessments that reflect the complex challenges of real-world activities. References Ashford-Rowe, K., Herrington, J. and Brown, C. (2014) ‘Establishing the critical elements that determine authentic assessment’, Assessment & Evaluation in Higher Education, 39(2), pp.205-222. https://doi.org/10.1080/02602938.2013.819566. Champagne, E. and Granja, A. D. (2021) ‘How the Covid-19 pandemic may have changed university teaching and testing for good’, The Conversation, 6 April. Available at: https://theconversation.com/how-the-covid-19-pandemic-may-have-changed- university-teaching-and-testing-for-good-158342 (Accessed: 1June 2021). Ellis, C., van Haeringen, K., Harper, R., Bretag, T., Zucker, I., McBride, S. and Saddiqui, S. (2020) ‘Does authentic assessment assure academic integrity? Evidence from contract cheating data’, Higher Education Research & Development, 39(3), pp.454- 469. https://doi.org/10.1080/07294360.2019.1680956. Fook, C. Y. and Sidhu, G. K. (2010) ‘Authentic assessment and pedagogical strategies in higher education’, Journal of social sciences, 6(2), pp.153-161. https://doi.org/10.3844/jssp.2010.153.161. Joy Cumming, J. and Maxwell, G. S. (1999) ‘Contextualising authentic assessment’, Assessment in Education: Principles, Policy & Practice, 6(2), pp.177-194. https://doi.org/10.1080/09695949992865. Karunanayaka, S. P. and Naidu, S. (2021) ‘Impacts of authentic assessment on the development of graduate attributes’, Distance Education, 42(2), pp.231-252. https://doi.org/10.1080/01587919.2021.1920206. https://doi.org/10.1080/02602938.2013.819566 https://theconversation.com/how-the-covid-19-pandemic-may-have-changed-university-teaching-and-testing-for-good-158342 https://theconversation.com/how-the-covid-19-pandemic-may-have-changed-university-teaching-and-testing-for-good-158342 https://theconversation.com/how-the-covid-19-pandemic-may-have-changed-university-teaching-and-testing-for-good-158342 https://theconversation.com/how-the-covid-19-pandemic-may-have-changed-university-teaching-and-testing-for-good-158342 https://doi.org/10.1080/07294360.2019.1680956 https://doi.org/10.3844/jssp.2010.153.161 https://doi.org/10.1080/09695949992865 https://doi.org/10.1080/01587919.2021.1920206 Hasan and Cerimagic Authentic assessment during Covid-19: an Australian postgraduate computing degree program example Journal of Learning Development in Higher Education, Issue 22: Compendium October 2021 5 Khlaif, Z. N., Salha, S., and Kouraichi, B. (2021) ‘Emergency remote learning during Covid-19 crisis: students' engagement’, Education and Information Technologies, 1- 23. https:/doi.org/10.1007/s10639-021-10566-4. Palm, T. (2008) ‘Performance assessment and authentic assessment: a conceptual analysis of the literature’, Practical Assessment, Research, and Evaluation, 13(1), p.4. https://doi.org/10.7275/0qpc-ws45. Schultz, M., Young, K., Gunning, T. K. and Harvey, M. L. (2021) ‘Defining and measuring authentic assessment: a case study in the context of tertiary science’, Assessment & Evaluation in Higher Education, pp.1-18. https://doi.org/10.1080/02602938.2021.1887811. Sokhanvar, Z., Salehi, K. and Sokhanvar, F. (2021) ‘Advantages of authentic assessment for improving the learning experience and employability skills of higher education students: a systematic literature review’, Studies in Educational Evaluation, 70, p.101030. https://doi.org/10.1016/j.stueduc.2021.101030. Sotiriadou, P., Logan, D., Daly, A. and Guest, R. (2020) ‘The role of authentic assessment to preserve academic integrity and promote skill development and employability’, Studies in Higher Education, 45(11), pp.2132-2148. https://doi.org/10.1080/03075079.2019.1582015. Swaffield, S. (2011) ‘Getting to the heart of authentic assessment for learning’, Assessment in Education: Principles, Policy & Practice, 18(4), pp.433- 449. https://doi.org/10.1080/0969594X.2011.582838. Villarroel, V., Bloxham, S., Bruna, D., Bruna, C. and Herrera-Seda, C. (2018) ‘Authentic assessment: creating a blueprint for course design’, Assessment & Evaluation in Higher Education, 43(5), pp.840-854. https://doi.org/10.1080/02602938.2017.1412396. Villarroel, V., Boud, D., Bloxham, S., Bruna, D. and Bruna, C. (2020) ‘Using principles of authentic assessment to redesign written examinations and tests’, Innovations in https://dx.doi.org/10.1007/s10639-021-10566-4 https://doi.org/10.7275/0qpc-ws45 https://doi.org/10.1080/02602938.2021.1887811 https://doi.org/10.1016/j.stueduc.2021.101030 https://doi.org/10.1080/03075079.2019.1582015 https://doi.org/10.1080/0969594X.2011.582838 https://doi.org/10.1080/02602938.2017.1412396 Hasan and Cerimagic Authentic assessment during Covid-19: an Australian postgraduate computing degree program example Journal of Learning Development in Higher Education, Issue 22: Compendium October 2021 6 Education and Teaching International, 57(1), pp.38-49. https://doi.org/10.1080/14703297.2018.1564882. Author details Rabiul Hasan is a Lecturer and Unit of Study Coordinator in the School of Computer Science at the University of Sydney. Rabiul’s research areas include curriculum redesign, change management, and health informatics. Sabina Cerimagic is a Senior Lecturer and Deputy Academic Director of the Business Co- Design (BCD) team, at the Sydney Business School, at the University of Sydney. Sabina’s main research areas are: educational pedagogy, project management, change management, leadership and motivation, cross-cultural project management and training, curriculum redesign, curriculum renewal through design thinking, systems thinking, design- based research, higher education pedagogy and technology integration. https://doi.org/10.1080/14703297.2018.1564882 Authentic assessment during Covid-19: an Australian postgraduate computing degree program example The challenge The response Recommendations References Author details