© 2011 Current Issues in Comparative Education, Teachers College, Columbia University, ALL RIGHTS RESERVED Current Issues in Comparative Education, Vol. 14(1): 24-37 Assessing Student Engagement in China: Responding to Local and Global Discourse on Raising Educational Quality Heidi Ross Indiana University Yuhao Cen Indiana University Zejun Zhou Indiana University China’s heated education policy climate in 2010 indicated an increasing national concern for improving educational quality and educational quality assessment. Despite glowing portraits of Chinese education painted by international observers, the Chinese public has expressed consistent dissatisfaction with educational quality. The inter-related research projects described in this article were launched with a desire to deepen comparative discussion of educational quality and to respond to China’s drive to improve and assess educational quality across all levels of schooling. This paper will introduce how educational quality is framed in key policy reform documents shaping Chinese education over the next decade. This will provide the backdrop for findings from two research projects that represent an effort to re-focus quality and quality assessment debates on high school and college students and their educational experiences. Derived and adapted from over a decade of robust research on student engagement in the U.S., the research projects include surveys on student engagement, a key factor in effective educational practice largely missing from Chinese quality assessment frameworks and toolkits. ot long before Shanghai’s PISA results caught the world’s attention in 2010, Chinese educational authorities launched plans to support the country's goal to ‚build a moderately prosperous society in all respects by 2020‛ 1 (Hu, 2007). Shortly after, China experienced a year of educational media attention and policy-making frenzy. A key document, titled Outline of China’s National Plan for Medium and Long-term Education Reform and Development 2010-2020 (hereafter the Blueprint) debuted in July 2010 after three years of planning, multiple revisions, expert and public involvement. The Blueprint outlines goals for all stages and aspects of education over the next decade. In January 2011, the State Council, the ‚cabinet‛ of the central government of the People’s Republic of China, issued a follow-up action plan for the Blueprint (hereafter the Action Plan) detailing key implementation projects.2 These two documents have received unprecedented public scrutiny and provide the context for our examination of how Chinese policy makers and educators are re-conceptualizing educational quality. Serious public concern for quality assessment features prominently in new policies in response to a suffocating environment of test score-equivalent-quality and outcome- N H. Ross, Y. Cen, and Z. Zhou Current Issues in Comparative Education 25 centered assessments. As a result of reforms characterized by rapid educational expansion, devolution of funding, diversification of institutional missions, and the quest for world class schools, a nationwide debate has centered on how to define, measure, and achieve educational effectiveness and innovation. Despite glowing portraits of Chinese education painted by international observers, Ministry of Education (MOE) officers, school administrators, and researchers have expressed consistent dissatisfaction with existing mechanisms. These are primarily standardized tests, research activity, and infrastructure measures for assessing the quality of student, faculty, and institutional outcomes. The inter-related research projects described in this article were launched with a desire to deepen comparative discussion of educational quality and to respond to China’s drive to improve and assess educational quality across all levels of schooling. The research projects’ use of student engagement surveys represents an effort to re-focus on the educational experiences of students in relation to education quality and new quality assessments. The phrase ‚student engagement‛ denotes the amount of time and effort students put into their studies and other educational activities in high school and college, and what they think of these experiences (Fredricks, Blumenfeld, & Paris, 2004; Kuh, 2003). Derived and adapted from robust research on student engagement at Indiana University, the National Survey of Student Engagement-China (NSSE-C) and the High School Survey of Student Engagement-China (HSSSE-C) were designed to measure student engagement at undergraduate and high school levels respectively, a key factor in effective educational practice largely missing from Chinese quality assessment frameworks. The two are distinct in their emphasis and methodology, but together provide insight on how debates about quality are largely consistent across secondary and post-secondary schooling. The surveys represent the first evaluation instruments to be used in China that focus on the concept of student engagement. A key feature of this project is the simultaneous development of surveys for both high school and college students. Tracking the development of student engagement across the secondary and post-secondary years is crucial to understanding educational quality in the Chinese context. High-stakes tests (and students’ ability to pay) determine college matriculation and also shape college experiences. A focus on student engagement allows researchers to explore factors that have impact on college access and success. It also allows policy makers and practitioners to address and act upon these factors. HSSSE-C data allow us to probe whether students’ activities in high schools are consistent with the normative performance demands reported by college students in NSSE-C. Complementing the high-stakes performance tests that characterize the Chinese secondary school experience, HSSSE-C also allows us to begin to identify specific educational processes that are linked to outcomes that Chinese standardized and entrance examination tests measure. In this article, we first analyze education quality improvement and quality assessment discourse in the new policies and their mandates for Chinese high schools and colleges. We then trace the trajectories of the NSSC-C and HSSSE-C projects and research findings in relation to quality improvement and assessment. Our discussion of the NSSE-C data draws on research already published in China, while our analysis of HSSSE-C data draws on its first 2007 pilot study in Assessing Student Engagement in China 26 Current Issues in Comparative Education Shanghai. We conclude by summarizing the significance of our student-centered approach, survey instruments, and specific conclusions for China’s new reform era. An Analysis of Chinese National Policy on Zhiliang Assessment and Evaluation for High Schools & Higher Education Akin to their counterparts in the U.S. and worldwide, Chinese policy documents are frequently scrutinized to evaluate changing policy climates. Examination of tifa, the Chinese expression for ‚how policies are framed and formulated,‛ provides a useful starting point for comprehending what education policies intend and how their implementation is envisioned. Our brief examination of the Blueprint and corresponding Action Plan highlights two salient themes: systematic improvement of educational quality and innovation in education quality assessment/evaluation. This analysis serves as a backdrop for our introduction of the two student engagement projects, the HSSSE-C at the high school level and the NSSE-C at the undergraduate level. The Blueprint’s preamble summarizes China’s major educational challenges, namely that, ‚teaching contents and methods are relatively outdated, schoolwork burdens on primary and middle school students are too heavy, the promotion of quality education is arrested, our students are weak in their adaptability to society, and innovative, practical and versatile professionals are in acute shortage‛ (Blueprint, 2010). Quality improvement emerges as a catchphrase for resolving these perceived weaknesses,3 as evidenced by two of the Blueprint’s five guiding principles, ‚reform and innovation‛ and ‚improving quality of education‛ (Blueprint, 2010). One crucial innovation in the principle of ‚reform and innovation‛ is education quality assessment/evaluation reform. The proposed reform mandates for high schools that ‚a scientific teaching quality evaluation system shall be in place, and academic proficiency tests and comprehensive evaluation of student quality should be instituted throughout senior middle school education‛ (Blueprint, 2010). For higher education, the Blueprint advocates ‚a project to ensure undergraduate teaching quality and to transform college education shall be undertaken comprehensively. Supervision over teaching shall be tightened up, and teaching quality guaranteed institutionally. College teaching evaluation shall be improved‛ (Blueprint, 2010). Of particular relevance to student-focused institutional reforms, the Blueprint reiterates the significance of quality assessment/evaluation as a complex process demanding diverse assessment approaches that involve multiple stake holders: We will improve the evaluation of teaching. We will set up scientific and diverse benchmarks for such evaluation, according to teaching goals and concepts on talents or professionals. Teaching quality shall be evaluated with the participation of government, schools, parents and communities. We will keep records of students and improve the assessment of comprehensive quality. Diverse evaluation approaches that help promote student development shall be explored to encourage students to be optimistic and independent and become useful persons [emphasis added by authors] (Blueprint, 2010). H. Ross, Y. Cen, and Z. Zhou Current Issues in Comparative Education 27 In addition, the Blueprint highlights quality assessment/evaluation of education processes in key reform experiments. For higher education this involves improving undergraduate education quality and teaching quality; for high schools ‚an educational quality monitoring and evaluating system shall be perfected and the findings of the evaluation should be publicized at regular intervals‛ (Blueprint, 2010). The Action Plan adopts similar priorities. One of its ten special reform experiments is establishing an education quality monitoring and assessment mechanism for elementary, middle and high schools. As for higher education, the Action Plan aims to improve quality and implement an innovation-oriented academic evaluation system. Despite the fact that the Blueprint and Action Plan aim to diversify assessments and broaden participation, student voice and experience are largely missing and educational outcomes are prioritized over processes. As noted in the extended quotation above, students are mentioned merely in passing and only with regard to increasing participation in assessment/evaluation. The National Survey on Student Engagement (NSSE-China): Focusing Reform on Improving Undergraduate Learning At the postsecondary level, quality improvement in ‘talent training’ (rencai peiyang), or teaching and learning, stands out in the Blueprint: Establish the central status of talent training in higher educational institutions. Cultivate specialized talents and innovative talents that are persistent, ethical, knowledgeable and competent. Increase input in teaching and learning. Prioritize teaching in faculty evaluation