7327 Husain FNL.docx education policy analysis archives A peer-reviewed, independent, open access, multilingual journal Arizona State University Volume 30 Number 150 October 11, 2022 ISSN 1068-2341 School Turnaround Lessons for Policy and Practice: A Systematic Review of Research and Evaluation Aliza N. Husain Pivot Learning United States Coby V. Meyers University of Virginia United States & Corrie Stone-Johnson University at Buffalo, State University of New York United States Citation: Husain, A. N., Meyers, C. V., & Stone-Johnson, C. (2022). School turnaround lessons for policy and practice: A systematic review of research and evaluation. Education Policy Analysis Archives, 30(150). doi:0000000/000000000000 [EPAA will assign the DOI] Abstract: While there currently exists a vast body of research around school turnaround policies, few studies speak to why they have or have not worked. This paper undertakes a systematic review of research literature on school turnaround policies to explore why this lack of understanding prevails in the field. We find key disconnects between “policy” and “practice” research on the topic of school turnaround. We contend that this divide negates the potential to learn from school leadership policy and practice in turnaround settings. We offer Journal website: http://epaa.asu.edu/ojs/ Manuscript received: 12/1/2021 Facebook: /EPAAA Revisions received: 2/27/2022 Twitter: @epaa_aape Accepted: 2/27/2022 Education Policy Analysis Archives Vol. 30 No. X 2 implications of these findings within turnaround research and policy while pointing out that this apparent divide seems to extend beyond the example of turnaround. Keywords: school turnaround; educational policy; educational practice; leadership Lecciones de recuperación educativa para políticas y prácticas: Un análisis sistemático de investigación y evaluación Resumen: Aunque actualmente exista un cuerpo amplio de investigación sobre las políticas de recuperación educativa, pocos estudios abordan los motivos por los que han funcionado o no. Este artículo entabla un análisis sistemático de la literatura que investiga la recuperación educativa para explorar la razón por la que esta falta de comprensión persiste en el campo educativo. Encontramos desconexiones fundamentales entre la investigación que se centra en las “políticas” de recuperación y la que se centra en las “prácticas” de recuperación. Sostenemos que esta división niega la posibilidad de que se aprenda de las políticas y prácticas del liderazgo escolar en ambientes de recuperación. Ofrecemos las implicaciones de estos hallazgos en las investigaciones y políticas que lidian con la recuperación educativa mientras señalamos que esta división evidente parece extender más allá del ejemplo de recuperación.  Palabras claves: recuperación educativa; políticas educativas; prácticas educativas; liderazgo Lições de recuperação escolar para políticas e práticas: Uma revisão sistemática de pesquisa e avaliação Abstract: Embora exista atualmente um vasto corpo de pesquisa sobre políticas de recuperação escolar, poucos estudos examinam por que elas funcionaram ou não. Este artigo realiza uma revisão sistemática da literatura sobre políticas de recuperação escolar para explorar por que essa falta de compreensão prevalece no campo. Encontramos importantes desconexões entre a pesquisa “política” e “prática” sobre o tema da recuperação escolar. Mantemos que essa divisão nega a possibilidade de aprender da política e da prática de liderança escolar em ambientes de recuperação. Oferecemos implicações dessas desconexões descobertas na pesquisa e nas políticas de recuperação escolar, e apontamos que essa aparente divisão parece se estender além do exemplo de recuperação. Keywords: recuperação escolar; políticas educativas; práticas educativas; liderança School Turnaround Lessons for Policy and Practice: A Systematic Review of Research and Evaluation The concept of school turnaround has emerged over the last twenty years as a call to rapidly improve the nation’s lowest-performing schools (Calkins et al., 2007; Herman et al., 2008). The intensity of school turnaround exceeds notions of school improvement or school reform, and typically relies on considerable disruption to who leads and how they lead underperforming schools (Meyers & Smiley, 2017; Redding & Nguyen, 2020). Federal (e.g., School Improvement Grants) and local (e.g., Innovation Zones) turnaround policies have typically prescribed what districts and schools should do to increase student achievement (Pham et al., 2020). For the purposes of this paper, we conceive of turnaround policies as formal attempts by a governing body to outline how districts and schools should achieve rapid improvement. Over the last 15 years the evidence base for the efficacy of these initiatives has grown, with mixed findings emerging. For example, turnaround programs led to significant increases in achievement in several contexts (Carlson & Lavertu, 2018; Player & Katz, 2016; Schueler et al., 2017; Sun et al., 2017; Thompson et al., 2016) but not in others (Heissel & Ladd, 2018; Hochbein, 2012; Meyers et al., School Turnaround Lessons for Policy and Practice 3 2012; Stuit, 2012). While the research on the impact of turnaround policy makes broad claims about policy efficacy (or lack thereof), few studies are able to describe why these policy initiatives have or have not worked. In part, the answer to why these policies succeed or fail is unknown because studies simply have not asked this question. Indeed, many of the conclusions of studies in the school turnaround policy arena suggest that more research is needed to understand these contextual factors. Even while policies and policy evaluations in this space continue to grow, no evidence indicates that this call is being taken up. Despite differences in their context and objectives, turnaround policies routinely identify principals as key to leading rapid school improvement (Herman et al., 2008). What is known suggests that school principals, ostensibly those most responsible for leading turnaround, feel uncertainty about which aspects of turnaround policies are the ones leading to the desired change (Welsh, 2019); a lack of district support (Meyers & Sadler, 2018); and a psychological toll on their wellbeing (Yoon & Barton, 2019). Thus, while the ambitious goal of school turnaround is to rapidly improve outcomes for the most vulnerable students, progress may come with a price for those tasked with turnaround. Without more interplay between—or blurring of (Hargreaves, 1996)—research focused on policy implementation and outcomes and the on-the-ground experiences of those doing the work, it is unlikely that we will fully understand how or why turnaround policy and research have or have not been effective. For these reasons, we conducted a systematic review of school turnaround policy evaluation and research to inform policymakers, researchers, and others about the ways in which related bodies of literature might not fully synchronize. Through shedding light on this issue, we hope to elucidate not only why policy and practice research needs to overlap in order to better serve marginalized students, but also why we believe these disconnects in research exist and how the field can overcome them moving forward. In this systematic review, we document the gap between what is known about the efficacy of school turnaround policies and the contextual factors that may lead to these outcomes. To do so, we pose two research questions. First, how has school turnaround been conceptualized within policy and practice—primarily leadership—research? Second, how do discrete features of the research articles—including research questions, units of analysis, findings, limitations, overlaps, and implications—differ across the policy and practice literature? To answer these questions, we systematically review research literature on school turnaround policies between the years 2000 and 2020, spanning the early years of the No Child Left Behind ([NCLB], 2002) policy in the United States and concluding with the most recent research on School Improvement Grants (SIGs). As many schools nationwide continue to require turnaround interventions (Meyers et al., 2022), simply exploring whether or not such policy initiatives work is no longer adequate, not only because such efforts require high levels of funding from federal and state governments, but also because without understanding more about the factors that impact success or failure, schools and districts operate with limited knowledge about how to utilize such funding. We thus argue that not only is more research needed to understand turnaround efficacy, but also a specific type of research is needed, one that is able to focus on the explanatory factors related to turnaround across contexts. This systematic review points the way for such research, indicating both where such policies may be most impactful as well as the types of studies that are needed and why. School Turnaround: An Overview In fewer than 15 years, school turnaround has been conceptualized in several distinct ways. In 2008, a federally sponsored practice guide (Herman et al., 2008) legitimized the term, framing it Education Policy Analysis Archives Vol. 30 No. X 4 as an effort to dramatically increase student achievement in three years and emphasizing the need to signal change through the school principal. Others (Murphy & Meyers, 2008) conceptualized the term more broadly, focusing on any strategic initiative prioritizing the rapid improvement of the lowest-performing schools. Shortly after, researchers (e.g., Stuit, 2012) developed statistical methods to identify the frequency with which schools achieved turnaround. Simultaneously, the federal government established SIG funds with models of turnaround prioritizing changing school leadership (Le Floch et al., 2014). Researchers and policymakers have also identified additional aggressive policy initiatives as turnaround policies that, unlike many improvement and reform initiatives, are externally imposed (Schueler, 2019). As a result of the aforementioned undertakings, our understanding of the concept of turnaround as a policy mechanism and school leadership framework has been interrupted and obfuscated. In this systematic literature review, we step back to analyze the concept of school turnaround and its derivations to extract lessons for both policy and practice. Turnaround Policy Since the advent of No Child Left Behind, the federal government of the United States has taken a more deliberate approach toward school improvement, focusing on a combination of incentives, additional funds, and consequences (e.g., status labeling) as vehicles for improvement and reform. In a recently published meta-analysis, Redding and Nguyen (2020) describe the four mechanisms by which school turnaround is hypothesized to affect student outcomes: improved organizational performance, changes in human capital, changes in governance/management, and incentives/sanctions. Through a federal approach of increased support and surveillance, the underlying assumption is that schools, districts, and/or those who work within them are either unwilling or unable to do the work of improving outcomes. Another way of saying this is that a prevailing assumption contends that school leaders do not have the expertise to turn around schools but instead must rely upon outside experts to guide their decision-making. Indeed, much of the research is based on the notion that “All failing schools, especially those that persistently fail, need guidance on what will work quickly to improve student outcomes” (Herman et al., 2008, p. 1). Despite increased federal spending on school turnaround policies and initiatives, the metrics for being designated a school in need of turnaround have been relatively unclear (Schmidt-Davis & Bottoms, 2012). One constant has been a focus on dramatic increases in student test scores, primarily in language arts and mathematics (e.g., Ylimaki et al., 2014). The more than $7 billion invested in SIG funding exemplifies this intensity to make substantial achievement gains quickly (Emma, 2015). No Child Left Behind (NCLB, 2002) established the School Improvement Grants program to support schools in this effort. Congressional funding for SIGs began in 2007 and additional funds were provided through the American Recovery and Reinvestment Act. To be specific, SIGs outlined the strategies that states could employ to turn schools around. Three of these four models required changing the principal, with school closure being the only exception (Le Floch et al., 2014). The Every Student Succeeds Act ([ESSA], 2015)—a federal law replacing NCLB and giving states more autonomy in how they hold schools accountable for student achievement—eliminated the SIGs but allowed for funding for struggling schools through increased Title 1 dollars (i.e., federal funding to supplement local funding for low-income students), resulting in similar financial support for turnaround initiatives in schools deemed to be priority (VanGronigen & Meyers, 2019). Following NCLB, ESSA encouraged states to take up tiered accountability systems targeting schools performing at the lowest levels for intensive School Turnaround Lessons for Policy and Practice 5 interventions (Schueler et al., 2017). This approach provides some flexibility to states through defining these tiers of evidence for consideration and use by policymakers and educators. This flexibility is the key difference between earlier NCLB/SIG policy and current ESSA policy; NCLB/SIG policy prescribed particular interventions whereas ESSA supports a wide range of improvement initiatives (Herman et al., 2017). Despite increased flexibility in turnaround policy in recent years, in our review of the literature we see little discernible change in how turnaround research and policy evaluation are conceptualized or conducted. There are, however, at least a couple of constants in research on turnaround. First, despite policy evaluations that have shown impact on student achievement outcomes (Dee, 2012; Schueler et al., 2017), many policymakers, researchers, and practitioners have come to believe that the overall results of such federal programs have been disappointing (Murphy & Bleiburg, 2019). Second, despite policy and scholarly insistence (e.g., Herman et al., 2008; Murphy & Meyers, 2008) on the importance of principals in leading turnaround, policy evaluations have mostly neglected the school leader when exploring the success or failure of particular initiatives. These findings appear to persist across the two waves of policies: NCLB and ESSA. Instead, studies of school turnaround can largely be considered distinctly as either policy evaluations (i.e., did school turnaround policy impact student achievement outcomes?) or case studies of principal action (i.e., what did a principal do in trying to lead a turnaround effort?). Policy evaluations do not offer insights into the potential heterogeneity of how these policies were enacted on the ground, while findings from the case studies cannot be generalized beyond the one particular school leader on whom the article focuses. The apparent disconnect between the way researchers and evaluators have analyzed school turnaround seems potentially inhibitive to learning what did (or did not) work when, for whom, and why (or why not). Principal Leadership and Turnaround Schools Much of the research on turnaround policy has focused on the effect of improvement efforts on student outcomes. There is some evidence, however, about the role that school leaders play in turnaround initiatives’ success or failure and their experiences working in turnaround schools. As research in educational administration repeatedly emphasizes, school leaders play an essential role in student outcomes generally (Louis et al., 2010) and improvement efforts more specifically (Herman et al., 2017). Indeed, new research indicates that principals have the greatest effect on student outcomes (Grissom et al., 2021), even more than teachers, although their work is largely indirect. Even so, little is known about these mechanisms of improvement. The limited evidence on principals and turnaround suggests three key areas for consideration. First, much of the work of leading turnaround schools is primarily personnel focused rather than policy focused. That is to say, leaders spend much of their time helping teachers through the reform efforts. Schools that improved culture often fared better than schools that did not (Brown et al., 2017; Cucchiara et al., 2015; Pulliam et al., 2014). Second, the work is challenging and can have detrimental effects on principals’ work and career satisfaction. Yoon and Barton (2019), as well as others (e.g., Peck & Reitzug, 2014), describe the work as taking a psychological toll on principals as they engage in the demanding and, at times, relentless work of school turnaround. Finally, of the few studies that exist on this important topic, many, if not most, are single case studies of leaders or districts engaged in the process of improvement. As we describe later in this paper, it is evident that more research is needed to understand turnaround work qualitatively at a larger scale. Thus, answering our research questions remains critically important because such an endeavor will help shed light on how the concept of school turnaround has been understood and enacted, and what lessons there are for policy and practice going forward given the field’s Education Policy Analysis Archives Vol. 30 No. X 6 continued commitment to improve low-performing schools, regardless of terminology. For instance, we still do not know what principals do or need to do to actually lead turnaround. If states continue to promulgate policies that promote turnaround as a change mechanism, we need to know what principals need to do and, relatedly, how to prepare them to do it effectively. Methods To respond to our research questions, we concurrently conducted a systematic review of existing literature on school turnaround from 2000 to 2020, searching the term “school turnaround” in the database EBSCO, which houses several significant education databases, and was accessible to all researchers on the team. We searched the term in quotations to identify literature addressing the concept specifically while not adding any other limiting search terms in order to retrieve all studies of school turnaround regardless of the various ways researchers and evaluators might conceptualize or define the term. We did, however, restrict our search to the option “find all of my search terms” instead of Boolean phrases, and limited results to scholarly (peer-reviewed) journals and then academic journals. Our initial search resulted in 573 article abstracts. We then divided the abstracts among the three of us to review for fit. Our determination of fit included whether (a) the article used the words “school turnaround”; (b) the study was set in the United States; and (c) the study context was focused on K-12 public schools. Each of us designated articles as relevant or irrelevant. At this stage, we retained articles unless we were completely confident from their abstracts that they failed to meet our criteria. We then redistributed the remaining abstracts among us to review for empiricism. To be included, the study needed to be an empirical examination of school turnaround or its effects and not a theoretical one. We excluded reviews and reports not in journals. After this review, we determined that 75 peer-reviewed articles met the criteria for empiricism. Subsequently, we separated articles into two groups based on their primary focus area: practice or policy. We came to this separation based on our prior reviews and conceptual considerations of turnaround research (Hitt & Meyers, 2018; Murphy & Meyers, 2008). Within this sphere, we observed differences in type of journal (based on journal aims) as well as general research questions. Indeed, this distinction is what anchored our overarching aim for this study (i.e., the specific ways in which these two bodies of work lack overlap). We then chose a subset of 10 articles, five from practice and five from policy, to assess the extent to which we agreed on whether articles were fit for full review. This was our attempt to evaluate inter-rater reliability. We agreed on 90% of the articles and discussed the one disagreement to understand our difference and resolve its inclusion status. With such agreement, we separated the articles for review again, reviewing the remaining 65. We followed the same basic process to analyze complete article texts with the same topical and empirical expectations for fit, before further reducing the total by excluding articles focused on school improvement or reform more broadly or partner organizations or charter organizations, for example, specifically. We excluded studies on school improvement and reform identified by the search engine but not specifically or intentionally referencing school turnaround because the concepts of improvement and reform typically do not frame change with the same level of urgency as that found in school turnaround. Forty-three of the remaining articles were classified as empirical research and evaluation of school turnaround in traditional public-school contexts, of which 27 focused on policy and 16 on practice. At each stage of the review process, we met as a team and discussed decisions. Figure 1 provides a decision tree that illustrates this process. School Turnaround Lessons for Policy and Practice 7 Figure 1 Decision Tree to Determine Final Body of Research Literature Data Source and Analysis Education Policy Analysis Archives Vol. 30 No. X 8 The 43 studies identified through the systematic review process described above comprise the data source for this study (see References for a list of all of the studies reviewed). To answer each question, we created a shared document for reporting and then divided categories evenly across the research team for analysis. The categories for analysis included the basic components of research papers: (1) How is turnaround defined; (2) What are the research questions; (3) What is the unit of analysis; (4) What did the study find; (5) What did the study identify as limitations; (6) What does the study say about leadership/policy; and (7) What does the study say is needed for follow up. Upon review of each article using this format, the research team then reanalyzed each section, looking for patterns of similarity and categorizing accordingly. For example, under defining turnaround, the articles were grouped according to no definition given, not clearly stated but generally about rapid improvement of test scores, naming of policy, and articulation of measurement rules. After each analysis, the team met for discussion and refinement of findings. Results When analyzing our identified articles, we examined various sections of each paper to examine any differences between the pieces we classified as policy or practice. Specifically, we looked at turnaround definitions, research questions, unit of analyses, findings, limitations, the extent to which policy articles spoke to practice research and vice versa, and directions for future research for each paper. We decided on these categories to guide our analyses as these are typically the sections by which empirical, peer-reviewed journal articles are organized. As such, delineation by these categories allowed us to conduct appropriate comparisons across articles while ensuring that we did not overlook important details. Below we outline our findings around each of these sections, emphasizing how the two groups of studies compared to each other within each section. Defining Turnaround We began our analysis by examining the definition of turnaround that each article adopted. Table 1 shows our resulting categorization. Seven of the 43 total articles provided general definitions of turnaround only. Specifically, these articles mentioned the rapid improvement of test scores and/or the dramatic improvement of low-performing schools as evidence of turnaround occurring. Of these seven, we classified one as a policy article and six as practice pieces. In addition to offering broad definitions of turnaround, several articles also discussed policies that were aimed at turning schools around, such as the School Improvement Grants. Twenty-one of these were categorized as policy pieces (of the 27 total policy pieces) and 10 were deemed to be practice articles (of the 16 total practice articles). As is evident, a majority of articles in both policy and practice realms offered broad definitions of turnaround, which were accompanied by an identification of policy prescriptions on the topic. There was also one policy piece that only named a turnaround policy without offering any definition of turnaround (Abdulkadiroğlu et al., 2016). As a final designation, four articles articulated specific measurement rules—for example, student test scores must increase by x amount in y number of years—when stating their definition of turnaround. These were all policy pieces. Of these, one article, Hochbein (2012), presented both a broad and a specific definition of turnaround. The remaining three (Heissel & Ladd, 2018; Hochbein et al., 2013; Stuit, 2012) shared general definitions of turnaround, specific definitions of turnaround, and related turnaround policy. Table 1 Categorization of School Turnaround Definition School Turnaround Lessons for Policy and Practice 9 Policy General statements about rapid improvement of test scores / improvement of low-performing / chronically low-performing schools Atchison (2020); Carlson & Lavertu (2018); Dougherty & Weiner (2019); Dragoset et al. (2019); Gandhi et al. (2018); Hamilton et al. (2014); Heissel & Ladd (2018); Hochbein (2012); Hochbein & Carpenter (2017); Hochbein et al. (2013); Marsh et al. (2012); Mette (2014); Meyers et al. (2012); Player & Katz (2016); Schueler (2019); Schueler et al. (2017); Strunk et al. (2016a); Strunk et al. (2016b); Stuit (2012); Sun et al. (2017); Thompson et al. (2016); VanGronigen & Meyers (2019); Welsh (2019); Welsh & Williams (2018); Welsh et al. (2019); Zimmer et al. (2017) Naming of policy Abdulkadiroğlu et al. (2016); Atchison (2020); Carlson & Lavertu (2018); Dougherty & Weiner (2019); Dragoset et al. (2019); Gandhi et al. (2018); Hamilton et al. (2014); Heissel & Ladd (2018); Hochbein et al. (2013); Hochbein & Carpenter (2017); Marsh et al. (2012); Mette (2014); Meyers et al. (2012); Player & Katz (2016); Schueler (2019); Strunk et al. (2016a); Strunk et al. (2016b); Stuit (2012); Sun et al. (2017); Thompson et al. (2016); VanGronigen & Meyers (2019); Welsh (2019); Welsh & Williams (2018); Welsh et al. (2019); Zimmer et al. (2017) Specific measurement rules Heissel & Ladd (2018); Hochbein (2012); Hochbein et al. (2013);Stuit (2012) Practice General statements about rapid improvement of test scores / improvement of low-performing / chronically low-performing schools Bonda & Mitchell (2015); Brown et al. (2017); Clifford (2013); Cucchiara et al. (2015); Duke & Landahl (2011); Duke & Salmonowicz (2010); Hewitt & Reitzug (2015); Hitt et al. (2018); Hitt et al. (2019); May & Sanders (2013); Mette (2013); Mette & Stanoch (2016); Meyers & Sadler (2018); Pulliam et al. (2014); Reitzug & Hewitt (2017); Yoon & Barton (2019) Naming of policy Brown et al. (2017); Cucchiara et al. (2015); Hewitt & Reitzug (2015); May & Sanders (2013); Mette (2013); Mette & Stanoch (2016); Meyers & Sadler (2018); Pulliam et al. (2014); Reitzug & Hewitt (2017); Yoon & Barton (2019) Specific measurement rules — The articles we identified as policy pieces had more heterogeneity across them when considering how the topic of turnaround was introduced, relative to the practice pieces. Despite having successfully categorized all articles by how they defined turnaround, we found that many articles did not explicitly state a definition of turnaround, either mentioning in passing that school improvement through the lens of academic achievement was being explored or that leaders who Education Policy Analysis Archives Vol. 30 No. X 10 had “turned around” schools were being examined. Very few pieces explicitly stated what it meant for a school to have turned around and how that benchmark was established and measured. Research Questions When considering research questions (see Table 2), all 16 of the practice articles posed questions that were descriptive in nature. Of these, four also asked relational questions (Cucchiara et al., 2015; Hitt et al., 2019; May & Sanders, 2013; Pulliam et al., 2014) and one also asked a perceptual question (Yoon & Barton, 2019). Unlike the practice pieces, several of the policy studies asked causal questions. Specifically, eight studies posed causal questions, an additional four posed both causal and descriptive questions, and one posed causal and relational questions. Ten of the policy studies asked only descriptive questions, while one posed descriptive and perceptual questions (Schueler, 2019), two asked descriptive and relational questions (Hochbein & Carpenter, 2017; Welsh et al., 2019), and one addressed descriptive, relational, and psychometric questions (Hochbein et al., 2013). Similar to the findings when examining turnaround definitions, policy articles had a lot more variation in the types of research questions that they were tackling, relative to the practice pieces. Table 2 Categorization of Research Questions Policy None — Descriptive Gandhi et al. (2018); Hamilton et al. (2014); Heissel & Ladd (2018); Hochbein (2012); Hochbein & Carpenter (2017); Hochbein et al. (2013); Marsh et al. (2012); Mette (2014); Meyers et al. (2012); Schueler (2019); Strunk et al. (2016a); Strunk et al. (2016b); Stuit (2012); Thompson et al. (2016); VanGronigen & Meyers (2019); Welsh (2019); Welsh & Williams (2018); Welsh et al. (2019) Relational Dragoset et al. (2019); Hochbein & Carpenter (2017); Hochbein et al. (2013);Welsh et al. (2019) Causal Abdulkadiroğlu et al. (2016); Atchison (2020); Carlson & Lavertu (2018); Dougherty & Weiner (2019); Dragoset et al. (2019); Gandhi et al. (2018); Heissel & Ladd (2018); Player & Katz (2016); Schueler et al. (2017); Strunk et al. (2016a); Strunk et al. (2016b); Sun et al. (2017); Zimmer et al. (2017) Psychometric Hochbein et al. (2013) Perceptual Schueler (2019) Practice None — School Turnaround Lessons for Policy and Practice 11 Descriptive Bonda & Mitchell (2015); Brown et al. (2017); Clifford (2013); Cucchiara et al. (2015); Duke & Landahl (2011); Duke & Salmonowicz (2010); Hewitt & Reitzug (2015); Hitt et al. (2018); Hitt et al. (2019); May & Sanders (2013); Mette (2013); Mette & Stanoch (2016); Meyers & Sadler (2018); Pulliam et al. (2014); Reitzug & Hewitt (2017); Yoon & Barton (2019) Relational Cucchiara et al. (2015); Hitt et al. (2019); May & Sanders (2013); Pulliam et al(2014) Causal — Psychometric — Perceptual Yoon & Barton (2019) Despite that variation, research questions for policy pieces were limited to quantitative framings to show frequencies, relationships, and causality. Collectively, however, only one of the policy pieces specifically asked research questions on perception (Schueler, 2019). On the other hand, no practice piece attempted to answer causal questions on the topic of turnaround. The research questions in the descriptive practice pieces also differed in scope than those in the policy pieces. Whereas the policy articles asked descriptive questions about counts, percentages, and frequencies, research questions in practice articles were framed to learn about what principals and others were doing in schools that had successfully turned around or were attempting to turn around. In other words, practice pieces asked questions about what principals were doing in schools—whether or not there was evidence that the schools had been successful in turning around or not—whereas policy pieces asked questions about whether turnaround had been achieved or not, but not what contributed to or impeded turnaround. Unit of Analysis We then moved on to categorizing each study by its unit of analysis. Specifically, we searched for whether a study’s outcomes pertained to states, districts, schools, principals, and/or students. Results can be found in Table 3. Nine (seven policy and two practice) of the 43 studies had outcomes relating to more than one category. Of these, two studies looked at state, district, and school outcomes (Schueler, 2019; Welsh & Williams, 2018), two at district and school outcomes (Marsh et al., 2012; Mette, 2014), five at school and student outcomes (Carlson & Lavertu, 2018; Dougherty & Weiner, 2019; Heissel & Ladd, 2018; Strunk et al., 2016a; Strunk et al., 2016b), one at school and principal outcomes (May & Sanders, 2013), and one at school, student, and principal outcomes (Pulliam et al., 2014). Perhaps the most striking revelation in this section was that no policy study had the principal as the unit of analysis and no practice study had the state as the unit of analysis. Even though some practice studies did focus on districts, the point to note here is that no practice study took a macro-level perspective on the topic of turnaround that was comparable to policy pieces. In a similar vein, policy pieces failed to offer a local, “on-the-ground” perspective that was similar to the practice studies. This distinction speaks to the divide across policy and practice pieces; policy pieces tend to overlook the role of the principal in turnaround while practice studies remain localized and unable to make broader claims. Table 3 Education Policy Analysis Archives Vol. 30 No. X 12 Categorization of Unit of Analysis Policy State Schueler (2019); VanGronigen & Meyers (2019); Welsh (2019); Welsh & Williams(2018); Welsh et al. (2019) District Marsh et al. (2012); Mette (2014); Schueler (2019); Welsh & Williams (2018) School Atchison (2020); Carlson & Lavertu (2018); Dougherty & Weiner (2019); Dragoset et al. (2019); Hamilton et al. (2014); Heissel & Ladd (2018); Hochbein (2012); Hochbein & Carpenter (2017); Hochbein et al. (2013); Marsh et al. (2012); Mette (2014); Meyers et al. (2012); Player & Katz (2016); Schueler (2019); Strunk et al. (2016a); Strunk et al. (2016b); Stuit (2012); Thompson et al. (2016); Welsh & Williams (2018) Student Abdulkadiroğlu et al. (2016); Carlson & Lavertu (2018); Dougherty & Weiner (2019); Gandhi et al. (2018); Heissel & Ladd (2018); Schueler et al. (2017); Strunk et al. (2016a); Strunk et al. (2016b); Sun et al. (2017); Zimmer et al. (2017) Principal — Practice State — District Bonda & Mitchell (2015); Mette (2013); Mette & Stanoch (2016); Meyers & Sadler(2018) School Brown et al. (2017); Cucchiara et al. (2015); May & Sanders (2013); Pulliam et al.(2014) Student Pulliam et al. (2014) Principal Clifford (2013); Duke & Landahl (2011); Duke & Salmonowicz (2010); Hewitt & Reitzug (2015); Hitt et al. (2018); Hitt et al. (2019); May & Sanders (2013); Pulliam et al (2014); Reitzug & Hewitt (2017); Yoon & Barton (2019) Findings Once we started categorizing findings (Table 4), takeaways converged into four broad, distinct groups (student achievement results, policy lessons, leadership lessons for districts, and leadership lessons for schools), with some studies falling into two groups. Sixteen (14 policy and two practice) studies examined changes in student academic outcomes. Of these, Dougherty and Weiner (2019) also looked at student mobility, Heissel and Ladd (2018) explored changes in student body composition, and Schueler et al. (2017) included non-test outcomes in their evaluation. Interestingly, 16 studies—of which 14 were policy focused—reported findings pertaining to policy design and consideration. Specifically, six of the studies in this group were also studies that discussed student achievement outcomes. All six of these studies were from the policy group. Eleven studies (six and five, respectively) made up group three, focusing their findings on district-level leadership lessons. Finally, group four—studies emphasizing lessons for school leaders—included 16 studies, of which 14 were from the practice group. Complementary studies by Strunk et al. (2016a; 2016b) were the only studies addressing each of the four groups on some level. School Turnaround Lessons for Policy and Practice 13 Table 4 Categorization of Findings Policy Student achievement / impact Abdulkadiroğlu et al. (2016); Atchison (2020); Carlson & Lavertu (2018); Dougherty & Weiner (2019); Dragoset et al. (2019); Gandhi et al. (2018); Hamilton et al. (2014); Heissel & Ladd (2018); Hochbein (2012); Meyers et al. (2012); Player & Katz (2016); Schueler et al. (2017); Strunk et al. (2016a); Strunk et al. (2016b); Stuit (2012); Sun et al. (2017); Zimmer et al. (2017) Policy lessons (design and considerations) Carlson & Lavertu (2018); Hamilton et al. (2014); Heissel & Ladd (2018); Hochbein et al. (2013); Marsh et al. (2012); Schueler (2019); Strunk et al. (2016a); Strunk et al. (2016b); Sun et al. (2017); VanGronigen & Meyers (2019a); Welsh (2019); Welsh & Williams (2018); Welsh et al. (2019) Leadership (district) Marsh et al. (2012); Mette (2014); Schueler (2019); Strunk et al. (2016a);Strunk et al. (2016b); Welsh & Williams (2018) Leadership (school) Strunk et al. (2016a); Thompson et al. (2016) Practice Student achievement / impact May & Sanders (2013); Pulliam et al. (2014) Policy lessons (design and considerations) Bonda & Mitchell (2015); Mette (2013) Leadership (district) Bonda & Mitchell (2015); Brown et al. (2017); Mette (2013); Mette &Stanoch (2016); Meyers & Sadler (2018b) Leadership (school) Bonda & Mitchell (2015); Brown et al. (2017); Clifford (2013); Cucchiara et al. (2015); Duke & Landahl (2011); Duke & Salmonowicz (2010); Hewitt & Reitzug (2015); Hitt et al. (2018); Hitt et al. (2019); May & Sanders (2013); Mette (2013); Pulliam et al. (2014); Reitzug & Hewitt (2017); Yoon & Barton (2019) Even though we collectively organized all studies into the four aforementioned categories, some important distinctions emerged across the policy and practice pieces. With two exceptions, all studies that had findings pertaining to student achievement outcomes were policy articles. Similarly, only two studies that offered policy-relevant lessons were not policy studies: Bonda and Mitchell (2015) and Mette (2013). Another way to look at this is that, with the two exceptions highlighted above, all practice studies offered findings relevant to district and school leaders, but not student achievement or policy. The most balanced group that emerged was group three, focusing on district leadership findings. Findings for school leadership were almost exclusively Education Policy Analysis Archives Vol. 30 No. X 14 limited to practice articles. Thus, three of the groups were starkly split by study classification as policy or practice. Some of the issues highlighted here should be expected: categorizing articles as policy or practice based on their focus naturally leads to some division in findings. What is concerning, however, is the clear lack of overlap between those categories. The fact that we can so cleanly split these studies speaks to the divide in research on turnaround. Other than a handful, none of the policy-relevant studies spoke to implications for school or district leaders. Similarly, very few of the practice pieces had findings relevant to student outcomes or macro-level policy. Limitations Twelve policy and six practice studies did not identify any study limitations (see Table 5 for our categorization). All of the remaining articles identified limitations pertaining to the design of their methodological approach. These included issues such as generalizability/small sample sizes (see Hochbein & Carpenter, 2017; Strunk et al., 2016a for examples), the role of selection bias (see Yoon & Barton, 2019 as an example), and unobservable factors (see Gandhi et al., 2018 as an example). The level of focus on limitations varied noticeably across studies, with some noting the lack of generalizability quickly and broadly while others provided detailed explanations about how selection bias existed within the study and why it should inform our interpretation. No concerning or particularly relevant differences across the two groups of studies, however, emerged when analyzing this section of the papers. Yet, in this case, the similarities are noteworthy for at least two reasons. First, for such drastically different studies to be relatively similar calls into question how deeply researchers are considering limitations. Second, and perhaps more importantly, none of the studies regardless of designation consider the lack of the other (i.e., practice without policy or policy without practice) as a limitation. Table 5 Categorization of Limitations Policy None identified Abdulkadiroğlu et al. (2016); Atchison (2020); Carlson & Lavertu (2018); Dougherty & Weiner (2019); Hamilton et al. (2014); Hochbein et al. (2013); Mette (2014); VanGronigen & Meyers (2019); Welsh (2019); Welsh & Williams (2018); Welsh et al. (2019); Zimmer et al. (2017) Design Dragoset et al. (2019); Gandhi et al. (2018); Heissel & Ladd (2018); Hochbein (2012); Hochbein & Carpenter (2017); Marsh et al. (2012); Meyers et al. (2012); Player & Katz (2016); Schueler et al. (2017); Strunk et al. (2016a); Strunk et al. (2016b); Stuit (2012); Sun et al. (2017) Generalizability Heissel & Ladd (2018); Hochbein & Carpenter (2017); Marsh et al. (2012);Schueler (2019); Strunk et al. (2016a); Strunk et al. (2016b); Unobservable factors Gandhi et al. (2018); Schueler (2019); Schueler et al. (2017); Strunk et al. (2016a); Strunk et al. (2016b); Thompson et al. (2016) Selection bias Dragoset et al. (2019); Gandhi et al. (2018) Practice None identified Bonda & Mitchell (2015); Clifford (2013); Duke & Salmonowicz (2010); Hewitt& Reitzug (2015); May & Sanders (2013); Mette (2013) School Turnaround Lessons for Policy and Practice 15 Policy Design Brown et al. (2017); Cucchiara et al. (2015); Hitt et al. (2018); Hitt et al. (2019);Pulliam et al. (2014); Yoon & Barton (2019) Generalizability Cucchiara et al. (2015); Duke & Landahl (2011); Hitt et al. (2019); Mette & Stanoch (2016); Pulliam et al. (2014); Reitzug & Hewitt (2017); Yoon & Barton (2019) Unobservable factors Cucchiara et al. (2015) Selection bias Yoon & Barton (2019) Policy–Practice Overlap When conducting our evaluation, we quickly realized that the ways in which the strands of literature “spoke” to each were thin. We show our results in Table 6. Nine of the policy studies did not prioritize or consider issues of practice at all. Another 17 of the policy studies included practice as part of a literature review or policy overview. In other words, terms such as school accountability, turnaround, School Improvement Grants, and others were described to varying degrees as parts of article introductions, research review sections, or context in research design. As previously described, most policy pieces were evaluations of policies in which the principal is central. Thus, the role of principal was discussed in terms of the policy (e.g., Heissel and Ladd, 2018). Six articles included practice in their analyses and eight articles included practice results. Of those, principal practice was typically a secondary or tertiary consideration and the depth of data and their analysis were reflected in limited reporting of leadership practice results. Only three policy articles (Marsh et al., 2012; Mette, 2014; Schueler, 2019) detailed practice considerations in the overview, analysis, and results sections. The same basic pattern exists for studies designated as practice. Six of them did not prioritize or consider policy at all. Eleven practice articles included policy in literature review and/or contextual overview. That is, many of the practice articles that focused on turnaround principal/leadership set the stage for the study by noting the study was conducted in a school identified as turnaround or in need of turnaround. No practice study, however, specified how policy was included or considered in data analysis. Only three practice studies (Bonda & Mitchell, 2015; Mette, 2013; Mette & Stanoch, 2016) included policy as a result or finding. Table 6 Categorization of Policy-Practice Overlap Policy Practice not prioritized or considered Abdulkadiroğlu et al. (2016); Hochbein (2012); Hochbein et al. (2013); Meyers et al. (2012); Stuit (2012); VanGronigen & Meyers (2019); Welsh (2019); Welsh et al. (2019); Zimmer et al. (2017) Education Policy Analysis Archives Vol. 30 No. X 16 Practice as part of literature and/or policy overview Atchison (2020); Carlson & Lavertu (2018); Dougherty & Weiner (2019); Hamilton et al. (2014); Heissel & Ladd (2018); Hochbein & Carpenter (2017); Marsh et al. (2012); Mette (2014); Player & Katz (2016); Schueler (2019); Schueler et al. (2017); Strunk et al. (2016a); Strunk et al. (2016b); Sun et al. (2017); Welsh & Williams (2018) Practice included in analysis Atchison (2020); Dragoset et al. (2019); Hamilton et al. (2014); Marsh et al. (2012); Mette (2014); Schueler (2019) Practice included as a result or finding Gandhi et al. (2018); Marsh et al. (2012); Mette (2014); Schueler (2019); Schueler et al. (2017); Strunk et al. (2016a); Strunk et al. (2016b); Thompson et al. (2016) Practice Policy not or prioritized or considered Duke & Salmonowicz (2010); Hitt et al. (2018); Hitt et al. (2019); Mette & Stanoch (2018); Meyers & Sadler (2018); Yoon & Barton (2019) Policy as part of literature and/or contextual overview Bonda & Mitchell (2015); Brown et al. (2017); Clifford (2013); Cucchiara et al. (2015); Duke & Landahl (2011); Hewitt & Reitzug (2015); May & Sanders (2013); Mette (2013); Mette & Stanoch (2016); Pulliam et al. (2014); Reitzug & Hewitt (2017) Policy included as a result or finding Bonda & Mitchell (2015); Mette (2013); Mette & Stanoch (2016) Lessons and/or Directions for Future Work Most studies across both the policy and practice groups offered ways to extend the existing research (results in Table 7). Eight studies were an exception to this and should be highlighted for clear difference. That is, only three policy studies did not identify any next steps whereas five practice studies did not. Not surprisingly, each set of studies was more likely to highlight lessons mapping back to their categorizations. Seventeen policy studies offered lessons or recommendations for policy but only seven did so for practice. Inversely, 10 practice studies offered lessons or recommendations for practice but only four did so for policy. Both sets of studies made notable research recommendations—25 studies total, 16 designated as policy studies and another nine designated as research studies. In general, policy studies that suggested research recommendations focused on issues such as more evaluations on the topic. Practice articles focused more on researching additional sites to build a knowledge base on how to lead turnaround. This was the most notable difference between policy and practice pieces on the topic of directions for future work. Table 7 Categorization of Directions/Lessons for Future Work Policy School Turnaround Lessons for Policy and Practice 17 Nothing identified Abdulkadiroğlu et al. (2016); Dragoset et al. (2019); Stuit (2012) Lessons or recommendations for policy Dougherty & Weiner (2019); Hamilton et al. (2014); Heissel & Ladd (2018); Hochbein (2012); Hochbein & Carpenter (2017); Hochbein et al. (2013); Marsh et al. (2012); Meyers et al. (2012); Strunk et al. (2016a); Strunk et al. (2016b); Sun et al. (2017); VanGronigen & Meyers (2019); Welsh (2019); Welsh & Williams (2018); Welsh et al. (2019); Zimmer et al. (2017) Lessons or recommendations for practice Gandhi et al. (2018); Hamilton et al. (2014); Marsh et al. (2012); Mette (2014); Schueler (2019); Strunk et al. (2016a); Thompson et al. (2016) Lessons or recommendations for research Atchison (2020); Carlson & Lavertu (2018); Gandhi et al. (2018); Heissel & Ladd (2018); Hochbein (2012); Hochbein & Carpenter (2017); Marsh et al. (2012); Player & Katz (2016); Schueler (2019); Schueler et al. (2017); Strunk et al. (2016a); Strunk et al. (2016b); VanGronigen & Meyers (2019); Welsh (2019); Welsh et al. (2019) Practice Nothing identified Bonda & Mitchell (2015); Clifford (2013); Duke & Landahl (2011); Duke& Salmonowicz (2010); Mette (2013) Lessons or recommendations for policy Cucchiara et al (2015); Mette & Stanoch (2016); Meyers & Sadler (2018); Pulliam et al. (2014) Lessons or recommendations for practice Brown et al. (2019); Cucchiara et al. (2015); Hewitt & Reitzug (2015); Hitt et al. (2018); Hitt et al. (2019); Mette & Stanoch (2016); Meyers & Sadler (2018); Pulliam et al. (2014); Reitzug & Hewitt (2017); Yoon & Barton (2019) Lessons or recommendations for research Cucchiara et al. (2015); Hewitt & Reitzug (2015); Hitt et al. (2018); Hitt et al. (2019); May & Sanders (2013); Mette & Stanoch (2016); Meyers & Sadler (2018); Pulliam et al. (2014); Yoon & Barton (2019) Discussion For this article, we systematically reviewed empirical studies of school turnaround. The results show two distinct strands, one focusing on policy and the other on practice. Approximately twice the number of studies have been conducted in or on policy than practice, yet each is significant enough to be analyzed. From our analysis, we illustrate that the two strands of literature seldom—and even then, only superficially—interact. That is, school turnaround policy evaluation advances little on the practice side and the practice research addresses school turnaround policy only as study context. The implications of this separation are substantial. We now highlight some of the most important ones. Perhaps the most glaring implication of our analysis is how much the field’s collective learning is impeded by the separation of research. Policy studies, for example, are designed Education Policy Analysis Archives Vol. 30 No. X 18 primarily to evaluate whether a policy did or did not have impact, which has typically been defined as student achievement outcomes. It follows that if a policy is designed with increases in student achievement outcomes as the goal, analyzing to measure whether those impacts were achieved or not is not only practical but necessary. Yet, a substantial body of research suggests that the principal is critically important to increasing student achievement (Grissom et al., 2021; Louis et al., 2010). The federal practice guide on school turnaround (Herman et al., 2008) underscored how important school leadership is to achieving school turnaround. Moreover, the three turnaround policy options in SIG besides school closure all emphasized the importance of changing leadership practices, including in many cases terminating the current principal (Meyers, 2012). Thus, the very turnaround policies that are being evaluated hold the principal as a critical lynchpin for improvement. To evaluate the impact of the policy on student achievement outcomes alone or by including leadership as a relatively simplified—and maybe minimalized—explanatory variable negates our ability to learn critical lessons for both school leadership policy and practice in turnaround settings. Relatedly, turnaround practice studies missed key opportunities to extend our understanding about how turnaround policy actually works on the ground. The practice studies we reviewed consistently detailed school turnaround policy in the front matter, including the introduction, literature review, and/or policy/conceptual framework. Researchers recognized that policy influences mattered for the context of their leadership studies. Few, however, made any substantial effort to write about how the policy contexts actually influenced principal knowledge, understanding, and/or behavior. Moreover, seldom did researchers return to policy considerations in their discussions, which tend to be the sections that allow for more freedom to consider implications and possibilities. In other words, researchers examining turnaround practice almost never connected their findings to policy or offered policy considerations that could further advance practice. As a result of the previous two points, we wonder about how policies and policymakers, funders, and incentive structures merge to unintentionally undermine more robust research and policy analysis. A number of school turnaround policies identify change in leadership as critical but do not embed measuring or understanding how leadership changed or how those changes in leadership impacted other outcomes, such as student achievement. It is unsurprising, then, that many policy evaluations do not include more extensive measures of leadership or include qualitative methods of inquiry to learn more about principals in turnaround policy contexts. Funding structures also matter on this point. Many of the policy evaluations have been financed by the federal government or state or local education agencies. These entities—in alignment with expectations embedded in a school accountability era—have funded studies to evaluate policy impacts on student achievement while seldom explicitly calling for inquiry into school leaders (Herman et al., 2017). In the articles we reviewed, we were unable to find any instance of education leadership researchers more focused on practice indicating that they had received external funding to study school principals and leaders or turnaround processes within schools. In sum, there is considerable opportunity to rethink school turnaround and the notion of improving underperforming schools rapidly. Both policy and practice have clearly identified leadership and student achievement outcomes as critical. We contend that policymakers, funders, leaders of colleges of education, and scholars studying school turnaround should reconsider how to embed interdisciplinary work into how they operate. There are clear opportunities to share different conceptualizations and epistemologies on the front end; consider alternative methodologies for more robust learning; and prioritize policy and practice lessons regardless of School Turnaround Lessons for Policy and Practice 19 the research and methodological interests at the heart of the study. For example, achieving rapid increases in student achievement and sustaining them likely requires policy not only focused on disruption, but also on engaging community. Understanding the impact of turnaround policy likely cannot be limited to a quasi-experimental design but also necessitates qualitative inquiry into understanding what changed and why. The goals of turnaround policy evaluation should go beyond whether or not fairly immediate increases in student achievement occurred, but to do so, research teams must be designed on the front end to not analyze impact and implementation data only. Ethnographers, critical race scholars, community and family engagement researchers, and others should be engaged at the outset to understand the nuance of turnaround policy when converted to practice and lived experience. Without a significantly more strategic study of school turnaround—and many other educational issues, for that matter—it seems unlikely for us to develop the robust understanding of challenges that we need to make greater, lasting improvement. References References marked with an asterisk (*) indicate studies included in the meta-analysis. *Abdulkadiroğlu, A., Angrist, J. D., Hull, P. D., & Pathak, P. A. (2016). Charters without lotteries: Testing takeovers in New Orleans and Boston. American Economic Review, 106(7), 1878–1920. https://doi.org/10.1257/aer.20150479 *Atchison, D. (2020). The impact of priority school designation under ESEA flexibility in New York State. Journal of Research on Educational Effectiveness,13(1), 121–146. https://doi.org/10.1080/19345747.2019.1679930 *Bonda, N., & Mitchell, E. (2015). School district turnaround: Leadership development as the nexus of change. European Journal of Educational Sciences,2(1), 55–72. https://files.eric.ed.gov/fulltext/EJ1236574.pdf *Brown, K. M., Thompson, C., Townsend, L., & Roney, K. (2017). Turning around high schools via “Scaffolded Craftmanship.” Journal of InstructionalPedagogies, 18, 1–29. https://files.eric.ed.gov/fulltext/EJ1182718.pdf Calkins, A., Guenther, W., Belfiore, G., & Lash, D. (2007). The turnaround challenge: Why America’s best opportunity to dramatically improve student achievement lies in our worst-performing schools. Mass Insight Education (NJ1). *Carlson, D., & Lavertu, S. (2018). School Improvement Grants in Ohio: Effects on student achievement and school administration. Educational Evaluation and Policy Analysis, 40(3), 287–315. https://doi.org/10.3102/0162373718760218 *Clifford, M. (2013). Learning to lead school turnaround: The Mississippi LEADS professional development model. Cypriot Journal of EducationalSciences, 8(1), 49–62. *Cucchiara, M. B., Rooney, E., & Roberston-Kraft, C. (2015). “I’ve never seen people work so hard!”: Teachers’ working conditions in the early stages of school turnaround. Urban Education, 50(3), 259–287. https://doi.org/10.1177/0042085913501896 Dee, T. (2012). School turnarounds: Evidence from the 2009 stimulus (No. w17990). National Bureau of Economic Research. *Dougherty, S. M., & Weiner, J. M. (2019). The Rhode to turnaround: The impact of waivers to No Child Left Behind on school performance. Educational Policy, 33(4), 555–586. https://doi.org/10.1177/0895904817719520 *Dragoset, L., Thomas, J., Herrmann, M., Deke, J., James-Burdumy, S., & Luca, D. L. (2019). The impact of School Improvement Grants on student outcomes: Findings from a national https://doi.org/10.1257/aer.20150479 https://doi.org/10.1080/19345747.2019.1679930 https://files.eric.ed.gov/fulltext/EJ1236574.pdf https://files.eric.ed.gov/fulltext/EJ1182718.pdf https://doi.org/10.3102/0162373718760218 https://doi.org/10.1177/0042085913501896 https://doi.org/10.1177/0895904817719520 Education Policy Analysis Archives Vol. 30 No. X 20 evaluation using a regression discontinuity design. Journal of Research on Educational Effectiveness, 12(2), 215–250. https://doi.org/10.1080/19345747.2019.157654 *Duke, D. L., & Landahl, M. (2011). “Raising test scores was the easy part”: A case study of the third year of school turnaround. International Studies in Educational Administration, 39(3), 91–114. *Duke, D. L., & Salmonowicz, M. (2010). Key decisions of a first-year “turnaround” principal. Educational Management Administration & Leadership 38(1), 33–58. https://doi.org/10.1177/1741143209345450 Emma, C. (2015). Here’s why $7 billion didn’t help America’s worst schools. POLITICO. Every Student Succeeds Act, 20 U.S.C. § 6301 (2015). *Gandhi, A. G., Slama, R., Park, S. J., Russo, P., Winner, K., Bzura, R., Jones, W., & Williamson, S. (2018). Focusing on the whole student: An evaluation of Massachusetts’s Wraparound Zone Initiative. Journal of Research on EducationalEffectiveness, 11(2), 240–266. https://doi.org/10.1080/19345747.2017.1413691 Grissom, J. A., Egalite, A. J., & Lindsay, C. A. (2021). How principals affect students and schools: A systematic synthesis of two decades of research.Wallace Foundation. https://www.wallacefoundation.org/knowledge-center/Documents/How-Principals-Affec t-Students-and-Schools.pdf *Hamilton, M. H., Helig, J. V., & Pazey, B. L. (2014). A nostrum of school reform? Turning around reconstituted urban Texas high schools. Urban Education, 49(2), 182–215. https://doi.org/10.1177/0042085913475636 Hargreaves, A. (1996). Transforming knowledge: Blurring the boundaries between research, policy, and practice. Educational Evaluation and Policy Analysis, 18(2), 105–122. https://doi.org/10.3102/01623737018002105 *Heissel, J. A., & Ladd, H. F. (2018). School turnaround in North Carolina: A regression discontinuity analysis. Economics of Education Review,62, 302–320. https://doi.org/10.1016/j.econedurev.2017.08.001 Herman, R., Dawson, P., Dee, T., Greene, J., Maynard, R., Redding, S., & Darwin, M. (2008). Turning around chronically low-performing schools: A practice guide (NCEE #2008-4020). National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. http://ies.ed.gov/ncee/wwc/practiceguides. Herman, R., Gates, S. M., Arifkhanova, A., Barrett, M., Bega, A., Chavez-Herrerias, E. R., Han, E., Harris, M., Migacheva, K., Ross, R., Leschitz, J. T., & Wrabel, S. L. (2017). School leadership interventions under the Every Student Succeeds Act: Evidence review (RR-1550-3-WF). RAND Corporation. *Hewitt, K. K., & Reitzug, U. (2015). Portrait of a turnaround leader in a high needs district. NCPEA Education Leadership Review, 16(2), 19–35. https://files.eric.ed.gov/fulltext/EJ1105472.pdf Hitt, D. H., & Meyers, C. V. (2018). Beyond turnaround: A synthesis of relevant frameworks for leaders of sustained improvement in previously low-performing schools. School Leadership & Management, 38(1), 4–31. https://doi.org/10.1080/13632434.2017.1374943 *Hitt, D. H., Meyers, C. V., Woodruff, D., & Zhu, G. (2019). Investigating the relationship between turnaround principal competencies and student achievement. NASSP Bulletin, 103(3), 189–208. https://doi.org/10.1177/0192636519871618 *Hitt, D. H., Woodruff, D., Meyers, C.V., & Zhu, G. (2018). Principal competencies that make a difference: Identifying a model for leaders of school turnaround. Journal of School Leadership, 28(1), 56–81. https://doi.org/10.1177/105268461802800103 https://doi.org/10.1080/19345747.2019.157654 https://doi.org/10.1177/1741143209345450 https://doi.org/10.1080/19345747.2017.1413691 https://www.wallacefoundation.org/knowledge-center/Documents/How-Principals-Affect-Students-and-Schools.pdf https://www.wallacefoundation.org/knowledge-center/Documents/How-Principals-Affect-Students-and-Schools.pdf https://doi.org/10.1177/0042085913475636 https://doi.org/10.3102/01623737018002105 https://doi.org/10.1016/j.econedurev.2017.08.001 http://ies.ed.gov/ncee/wwc/practiceguides https://files.eric.ed.gov/fulltext/EJ1105472.pdf https://doi.org/10.1080/13632434.2017.1374943 https://doi.org/10.1177/0192636519871618 https://doi.org/10.1177/105268461802800103 School Turnaround Lessons for Policy and Practice 21 *Hochbein, C. (2012). Relegation and reversion: Longitudinal analysis of school turnaround and decline. Journal of Education for Students Placedat Risk (JESPAR), 17(1–2), 92–107. https://doi.org/10.1080/10824669.2012.636728 *Hochbein, C., & Carpenter, B. (2017). Teacher migration: Extension and application of the population ecology model to explore teacher transfers in a reform environment. Education and Urban Society, 49(5), 459–485. https://doi.org/10.1177/0013124516644048 *Hochbein, C., Mitchell, A. M., & Pollio, M. (2013). Gamed by the system: Adequate Yearly Progress as an indicator of persistently low-achieving school performance. NASSP Bulletin, 97(3), 270–289. https://doi.org/10.1177/0192636513479139 Le Floch, K. C., Birman, B., O’Day, J., Hurlburt, S., Mercado-Garcia, D., Goff, R.,. . . & Hulsey, L. (2014). Case studies of schools receiving School ImprovementGrants: Findings after the first year of implementation (NCEE 2014-4015). National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. Louis, K. S., Leithwood, K., Wahlstrom, K. L., & Anderson, S. E. (2010). Investigating links to improved student learning: Final report of research findings.Wallace Foundation. https://www.wallacefoundation.org/knowledge-center/Documents/Investigating-the-Lin ks-to-Improved-Student-Learning.pdf *Marsh, J. A., Strunk, K. O., & Bush, S. (2012). Portfolio district reform meets school turnaround: Early implementation findings from the Los Angeles Public School Choice Initiative. Journal of Educational Administration, 51(4), 498–527. https://doi.org/10.1108/09578231311325677 *May, J. J., & Sanders, E. T. W. (2013). Beyond standardized test scores: An examination of leadership and climate as leading indicators of future success in the transformation of turnaround schools. Journal of Urban Learning, Teaching,and Research, 9, 42–54. https://files.eric.ed.gov/fulltext/EJ1028857.pdf *Mette, I. (2014). Turnaround reform efforts in a rural context: How community and culture impact change. Rural Educator, 35(3), 1–10. https://files.eric.ed.gov/fulltext/EJ1225570.pdf *Mette, I. M. (2013) Turnaround as reform: Opportunity for meaningful change or neoliberal posturing? Interchange: A Quarterly Review of Education,43(4), 317–342. https://link.springer.com/article/10.1007%2Fs10780-013-9181-3 *Mette, I. M., & Stanoch, J. (2016). School turnaround: A rural reflection of reform on the reservation and lessons for implementation. Rural Educator, 37(2), 39–50. https://doi.org/10.35608/ruraled.v37i2.270 *Meyers, C. V., & Sadler, J. (2018). District leaders engaged in school turnaround: Identified challenges and espoused responses. NASSP Bulletin, 102(2), 89–110. https://doi.org/10.1177/0192636518786008 Meyers, C. V., & Smylie, M. (2017). The myths of school turnaround policy and practice. Leadership and Policy in Schools, 16(3), 502–523. https://doi.org/10.1080/15700763.2016.1270333 Meyers, C. V., Brandt, W. C., & VanGronigen, B. A. (2022). State ESSA plans and Comprehensive Support and Improvement (CSI) status. Educational Policy, https://doi.org/10.1177/0895904812467081. *Meyers, C. V., Lindsay, J., Condon, C., & Wan, Y. (2012). A statistical approach to identifying schools demonstrating substantial improvements in student learning. What does it mean to be a school in need of turnaround? [Special Issue]. Journal of Education for Students Placed at Risk, 17(1), 1–22. https://doi.org/10.1080/10824669.2012.636703 Murphy, J. F., & Bleiberg, J. F. (2019). School turnaround policies and practices in the US. Springer. https://doi.org/10.1080/10824669.2012.636728 https://doi.org/10.1177/0013124516644048 https://doi.org/10.1177/0192636513479139 https://www.wallacefoundation.org/knowledge-center/Documents/Investigating-the-Links-to-Improved-Student-Learning.pdf https://www.wallacefoundation.org/knowledge-center/Documents/Investigating-the-Links-to-Improved-Student-Learning.pdf https://doi.org/10.1108/09578231311325677 https://files.eric.ed.gov/fulltext/EJ1028857.pdf https://files.eric.ed.gov/fulltext/EJ1225570.pdf https://link.springer.com/article/10.1007%2Fs10780-013-9181-3 https://doi.org/10.35608/ruraled.v37i2.270 https://doi.org/10.1177/0192636518786008 https://doi.org/10.1080/15700763.2016.1270333 https://doi.org/10.1177/0895904812467081 https://doi.org/10.1080/10824669.2012.636703 Education Policy Analysis Archives Vol. 30 No. X 22 Murphy, J., & Meyers, C. V. (2008). Turning around failing schools: Leadership lessons from the organizational sciences. Corwin Press. No Child Left Behind Act of 2001, P.L. 107-110, 20 U.S.C. § 6319 (2002). Peck, C., & Reitzug, U. C. (2014). School turnaround fever: The paradoxes of a historical practice promoted as a new reform. Urban Education, 49(1), 8–38. https://doi.org/10.1177/0042085912472511 Pham, L. D., Henry, G. T., Kho, A., & Zimmer, R. (2020). Sustainability and maturation of school turnaround: A multiyear evaluation of Tennessee’s Achievement School District and local Innovation Zones. AERA Open, 6(2). https://doi.org/10.1177/2332858420922841 *Player, D., & Katz, V. (2016). Assessing school turnaround: Evidence from Ohio. The Elementary School Journal, 116(4), 675–698. https://doi.org/10.1086/686467 *Pulliam, C. L., LaCaria, L., Schoeneberger, J., & Algozzine, B. (2014). A preliminary analysis of a strategic staffing initiative. Educational Policy, 28(4), 578–603. https://doi.org/10.1177/0895904812467081 Redding, C., & Nguyen, T. D. (2020). The relationship between school turnaround and student outcomes: A meta-analysis. Educational Evaluation and Policy Analysis, 42(4), 493–519. https://doi.org/10.3102/0162373720949513 *Reitzug, U. C., & Hewitt, K. K. (2017). “The click-clack of her heels and the jingle of her keys”: Exploring the tensions in the leadership of a successful turnaround principal. Journal of School Leadership, 27(4), 491–520. https://doi.org/10.1177/105268461702700402 Schmidt-Davis, J., & Bottoms, G. (2012). Turnaround High School Principals: Recruit, Prepare and Empower Leaders of Change. Southern Regional Education Board (SREB). *Schueler, B. E. (2019). A third way: The politics of school district takeover and turnaround in Lawrence, Massachusetts. Educational Administration Quarterly, 55(1), 116–153. https://doi.org/10.1177/001316X18785873 *Schueler, B. E., Goodman, J. S., & Deming, D. J. (2017). Can states take over and turn around school districts? Evidence from Lawrence, Massachusetts. Educational Evaluation and Policy Analysis, 39(2), 311–332. https://doi.org/10.3102/1062373716685824 *Strunk, K. O., Marsh, J. A., Hashim, A. K., & Bush-Mecenas, S. (2016a). Innovation and a return to the status quo: A mixed-methods study of school reconstitution. Educational Evaluation and Policy Analysis, 38(3), 549–577. https://doi.org/10.3102/0162373716642517 *Strunk, K. O., Marsh, J. A., Hashim, A. K., Bush-Mecenas, S. & Weinstein, T. (2016b). The impact of turnaround reform on student outcomes: Evidence and insights from the Los Angeles Unified School District. Education Finance and Policy, 11(3), 251–282. https://doi.org/10.1162/EDFP_a_00188 *Stuit, D. (2012). Turnaround and closure rates in the charter and district sectors. [Special Issue]. Journal of Education for Students Placed at Risk, 17(1), 40–54. https://doi.org/10.1080/10824669.2012.637032 *Sun, M., Penner, E. K., & Loeb, S. (2017). Resource- and approach-driven multidimensional change: Three-year effects of School Improvement Grants. American Educational Research Journal, 54(4), 607–643. https://doi.org/10.3102/0002831217695790 *Thompson, C. L., Henry, G. T., & Preston, C. (2016). School turnaround through scaffolded craftsmanship. Teachers College Record, 118(13), 1–26. https://www.tcrecord.org/Content.asp?ContentId=20554 *VanGronigen, B. A., & Meyers, C. V. (2019). How state education agencies are administering school turnaround efforts: 15 years after No Child Left Behind. Educational Policy, 33(3), 423–452. https://doi.org/10.1177/0895904817691846 https://doi.org/10.1177/0042085912472511 https://doi.org/10.1177/2332858420922841 https://doi.org/10.1086/686467 https://doi.org/10.1177/0895904812467081 https://doi.org/10.3102/0162373720949513 https://doi.org/10.1177/105268461702700402 https://doi.org/10.1177/001316X18785873 https://doi.org/10.3102/1062373716685824 https://doi.org/10.3102/0162373716642517 https://doi.org/10.1162/EDFP_a_00188 https://doi.org/10.1080/10824669.2012.637032 https://doi.org/10.3102/0002831217695790 https://www.tcrecord.org/Content.asp?ContentId=20554 https://doi.org/10.1177/0895904817691846 School Turnaround Lessons for Policy and Practice 23 *Welsh, R. O. (2019). Recovery, achievement, and opportunity: A comparative analysis of state takeover districts in Louisiana, Tennessee, and Georgia. Urban Education, 54(3), 311–338. https://doi.org/10.1177/0042085918801884 *Welsh, R. O., & Williams, S. M. (2018). Incentivizing improvement or imposition? An examination of the response to gubernatorial school takeover and statewide turnaround districts. Education Policy Analysis Archives, 26(124), 1–32. https://doi.org/10.14507/epaa26.3679 *Welsh, R. O., Williams, S., Little, S., & Graham, J. (2019). Right cause, wrong method? Examining the politics of state takeover in Georgia. Urban Affairs Review, 55(3), 703–742. https://doi.org/10.1177/1078087417714061 Ylimaki, R. M., Brunderman, L., Bennett, J. V., & Dugan, T. (2014). Developing Arizona turnaround leaders to build high-capacity schools in the midst of accountability pressures and changing demographics. Leadership and Policy in Schools, 13(1), 28–60. https://doi.org/10.1080/15700763.2014.884226 *Yoon, I. H., & Barton, A. (2019). Turnaround leaders’ shifting gears in chronos and kairos time. Journal of Educational Administration, 57(6), 690–707. https://doi.org/10.1108/JEA-08-2018-0139 *Zimmer, R., Henry, G. T., & Kho, A. (2017). The effects of school turnaround in Tennessee’s Achievement School District and Innovation Zones. Educational Evaluation and Policy Analysis, 39(4), 670–696. https://doi.org/10.3102/0162373717705729 About the Authors Aliza N. Husain Pivot Learning alizahusain@gmail.com https://orcid.org/0000-0002-8819-0229 Aliza N. Husain is Director of Research and Evaluation at Pivot Learning. Her research focuses using large-scale data and quantitative methods to measure and evaluate principal effects and quality. https://doi.org/10.1177/0042085918801884 https://doi.org/10.14507/epaa26.3679 https://doi.org/10.1177/1078087417714061 https://doi.org/10.1080/15700763.2014.884226 https://doi.org/10.1108/JEA-08-2018-0139 https://doi.org/10.3102/0162373717705729 mailto:alizahusain@gmail.com https://orcid.org/0000-0002-8819-0229 Education Policy Analysis Archives Vol. 30 No. X 24 Coby V. Meyers University of Virginia cvm2x@virginia.edu https://orcid.org/0000-0002-0394-2613 Coby V. Meyers is Chief of Research of the Darden/Curry Partnership for Leaders in Education (PLE) and an associate professor in the Curry School of Education at the University of Virginia. Dr. Meyers’s research focuses on understanding the role of school system leadership, especially in the context of improving the nation’s lowest-performing schools. Corrie Stone-Johnson University at Buffalo, State University of New York corriest@buffalo.edu http://orcid.org/0000-0002-1463-7198 Corrie Stone-Johnson is an associate professor in educational administration in the Department of Educational Leadership and Policy at the University at Buffalo, State University of New York. Her research focuses on school leadership, leadership preparation, and educational change. She is the Editor-in-Chief of the Journal of Educational Change. education policy analysis archives Volume 30 Number 147 October 11, 2022 ISSN 1068-2341 Readers are free to copy, display, distribute, and adapt this article, as long as the work is attributed to the author(s) and Education Policy Analysis Archives, the changes are identified, and the same license applies to the derivative work. More details of this Creative Commons license are available at https://creativecommons.org/licenses/by-sa/4.0/. EPAA is published by the Mary Lou Fulton Teachers College at Arizona State University. Articles are indexed in CIRC (Clasificación Integrada de Revistas Científicas, Spain), DIALNET (Spain), Directory of Open Access Journals, EBSCO Education Research Complete, ERIC, Education Full Text (H.W. Wilson), QUALIS A1 (Brazil), SCImago Journal Rank, SCOPUS, SOCOLAR (China). About the Editorial Team: https://epaa.asu.edu/ojs/index.php/epaa/about/editorialTeam Please send errata notes to Audrey Amrein-Beardsley at audrey.beardsley@asu.edu Join EPAA on Facebook at https://www.facebook.com/EPAAAAPE and Twitter feed @epaa_aape. mailto:cvm2x@virginia.edu https://orcid.org/0000-0002-0394-2613 mailto:corriest@buffalo.edu http://orcid.org/0000-0002-1463-7198 https://creativecommons.org/licenses/by-sa/4.0/ http://www.doaj.org/ https://epaa.asu.edu/ojs/index.php/epaa/about/editorialTeam mailto:audrey.beardsley@asu.edu https://www.facebook.com/EPAAAAPE