TOWARDS AN OBJECTIVE EVALUATION OF TEACHER PERFORMANCE Readers are free to copy, display, and distribute this article, as long as the work is attributed to the author(s) and Education Policy Analysis Archives (Archivos Analíticos de Políticas Educativas), it is distributed for non-commercial purposes only, and no alteration or transformation is made in the work. More details of this Creative Commons license are available at http://creativecommons.org/licenses/by-nc-nd/2.5/. All other uses must be approved by the author(s) or EPAA/AAPE. EPAA/AAPE is published jointly by the Colleges of Education at Arizona State University and the University of South Florida. Articles are indexed by the Directory of Open Access Journals, H.W. Wilson & Co., and SCOPUS. EDUCATION POLICY ANALYSIS ARCHIVES English Editor: Sherman Dorn Spanish Editor: Gustavo Fischman College of Education Mary Lou Fulton College of Education University of South Florida Arizona State University Volume 17 Number 23 December 4, 2009 ISSN 1068–2341 Contextual Influences on Superintendents' Time Usage Kim Jones Trimble Local Schools Aimee Howley Ohio University Citation: Jones, K., & Howley, A. (2009). Contextual influences on superintendents’ time usage. Education Policy Analysis Archives, 17(23). Retrieved [date] from http://epaa.asu.edu/epaa/v17n23/. Abstract Using data from a survey of superintendents in four states, this study explored how contextual factors and the real and perceived stringency of accountability measures influence the attention superintendents pay to the different roles comprising their work. A major concern was the extent to which stringent accountability was associated with superintendents’ tendency to emphasize educational leadership rather than managerial functions. Recognizing that other circumstances also might contribute to superintendents’ decisions about how to balance their work, the study included five contextual variables: enrollment, locale, SES, funding, and percentage minority. From a sample of 941 superintendents, 68% returned questionnaires. Findings: although superintendents’ perceptions of the stringency of state accountability measures were related to their location in high- or low-stringency states, contextual factors and especially enrollment and the location of a district in a rural region had the most pronounced effects on their attention to managerial tasks. Allocation of time varied by state; however, across states very few superintendents’ devoted the majority of their time to educational leadership. Keywords: educational leadership; role conflict; accountability; rural schooling. Education Policy Analysis Archives Vol. 17 No. 23 2 Influencias contextuales sobre el uso de tiempo de los superintendents Resumen Utilizando datos de una encuesta con superintendentes en cuatro estados, este estudio investigó cómo los factores contextuales, percepciones acerca del rigor de las medidas de rendición de cuentas influyeron en los niveles de atención que superintendentes dieron a las distintas funciones de su trabajo. Una preocupación importante fue entender en que medida los modelos de “rendición de cuentas estrictos” se asociaron con la tendencia de los superintendentes, para subrayar el liderazgo educativo en vez de funciones de gestión. Reconociendo que otras variables también podría contribuir a las decisiones de los superintendentes sobre la manera de equilibrar su trabajo, este estudio incluyó cinco variables contextuales: matriculación, localización, situación socioeconómica, financiación y porcentaje de minorías. De una muestra de 941 superintendentes, 68% respondieron los cuestionarios recibidos. Conclusiones: a pesar de las percepciones de los superintendentes acerca de la severidad de las medidas de rendición de cuentas del estado estaban relacionadas con su ubicación en estados de alto o bajo de rigor, los factores contextuales y, especialmente, la matriculación y la ubicación en una región rural mostraban los efectos más pronunciados en la atención a tareas de gestión. La asignación de tiempo vario de estado a estado, sin embargo, en todos los estados muy pocos superintendentes dedicaron la mayor parte de su tiempo al liderazgo educativo. Palabras clave: liderazgo educativo; conflicto de funciones; responsabilidad; educación rural. Introduction The role of the public school superintendent is both challenging and varied, and it has been that way for quite some time (Callahan, 1962; Owen, 1998). In recent years, accountability requirements and increased standardization associated with the No Child Left Behind Act (NCLB) may have added to the complexity of the role (Farkas, Johnson, & Duffett, 2003). But little research has explored the influence of such requirements or the impact of their perceived stringency on the work lives of superintendents. Moreover, only a few recent studies have examined the association between contextual factors and superintendents’ performance of their roles, and to our knowledge no study has investigated the relationship between these contextual factors and superintendents’ perceptions of the stringency of accountability requirements. Nevertheless, speculation based on prior research suggests that contextual factors and the stringency of accountability measures—real, perceived, or both—might combine in certain ways to influence the attention superintendents pay to the different roles comprising their work. In this study we explore these relationships through a series of quantitative analyses using data from four states, two of which have stringent accountability requirements and two of which have lenient accountability requirements. These analyses gave us the basis for answering several research questions pertinent to an understanding of superintendents’ work in the age of accountability. As discussed below, we used allocation of time as a proxy measure of superintendents’ attention to certain roles. First, we asked how superintendents allocate their time across managerial, educational, and political roles. Next, we investigated the relationship between location in a state with stringent or lenient accountability and superintendents’ perceptions of the stringency of accountability Superintendents' Time Usage 3 measures. Third, we asked to what extent do contextual variables—district size, district locale, percent free and reduced lunch, percent minority, and per-pupil expenditure—independently and in combination influence superintendents’ perceptions of the stringency of accountability measures. Fourth, we asked to what extent contextual variables independently and in combination influence superintendents’ propensity to devote time to managerial leadership. Finally, with covariates controlled, we explored the relationship between location in a state with stringent or lenient accountability and superintendents’ allocation of time to managerial leadership. Theoretical Framework The existing literature about the superintendency characterizes the functions performed by superintendents in various ways. Typologies assign these functions to several distinct roles. Three- part typologies that distinguish among educational, political, and managerial roles enable a fairly exhaustive categorization of the superintendent’s functions, and these typologies are used more often than other typologies in studying superintendents’ work. For example, on the basis of his analysis of historical data, Cuban (1976) seems to have been the first to identify three roles: Teacher- Scholar, Chief Administrator, and Negotiator-Statesman. Later, he used the terms instructional, managerial, and political leadership to refer to these three roles (Cuban, 1988). More recently, Johnson (1996) used a similar classification when she described the superintendency as encompassing roles in educational, political, and managerial leadership. Her typology was based on an analysis of the work undertaken by 12 newly-hired superintendents (Johnson, 1996). In Cuban’s and Johnson’s typologies, the managerial role encompasses planning and administrative functions. The superintendent exercises authority over personnel, finance, and facilities. Exercising these managerial functions, the superintendent strives to ensure organizational stability while also making the district accountable to the public. The superintendent exercises educational (or instructional) leadership by formulating the district’s vision, focusing particularly on curriculum and instruction. Recent literature on district-level influences on student achievement also demonstrates that superintendents exercise educational leadership by promoting educational coherence and by working to cultivate instructional capacity (e.g., Cawelti & Protheroe, 2001; Leithwood, Louis, Anderson, & Wahlstrom, 2004; Snipes, Doolittle, & Herlihy, 2002; Waters & Marzano, 2006). Finally, the superintendent assumes a political role to “secure[e] cooperation” from various social groups with the goal of “making outside conditions favorable to successful management” (Cuban, 1976, p. 18). Functioning within this role, the superintendent negotiates with diverse interest groups to reach agreement about district priorities, policies, and resource allocation (Cuban, 1988; Johnson, 1996). One recent study suggested, however, that power dynamics between superintendents and other influential groups (e.g., schools boards and teachers unions) tend to make performance of this role particularly difficult for superintendents of large districts (Fuller, Campbell, Celio, Harvey, Immerwahr, & Winger, 2003). Literature describing the functions that comprise the superintendent’s educational, managerial, and political roles reveals the range of activities performed by these school administrators. Because role enactment is difficult to measure directly, researchers sometimes use the proxy measure of time allocation to examine superintendents’ performance of the functions associated with the roles they fill. In fact, studies of time allocation have long been used to examine workers’ roles (Burns, 1954; Copeman, Luijk, & Hanika, 1963). In one of the most famous of these studies, Mintzberg (1973) investigated administrators’ time allocation to determine the functions that comprised their roles. Studies such as Mintzberg’s highlight the consistencies in managers’ allocation of time, but there is also variability. Considering the variation in the circumstances confronting Education Policy Analysis Archives Vol. 17 No. 23 4 different school districts, moreover, it seems likely that a particular superintendent’s role consists of a unique combination of functions falling within the three broad role categories. In fact, a few studies do suggest that the degree to which individual superintendents perform functions in each of these three role categories is influenced by factors relating to district context (Fuller et al., 2003; Johnson, 1996). Despite evidence of variability in superintendents’ role performance, certain scholars argue that the optimal role for superintendents is one that focuses primarily on educational leadership (Bjork, 1993; Carter & Cunningham, 1997; Konnert & Augenstein, 1990). Moreover, some research reveals a positive association between superintendents’ attention to educational leadership and teachers’ confidence, competence, and willingness to take responsibility (Kussy, 1995). Nevertheless, time constraints, role overload, and situations involving conflict often limit superintendents’ ability to focus on matters relating to curriculum and instruction (Bredeson, 1996; Fuller et al., 2003; Wirt, 1991). In contrast to those arguing for the priority of the educational leadership role, Johnson (1996) advocates a balance among the three roles. Findings from her study revealed that the failure of a superintendent to pay attention to any of the roles had a negative impact on the district. For example, one superintendent’s failure to attend to the educational role diminished that leader’s credibility with teachers and principals. Inadequate attention to political leadership resulted in conflict and financial hardship. Lack of focus on managerial functions led to poor communication and distracting bureaucratic errors. What these perspectives have in common is the belief that excessive focus on managerial responsibilities is likely to detract from effectiveness. As a consequence, conditions that predispose superintendents to attend primarily to the managerial role might work against the sorts of reform that accountability policies hope to promote. It would be ironic if those same policies either directly or indirectly promoted greater attention among superintendents to the managerial domain. This study examines this possibility along with the possibility that other district circumstances might singly or in combination require superintendents to devote more of their time to management than to other domains of leadership. Related Literature Although some studies such as Cuban’s (1988) historical analysis suggest the possibility that context has an influence on superintendents’ apportionment of time, few studies of contemporary superintendents examine such influences directly. Moreover, most of the studies that are available focus on district size as the contextual variable of interest. Other possible contextual influences have not received much attention from researchers. And only a few studies tangentially address the influence of accountability measures on the attitudes and practices of local superintendents (e.g., Cohn, 2005; Whitney & Grogan, 2003). Interestingly, one study (Farkas et al., 2003) seemed to indicate that the locale of districts influenced superintendents’ level of support for the accountability measures included in the federal No Child Left Behind Act (2002). Urban superintendents in this study were more supportive of these measures than were their rural and suburban counterparts. Of course, district locale and district size are often confounded because urban districts tend to be larger than districts in other places, and several early studies of the influence of district size on superintendents’ performance of their roles fail to distinguish the influence of locale from the influence of size. Nevertheless some of these studies showed that superintendents of larger districts tended to devote more time to educational leadership while superintendents of smaller districts tended to devote more time to managerial leadership. Superintendents' Time Usage 5 However, two more recent studies offered counterevidence. Duea and Bishop (1980) concluded that superintendents in larger districts focus more on political and educational leadership while those in smaller districts focus more on managerial leadership. These researchers compared superintendents’ rankings of the time devoted to different administrative tasks. Specifically, the rankings of superintendents from the largest districts were compared with those from a random sample of small and mid-sized districts. Results revealed that superintendents of large districts spent the most time on political and educational tasks, while those in other districts spent the most time on managerial tasks. Similar findings were reported by Larson, Bussom, and Vickers (1981), who investigated the work lives of six Midwestern superintendents. Their study revealed that there were large differences in the amounts of time that the superintendents spent on different activities, and these differences seemed associated with district size. For example, the percentage of time devoted to desk work and phone calls was inversely proportional to district size. Compared to leaders of other districts, the superintendent of the largest district spent less time on desk work and travel but more time on unscheduled contacts. Similarly, Lindsey (1989) observed differences in superintendents’ time allocation based on district size. Although, like the sample of Larson and associates, his sample was small and he used only descriptive statistics, his data suggested that superintendents of small districts spent comparatively less time on instructional activities but comparatively more time on political activities than superintendents of larger districts. Munther (1997) also reported differences in superintendents’ allocation of time based on district size, but his analysis revealed a somewhat different pattern from the one reported in the three studies discussed above. Using Parson’s (1960) model of organizational levels of responsibility and control, in which organizational functions are categorized as technical, managerial, or institutional, Munther found that superintendents in small and mid-sized districts spent the most time on managerial tasks. In comparison, superintendents in the largest districts (i.e., over 10,000 students) spent the most time on tasks classified as institutional. Because institutional functions (in Parson’s scheme) can be equated to what Cuban and Johnson classified as political functions, Munther’s findings seem to suggest that superintendents in larger districts devote more time than those in smaller districts to activities associated with political leadership. Munther also noted that, in general, superintendents in smaller districts tended to pay more attention to technical functions than did superintendents in larger districts. Considering the similarity between what Parsons classified as technical functions and what Cuban and Johnson classified as educational (or instructional) functions, this finding implies that superintendents in smaller districts might be spending more time than their counterparts in larger districts on educational leadership. According to a recent study (Fuller, Campbell, Celio, Harvey, Immerwahr, & Winger, 2003), particularly those in large urban and suburban districts, the job of superintendents has become so burdensome that many find it impossible to accomplish productive work in any of the three domains. In general, superintendents who were interviewed by these researchers reported that much of their time was devoted to issues relating to employment—issues that were exacerbated by persistent cronyism and patronage politics. Other political dynamics such as labor negotiations, competing demands of constituents, and accountability mandates also consumed a great deal of superintendents’ time, leaving them with diminished ability to address other leadership needs. Although this study did not explicitly examine superintendents’ allocation of time to different roles, its findings did imply that superintendents spent a great deal of time on activities relating to politics (construed broadly). The limited research on the relationship between contextual conditions and superintendents’ allocation of time to different roles suggests tentatively that superintendents in smaller (perhaps rural and suburban) districts tend to pay disproportionate attention to managerial functions and that superintendents in larger (perhaps urban) districts tend to pay disproportionate attention to political functions. Clearly, however, with so few studies contributing to an Education Policy Analysis Archives Vol. 17 No. 23 6 understanding of such influences, generalizations are premature. The study reported here adds to the extant literature by incorporating contextual influences other than district size, by examining the combined effects of contextual influences, and by examining relevant relationships in consideration of the real and perceived stringency of accountability measures. Methods Using data obtained through a large-scale survey of superintendents in four states, the study used post hoc analyses to explore relationships between a set of variables representing superintendents’ perceptions of the stringency of accountability measures and their allocation of time—a proxy variable measuring their attentiveness to various leadership domains. Population and Sample The population consisted of superintendents employed in public school districts in four states: Texas, Tennessee, New Hampshire, and Nebraska. Two of the states—Texas and Tennessee —represented jurisdictions in which state education agencies applied stringent accountability measures, and two of them—New Hampshire and Nebraska—represented jurisdictions in which state education agencies applied much less stringent measures. The decision to draw samples from states in which the extent of state-level control differed was supported by research showing that external threats exert an influence on organizational leadership (e.g., Fitzpatrick & Rubin, 1995; Mulder, deJong, Koppelaar, & Verhage, 1986; Mulder, Ritsema van Eck, & deJong, 1970). These studies were conducted in business organizations; but evidence about the stressors associated with accountability mandates suggested the possibility that similar dynamics might be at play in the education arena (e.g., Schoen & Fusarelli, 2008). We used a systematic procedure to select states that represented extreme cases along the continuum of loose to stringent accountability. Their selection was made on the basis of the following criteria: the presence or absence of rewards and sanctions based on district performance, the extent of these sanctions and rewards, and the extensiveness of accountability testing requirements within the state. The selection process involved the following procedures. First, based on information in the document Rewards and Sanctions for School Districts and Schools (Education Commission of the States, 2001, 2002), states were divided into four categories reflecting the presence or absence of rewards or sanctions at the district level. “Stringent accountability” states used sanctions alone or a combination of sanctions and rewards, while “loose accountability” states used rewards only or used neither sanctions nor rewards. Next, within each of the four categories, states were ranked from highest to lowest based on the mean rankings for two conditions: the extensiveness of their testing programs, including number of different grade levels tested and total number of tests administered (range = 0–21) and a state sanction score, which comprised the number of sanctions that were permissible in each state (range = 0–17). The average of these two rankings yielded a number that was taken to represent stringency within category. The selection process also took into account feasibility issues such as whether or not states had sufficient numbers of superintendents representing each of the demographic categories salient to the study, particularly locale and district size. In addition to these considerations, we also sought to find states that were geographically widespread across the contiguous United States. Based upon the selection process and considerations described above, four states were selected. Tennessee, ranked first with regard to stringency of accountability, was selected to Superintendents' Time Usage 7 represent the category of states that offered sanctions without rewards, while Texas, ranked fourth overall in level of stringency, was chosen to represent states that offered both sanctions and rewards. New Hampshire, ranked 44th, was chosen to represent states that offered neither sanctions nor rewards, while Nebraska, ranked 50th, was the only state to offer rewards without imposing sanctions. Several other recent studies (e.g., Amrein & Berliner, 2002; Carnoy & Loeb, 2002; Clarke, Shore, Rhoades, Abrams, Miao, & Li, 2003; Nichols, Glass, & Berliner, 2006; Pedulla, Abrams, Madaus, Russell, Ramos, & Miao, 2003) have likewise attempted to categorize states according to the stringency of accountability measures. Like the methodology employed in the current study, the various selection procedures used in these studies ranked or grouped states according to accountability demands. And like the current study, these studies used selection processes that derived these rankings or groupings based on one or more of the following factors: the extent of testing across grade levels, and the number and severity of sanctions and rewards. Rankings yielded by the selection process used in the current study were largely aligned to those rankings (or groupings) produced by the various selection processes used in the other studies. As was the case with the current study, four other studies ranked both New Hampshire and Nebraska as states with lower accountability demands (Amrein & Berliner, 2002; Carnoy & Loeb, 2002; Clarke et al., 2003; Pedulla et al., 2003). In all four ranking systems, as well as in the one employed in the current study, Texas ranked as a state with highly stringent accountability. Finally, the selection of Tennessee as a high-stringency state was also generally though not universally supported. While the common ranking system employed by two studies (Clarke et al., 2003; Pedulla et al., 2003) ranked Tennessee as restrictive, systems used in some other studies placed it in the upper middle (Amrein & Berliner, 2003; Nichols et al., 2006) or bottom (Carnoy & Loeb, 2002) with regard to strictness of accountability measures. Once we selected the four states, we made decisions about sampling. We drew random samples of superintendents working in public school districts in Texas and Nebraska and included all superintendents working in public school districts in Tennessee and New Hampshire. In Texas, our sample of 528 superintendents (out of 1041 superintendents altogether) was large enough to produce results that were representative of the population at the 95% confidence level with a 3% confidence interval; and in Nebraska, our sample of 234 (out of 267 superintendents altogether) was large enough to produce a similar degree of accuracy. Instrumentation and Variables We collected data using a two-page questionnaire (see Appendix A). It included items pertaining to time allocation among leadership roles, items eliciting demographic information, and items comprising a scale to measure perceived stringency of accountability. We pilot-tested the instrument with a convenience sample of 49 Ohio superintendents. Data from the pilot test enabled calculation of the internal consistency of the scale measuring perceived stringency, and a Cronbach Alpha reliability estimate of .72 suggested that the scale had sufficient internal consistency to be used for research purposes (e.g., Garson, 2002). Table 1 provides a list of variables and operational definitions used in this study. Education Policy Analysis Archives Vol. 17 No. 23 8 Table 1 Data definitions and sources Variable Definition/Source Rural Sparsely populated places usually outside of cities, and small towns (< 24,999). Suburban Fringes of cities/ large towns (25,000–50,000). Urban Large and midsized cities (> 50,000). District size Student enrollment, reported by the superintendent. Sanction scale Superintendents’ perception of the extent to which accountability measures in their state were loose or stringent. % minority As reported by superintendent. Per-pupil expenditure As reported by Common Core of Data, 1999–2000 Socioeconomic status % students eligible for federal lunch programs, reported by superintendent. Time allocation Self-reported proportions of time devoted to specified sets of leadership activities (i.e., educational, managerial, or political), reported by superintendent. Data Collection and Analysis We mailed questionnaires to the superintendents in the sample and sent a reminder postcard to non-respondents after two weeks, followed by a duplicate questionnaire five weeks after the initial mailing. Of the 941 superintendents included in the sample, 683 returned usable questionnaires, providing an overall response rate of 73%.1 We entered all data into a database and checked them for usability. Cases were omitted in which summation errors indicated that participants may not have understood the instructions. Univariate outliers past three standard deviations were also removed, along with multivariate outliers identified by computing Cook’s Distance and the Mahalonabis Distance. After the removal of outliers, the overall net response rate for all four states was 68% (644/941 superintendents). The net response rates for individual states were as follows: Texas, 67% (352/528); Tennessee, 69% (94/136); New Hampshire, 60% (48/80); and Nebraska, 76% (150/197). Examination of frequencies, histograms, and computed skewness showed that most variables were normally distributed. An exception was enrollment, which showed a substantial positive skew. To correct for the unacceptable level of skewness, natural log transformations were computed and substituted for original enrollment values. Skewness for the transformed variable, log-enrollment, was minimal. Variables used in the regression analyses were also checked for multicollinearity. 1 Some problems were encountered in identifying the total population of superintendents in New Hampshire and in drawing a simple random sample of superintendents in Nebraska. First, contact information obtained from the 2001–2002 Common Core of Data provided the names and addresses for districts no longer in existence in fall 2003 when the questionnaire was mailed. Second, in both New Hampshire and Nebraska, some superintendents serve as leaders in more than one district. The fact that there was not a one-to-one correspondence between superintendents and districts caused two errors with respect to the eventual obtained sample. The size of the population of superintendents was overestimated so more superintendents were surveyed than actually needed to be surveyed, and some superintendents were sent two (or even more) copies of the questionnaire. These circumstances may have had some effect on the randomness of the sample, but the magnitude of that effect is impossible to quantify. Once alerted to the problem, we were able to remove duplicate submissions from those Nebraska and New Hampshire superintendents who mailed back more than one response. And, in some cases, where district demographics differed across the districts served by the same superintendent, they were able to create values representing aggregations across the multiple districts. Superintendents' T im e U sage 9 T able 2 D escriptive statistics V ariable T X (n = 352) T N (n = 94) N E (n = 150) N H (n = 48) A ll (n = 644) M SD M SD M SD M SD M SD E ducational leadership 0.31 0.15 0.31 0.13 0.25 0.13 0.33 0.15 0.30 0.15 M anagerial leadership 0.43 0.18 0.36 0.14 0.49 0.18 0.36 0.15 0.43 0.18 P olitical leadership 0.25 0.14 0.33 0.13 0.26 0.13 0.31 0.13 0.27 0.14 E nrollm ent 3,935 8,918 7,616 16,009 1,090 4,143 2,735 2,756 3,720 9,429 E nrollm ent (logarithm ) 3.08 0.64 3.53 0.48 2.61 0.46 3.31 0.33 3.05 0.63 F ree/reduced lunch (% ) 0.51 0.19 0.49 0.17 0.35 0.14 0.18 0.14 0.44 0.20 M inority (% ) 0.37 0.27 0.13 0.16 0.08 0.13 0.04 0.11 0.24 0.26 P er-pupil expenditure 6,841 1,483 5,056 611 6,726 1,231 7,319 1,171 6,589 1,459 T otal sanction scale 13.50 2.47 13.14 2.37 10.57 2.69 8.5 2.2 12.39 2.97 Education Policy Analysis Archives Vol. 17 No. 23 10 The extent to which the independent variables were collinear was assessed using two standard statistical tests, tolerance and Variance Inflation Factor (VIF). These tests yielded acceptable values; for none of the seven variables did tolerance exceed 1.0 nor fall under 0.4, while no VIF exceeded 2.5. Finally, we created two derived variables, both dichotomous. One classified superintendents based on their location in high-stringency or low-stringency states, and the other categorized them as either apportioning the majority of their time (50% or more) to managerial leadership or apportioning less than the majority of their time to managerial leadership. Findings Our discussion of findings provides answers to the five research questions listed above. To contextualize these findings, readers may wish to examine descriptive statistics, which are presented in Table 2. How Superintendents Allocate Time to Leadership Roles To assess superintendents’ allocation of time, we computed mean comparisons using paired- sample t-tests. We performed these analyses separately for each state and also using the four-state data set. With the combined data, mean comparisons revealed that superintendents devoted the most time to managerial leadership, followed by educational and then political leadership. These significant differences as well as the state-by-state comparisons are shown in Table 3. Analyses using Texas data revealed the same pattern of significant differences. With Tennessee data, the pattern was the same, but only the difference between time allocated to managerial leadership and the time allocated to educational leadership was significant. Again, in Nebraska, the pattern was the same, but significant differences were evident in only two sets of comparisons—between managerial and educational leadership, and between managerial and political leadership. And in New Hampshire, the pattern was the same but t-tests revealed that none of the differences was significant. Table 3 Comparison of means Paired comparison State t value p value Managerial-educational TX -7.43 < .001 TN -2.07 .041 NE -10.39 < .001 NH -0.87 .39 All -11.34 < .001 Educational-political TX 4.90 < .001 TN -0.56 .58 NE -0.77 .44 NH 0.64 .53 All 3.43 < .001 Managerial-political TX 12.13 < .001 TN 1.52 .13 NE 10.00 < .001 NH 1.64 .11 All 14.73 < .001 Superintendents' Time Usage 11 Real and Perceived Stringency To answer the research question, “What is the relationship between location in a state with stringent or lenient accountability and superintendents’ perceptions of the stringency of accountability measures?” we used one-way analysis of variance to compare mean scores on the total sanction scale from superintendents in high-stringency states (i.e., Texas and Tennessee) with mean scores from superintendents in low-stringency states (i.e., Nebraska and New Hampshire). The comparison of means revealed significantly higher scores in the high-stringency states (F (2, 643) = 118.99, p < .0001). The mean score from superintendents in high-stringency states was 13.42 (SD = 2.45) in contrast to a mean score of 10.08 (SD = 2.72) from those in low-stringency states. The difference remained the same when we expanded the model to introduce enrollment as a covariate—a control that we thought was wise to include because of its low, but significant correlation with the total sanction scale (R 2 = .15, p = .01). Estimated marginal means calculated using the expanded model were equivalent to actual means obtained when the covariate was omitted. These analyses showed that even with enrollment controlled, superintendents in high- stringency states perceived accountability measures to be more stringent than did superintendents in low-stringency states.2 Predictors of Perceived Stringency To answer the question, “to what extent do contextual variables—district size, district locale, percent free and reduced lunch, percent minority, and per-pupil expenditure—independently and in combination influence superintendents’ perceptions of the stringency of accountability measures?” we constructed multiple regression equations using four state-level data sets. We found it necessary to disaggregate the data by state because these four states differed dramatically with regard to several of the independent variables. A review of the descriptive statistics provided in Table 2 reveals that the most dramatic differences are observed with respect to enrollment, free and reduced lunch rates, and percent of students from minority groups. The greatest difference in mean enrollment was between Tennessee, with a mean of 7,616 and Nebraska, with a mean of 1,090. For free and reduced lunch rates, the greatest difference was between Texas, with a mean rate of 51% and New Hampshire with a mean rate of 18%. These states also had the greatest difference in percentage of students from minority groups, with averages of 37% and 4% respectively. We tested the same regression model with the data sets from each of the four states, but the model was significant only with the data set from Texas. Perhaps this situation resulted from the fact that the Texas data set was considerably larger than those from the other three states. Nevertheless, even with the Texas data, we found quite modest effects. Overall, the independent variables explained approximately 2% of the variance in perceived stringency, with rurality and enrollment exerting significant influences. Superintendents in rural districts were more likely than their suburban counterparts to perceive accountability as stringent, and superintendents in larger districts were more likely than those in smaller districts to perceive accountability as stringent (see Table 4). 2 With scores ranging from 5 to 20, a score of 10.08 falls just above the bottom quartile (approximately the 26th percentile) and a score of 13.4 falls somewhat above the median (approximately the 58th percentile). Education Policy Analysis Archives Vol. 17 No. 23 12 Table 4 Predictors of perceived stringency Variables B SE β (Constant) 9.82 1.85 - Enrollment (logarithm) 0.82 0.36 .21* Free or reduced lunch (%) 0.20 1.06 .02 Minority (%) 0.29 0.77 .03 Per-pupil expenditure 0.00 0.00 .01 Rural locale 1.03 0.45 .17* Urban locale 0.83 0.69 .07 Adj R 2 = .02 (p < .05); * p < .05 Predictors of Managerial Leadership Two sets of state-level analyses enabled us to address the research question, “To what extent do contextual variables—enrollment, percent free and reduced lunch, percent minority, per pupil expenditure, urban locale, rural locale, and perceived stringency of accountability—independently and in combination influence superintendents’ propensity to devote time to managerial leadership?”3 Texas. The multiple regression equation with managerial leadership as the dependent variable was found to be significant at the .001 level, with the independent variables accounting for 18% of the total variance in the dependent variables (Adj R 2 = .18, F (7, 344) = 12.24, p < .001). Enrollment and rural locale were significant predictors of time spent on managerial leadership. Superintendents from smaller and those from rural districts reported allocating more time to managerial tasks than did superintendents of larger and non-rural districts (see Table 5). In the first set of analyses we tested the influence of relevant contextual variables on superintendents’ allocation of time to managerial leadership using multiple regression. In the second set we used logistic regression to test the influence of those same contextual variables on superintendents’ membership in one of two groups—the group spending more than 50% of time on managerial leadership or the group spending less than 50% of time on managerial leadership. Findings for Texas and Tennessee are presented first. These are the states we identified as having highly stringent accountability systems. Then findings for the two states with more lenient accountability systems—New Hampshire and Nebraska—are presented. 4 The logistic regression equation painted a similar, but somewhat fuller picture. In this statistically significant equation including the six independent variables targeted in this study [χ2(7, N = 352) = 58.08, p < .001, 58%], enrollment and rural locale predicted membership in the group of superintendents who reported spending 50% or more of their time on tasks associated with managerial leadership. In this equation urban locale also predicted attention to managerial tasks, though to a lesser degree. Table 6 presents Wald statistics and odds ratios for each variable in the equation. 3 In all analyses, the independent variable “locale” treats the suburban locale as the reference category, with dummy variables for rural and urban. 4 Table 5 also presents results from equations evaluating the association between the set of independent variables and percentage of time allocated to educational and political leadership. Superintendents' Time Usage 13 Table 5 Selected regression coefficients predicting allocation of superintendents’ time to activity categories: Nebraska (n = 150), Tennessee (n = 94), and Texas (n = 352) Managerial Political Educational B SE β B SE β B SE β Nebraska (n = 150) (Constant) 0.85 0.20 - 0.12 0.14 - 0.04 0.15 - Rural locale 0.06 0.07 0.09 -0.09 0.05 -0.19 0.03 0.05 0.06 Urban locale - - - - - - - - - Enrollment (log) -0.10 0.04 -0.26* 0.05 0.03 0.17 -0.05 0.03 0.19 Lunch program % -0.15 0.12 -0.12 -0.08 0.09 -0.09 0.23 0.09 0.25* Minority (*) 0.08 0.15 0.05 0.01 0.10 0.01 -0.09 0.11 -0.08 Per-pupil $ 0.00 0.00 -0.01 0.00 0.00 0.08 0.00 0.00 -0.07 Sanction scale -0.01 0.01 -0.15 0.01 0.00 0.15 0.00 0.00 0.05 Tennessee (n = 94) (Constant) 0.52 0.25 - -0.09 0.24 - 0.58 0.26 - Rural locale 0.04 0.05 0.13 0.00 0.05 0.01 -0.05 0.05 -0.15 Urban locale 0.03 0.07 0.06 -0.05 0.07 0.10 0.02 0.07 0.03 Enrollment (log) -0.10 0.04 -0.34* 0.13 0.04 0.48*** -0.03 0.04 -0.12 Lunch program % -0.08 0.10 -0.10 -0.02 0.09 -0.02 0.10 0.10 0.13 Minority (*) -0.01 0.10 -0.01 -0.06 0.10 -0.07 0.07 0.11 0.08 Per-pupil $ 0.00 0.00 0.04 0.00 0.00 0.02 0.00 0.00 -0.06 Sanction scale 0.01 0.01 0.20 0.00 0.01 -0.07 -0.01 0.01 -0.14 Texas (n = 352) (Constant) 0.69 0.13 - 0.24 0.11 - 0.07 0.12 - Rural locale 0.09 0.03 0.20** -0.04 0.03 -0.12 -0.05 0.03 -0.12 Urban locale 0.09 0.05 0.11 -0.03 0.04 -0.05 -0.06 0.04 -0.08 Enrollment (log) -0.08 0.02 -0.30** 0.02 -0.02 0.09 0.06 0.02 0.27** Lunch program % 0.01 0.07 0.01 -0.07 0.06 -0.09 0.06 0.06 0.08 Minority (*) -0.08 0.05 -0.12 0.01 0.04 0.02 0.07 0.05 0.12 Per-pupil $ 0.00 0.00 -0.02 0.00 0.00 -0.09 0.00 0.00 0.11 Sanction scale 0.00 0.00 -0.02 0.01 0.00 0.09 0.00 0.00 -0.06 Adj R2 = .06 (p < .05). * p < .05; ** p < .01; *** p < .001. Table 6 Regression model evaluating managerial leadership ≥ 50% Variable Wald Odds ratio Rural locale 5.92 0.30* Urban locale 4.30 0.21* Enrollment (Log) 8.64 0.37** Lunch program % 0.41 0.53 Minority 1.03 0.50 Per-pupil $ 0.02 1.00 Sanction scale 0.16 0.98 Constant 7.18 164.09 * p < .05; ** p < .01. Tennessee. The multiple regression equation with managerial leadership as the dependent variable was found to be significant at the .05 level, with the independent variables accounting for Education Policy Analysis Archives Vol. 17 No. 23 14 approximately 10% of the total variance in the dependent variables (Adj R 2 = .098, F (7, 86) = 2.44, p < .05). Enrollment was the only significant predictor of time spent on managerial leadership. Superintendents from smaller districts reported allocating more time to managerial tasks than did superintendents of larger districts (see Table 5). Results of the logistic regression analysis showed the same pattern—enrollment was the only independent variable that contributed to explaining membership either in the group of superintendents spending 50% or more of their time on managerial leadership or in the group spending less than 50% of their time on managerial leadership.5 Nebraska and New Hampshire. With the Nebraska data set, the regression model examining predictors of managerial leadership was significant (Adj R 2 = .06, F (6,143) = 2.69, p < .05), with enrollment exerting a significant negative influence (see Table 5). The logistic regression equation using Nebraska data, however, was not significant. Using the New Hampshire data set, we found that neither the multiple regression equation nor the logistic regression equation was significant. These findings are not surprising considering how little variability in enrollment there is among the New Hampshire districts (see Table 2). Cross-State Trends. In general these analyses suggest that the lower the district enrollment, the more likely it is that the superintendent will devote a substantial amount of time to managerial leadership. In addition, even though rurality tends to be associated with lower district enrollment, it did exert a separate influence on the amount of time that Texas superintendents devoted to managerial leadership.6 Influence of State Policy Environment We created an analysis of covariance model to answer the research question, “With covariates controlled, what is the relationship between location in a state with stringent or lenient accountability and superintendents’ allocation of time to managerial leadership?” The model included state accountability context (i.e., location in a stringent or loose accountability state) as a fixed factor and two covariates (enrollment and locale) that had previously shown an influence on the percent of time superintendents allocated to managerial leadership. As we expected, enrollment was significantly associated with managerial leadership, but location in a stringent or lenient accountability state had no significant influence. The influence of locale was also non-significant (see Table 7). This finding suggests that circumstances associated with lower and higher district enrollments have a demonstrable influence on superintendents’ allocation of time to managerial leadership, regardless of the stringency of the accountability requirements under which those superintendents operate. 5 More detailed information about the results of the logistic regression analyses for Tennessee, Nebraska, and New Hampshire may be obtained by writing to the first author. 6 In the data set overall, r = -.73, p <.01; in the Texas data set, r = -.63, p <.01. Superintendents' Time Usage 15 Table 7 ANCOVA model evaluating location in stringent or lenient state in consideration of known covariates (Type II sum of squares) Source F p value Corrected model 34.92 <.001 Log enrollment 62.36 <.001 Rural 3.01 .083 Urban .42 .52 High-low state stringency .06 .81 R 2 = .18 (Adj. R 2 = .17) Summary of Findings We found that states differ with regard to the stringency of their accountability measures, and superintendents’ perceptions of the stringency of state accountability measures relate to their location in high- or low-stringency states. To some degree, then, superintendents appear to be accurate interpreters of their state policy contexts. Nevertheless, structural conditions, namely enrollment and rural location, also appear to influence their perceptions to a modest extent. In terms of perception, then, accountability measures seem more stringent to superintendents in high- stringency states, rural locales, and larger districts. Interestingly, however, neither the stringency of accountability measures nor superintendents’ perceptions of that stringency appear to influence their choices with regard to the leadership responsibilities they emphasize. Rather, certain structural conditions, in particular low district enrollment and rural locale, seem to predispose superintendents to spend more time on activities associated with the managerial role. Limitations The models tested in this study were limited in several ways. The first relates to the use of self-report data, which are susceptible to social desirability bias. In addition to limitations associated with self-reporting, the accuracy of responses was also dependent on the alignment between conceptual categories provided on the questionnaire and conceptual categories arising from superintendents’ actual lived experience. If the alignment was close, superintendents clearly understood the concepts to which questionnaire items referred. If the alignment was not close, however, superintendents might have either failed to understand items or might have read into them meanings derived from their own experiences, and these meanings may have differed considerably from the meanings intended by the researchers. Another limitation begins in the way variables were operationalized. The consolidation of locale codes into three categories, for example, reduced precision and thereby resulted in a loss of potentially relevant variability. Furthermore, the need to represent locale as a dummy variable in the regression equations (e.g., rural/not rural, urban/not urban) resulted in an additional loss of variability. As mentioned in the footnote above, some sampling problems may also have compromised our findings. In addition, our use of samples from four states, rather than a national sample means that our findings cannot be generalized definitively to superintendents across the nation. Moreover, our discovery of so much variability across states suggests that state context does matter. Our approach to this circumstance was to construct our models on a state-by-state basis, with one Education Policy Analysis Archives Vol. 17 No. 23 16 exception. To test the influence of being in a high- or low-stringency state, we obviously needed to perform analyses using the entire multi-state data set. A final limitation relates to the models we used to predict perception of the stringency of accountability and allocation of time to managerial leadership. Although the models incorporated a set of independent variables that were theoretically (and in some cases empirically) linked to the dependent variables, other variables, excluded from the model, are likely to have been at least as influential. Other possible predictors might relate to the personal characteristics of superintendents, their leadership styles, and their professional training. Discussion The findings from this study support earlier research showing that district size and locale strongly influence superintendents’ leadership (Duea & Bishop, 1980; Gilstrap, 1982; Larson et al., 1981; Lindsey, 1989; Munther, 1997). The portrait of small- and rural-district superintendents suggested by the current study fits in with findings from some previous research indicating that superintendents in smaller (and rural) districts perceive themselves primarily as managers who are required to perform a broad range of administrative tasks in multi-faceted roles (Glass, 1992; Grady & Bryant, 1991; Hoyle, 1978; Kaiser & Webb, 1974; Sabatino, 1993; Tagg, 1982). Undoubtedly some interpreters would see these findings as evidence that smaller (and also rural) districts are deficient in comparison to larger (suburban) ones. But this claim seems premature. After all, several studies using state data sets have demonstrated that small district size confers an achievement advantage as well as reducing achievement gaps ( Howley, Brooks, Gocmen, & Hammer, 2002; Bickel & Howley, 2000).7 More defensible, however, is the claim that smaller (and rural) districts have different leadership requirements than larger (suburban and urban) ones. Perhaps because there are fewer administrative personnel in smaller (and rural) districts, superintendents take on more managerial responsibilities. Or possibly, the freedom from political turmoil associated with small size or rurality enables superintendents to spend less time handling conflict and more time on organizational routines. Whatever the causal linkages, however, the fact remains that as districts become larger the character of the superintendent’s work changes. This insight about district leadership is not new, of course. But its continued salience is somewhat surprising in light of changes in educational policy as well as normative claims made in the literature on school leadership. For instance, we expected that the actual or perceived stringency of state accountability measures would influence superintendents’ allocation of time, but neither did. We also expected that the emphasis in recent literature on educational leadership (e.g., Bjork, 1993; Carter & Cunningham, 1997; Konnert & Augenstein, 1990), on the one hand, and balanced leadership (e.g., Johnson, 1996), on the other, would have kept superintendents from reporting that they spent large proportions of their time on managerial tasks. Nevertheless, our analyses indicated that in all four states, the managerial category of responsibilities was the one to which superintendents generally devoted the most time. This finding, coupled with our findings about the influences of enrollment and locale on the allocation of time to managerial leadership, suggest that structural conditions play a powerful role in determining the character of superintendents’ work. In the face of both accountability measures and prescriptive literature pushing them toward educational leadership, superintendents still devote the largest proportion of their time to management. 7 See Berry (2005) for a different view. Superintendents' Time Usage 17 These conclusions do not directly support policy recommendations but rather point to unanswered questions about the relationship between superintendents’ work and district performance. They suggest, moreover, that studies attentive to these questions need to be conducted in different types of districts—distinguished primarily on the basis of size and locale. This suggestion is not new, of course. In fact, it repeats, expands on, and lends empirical support to Cuban’s (2001) contention that leadership of urban schools ought not to be confused with leadership of schools in other locales. According to Cuban, The blending of urban with suburban and rural schools encourages presidents, governors, and corporate leaders to design solutions for ailing urban schools that become one-size-fits-all reforms treating all American schools as interchangeable cogs in a large machine. (p. 2) Of course, Cuban’s concern for urban districts takes the foreground here, but his insight retains its force when we substitute “rural” or “small-district” for “urban.” Moreover, despite the face-validity of Cuban’s (2001) claim that leadership of urban districts requires a judicious balance of educational, managerial, and political leadership positioned “to cope with the conflicts arising from issues of race and class as they affect test scores and the broader purposes of public schooling” (p. 6), little empirical evidence shows a linkage between such leadership balance and higher performance (see also Johnson, 1996). Additional research along these lines is clearly warranted. So too is research on the outcomes associated with the predominantly managerial leadership exercised by superintendents in many rural and small-sized districts. Holding the leadership rhetoric in abeyance, researchers need to explore the possibility that some uses of managerial leadership in such districts might support high performance or that some uses of educational or political leadership might impede it. Furthermore, as consumers of the research, educators and policy makers should avoid the tendency to generalize findings across contexts. After all, an accumulating body of evidence, to which our study contributes, points to the likelihood that context has an influence not only on practice, but also on the relationship between practice and performance. Education Policy Analysis Archives Vol. 17 No. 23 18 References Amrein, A.L., & Berliner, D.C. (2002a). The impact of high-stakes tests on student academic performance: An analysis of NAEP results in states with high-stakes tests and ACT, SAT, and AP Test results in states with high school graduation exams. Tempe, AZ: Education Policy Studies Laboratory, Arizona State University. Retrieved January 7, 2004, from http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0211–126- EPRU.pdf. Berry, C. (2005). School district consolidation and student outcomes: Does size matter? In W. Howell (Ed.), Besieged: School boards and the future of education politics (56–80). Washington, DC: Brookings Institution Press. Bickel, R., & Howley, C. (2000). The influence of scale on student performance: A multi-level extension of the Matthew principle. Education Policy Analysis Archives, 8(22). Retrieved February 11, 2002, from http://epaa.asu.edu/epaa/v3n18.html. Bjork, L. G. (1993). Effective schools-effective superintendents: The emerging instructional leadership role. Journal of School Leadership, 3, 246–259. Bredeson, P. V. (1996). Superintendents’ roles in curriculum development and instructional leadership: Instructional visionaries, collaborators, supporters, and delegators. Journal of School Leadership, 6(3), 243–264. Burns, T. (1954). The directions of activity and communication in a departmental executive group. Human Relations, 7, 73–97. Callahan, R. E. (1962). Education and the cult of efficiency: A study of the social forces that have shaped the administration of the public schools. Chicago: University of Chicago Press. Carnoy, M., & Loeb, S. (2002). Does external accountability affect student outcomes? A cross- state analysis. Educational Evaluation and Policy Analysis, 24(4), 305–331. Carter, G. R., & Cunningham, W. G. (1997). The American school superintendent: Leading in an age of pressure. San Francisco: Jossey-Bass. Cawelti, G., & Protheroe, N. (2001). High student achievement: Now six school districts changed into high-performance systems. Arlington, VA: Educational Research Service. Clarke, M., Shore, A., Rhoades, K., Abrams, L., Miao, J., & Li, J. (2003). Perceived effects of state- mandated testing programs on teaching and learning: Findings from interviews with educators in low-, medium-, and high-stakes states. Boston, MA: Boston College, National Board on Educational Testing and Public Policy. Retrieved November 18, 2006, from http://www.bc.edu/research/nbetpp/statements/nbr1.pdf. Cohn, C. A. (2005). NCLB implementation challenges: The local superintendent’s view. Peabody Journal of Education, 80(2), 156–169. http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0211–126-EPRU.pdf� http://www.asu.edu/educ/epsl/EPRU/documents/EPSL-0211–126-EPRU.pdf� http://epaa.asu.edu/epaa/v3n18.html� http://www.bc.edu/research/nbetpp/statements/nbr1.pdf� Superintendents' Time Usage 19 Copeman, G., Luijk, H., & Hanika, F. DeP. (1963). How the executive spends his time. London: Business Publications Ltd. Cuban, L. (1976). Urban school chiefs under fire. Chicago: University of Chicago Press. Cuban, L. (1988). The managerial imperative and the practice of leadership in schools. Albany, NY: State University of New York Press. Cuban, L. (2001). Leadership for student learning: Urban school leadership—different in kind and degree. Washington, DC: Institute for Educational Leadership. Duea, J., & Bishop, W. L. (1980). Probe examines time management, job priorities and stress among public school superintendents. Cedar Falls, IA: Practical Research into Organizational Behavior and Effectiveness. (ERIC Document Reproduction Service No. ED 197 420). Education Commission of the States. (2001, 2002). Accountability–rewards/sanctions. Retrieved March 31, 2004, from http://www.ecs.org/clearinghouse/13/86/1386.htm. Farkas, S., Johnson, J., & Duffett, A. (2003). Rolling up their sleeves: Superintendents and principals talk about what's needed to fix public schools. New York: Public Agenda Foundation. Fitzpatrick, K. R., & Rubin, M. S. (1995). Public relations vs. legal strategies in organizational crisis decisions. Public Relations Review, 21(1), 21–33. Fuller, H., Campbell, C., Celio, M., Harvey, J., Immerwahr, J., & Winger, A. (2003). An impossible job? The view from the urban superintendent’s chair. Seattle, WA: University of Washington, Center on Reinventing Public Education. Garson, D. G. (2002). PA 765 statnotes: An online textbook. Retrieved April 3, 2004, from http://www2.chass.ncsu.edu/garson/pa765/statnote.htm. Gilstrap, J. L. (1982). Differences in actual and ideal attention to administrative functions by rural school superintendents. Dissertation Abstracts International, 43(04), 990A. (UMI No. 8221840). Glass, T. E. (1992). The 1992 study of the American school superintendency: America’s education leaders in a time of reform. Arlington, VA: American Association of School Administrators. Grady, M., & Bryant, M. (1991). School board turmoil and superintendent turnover: What pushes them to the brink? School Administrator, 48(2), 19–26. Howley, A., Brooks, G., Gocmen, G., & Hammer, P. (2002). Making a difference against the odds: The conditions of supeintendent’s work. Unpublished manuscript. Hoyle, J. R. (1978). Critical tasks and administrative behaviors of superintendents in small schools. Paper presented at the Annual Meeting of the American Educational Research http://www.ecs.org/clearinghouse/13/86/1386.htm� http://www2.chass.ncsu.edu/garson/pa765/statnote.htm� Education Policy Analysis Archives Vol. 17 No. 23 20 Association, Toronto, Ontario. (ERIC Document Reproduction Service No. ED 150 701). Johnson S. M. (1996). Leading to change: The challenge of the new superintendency. San Francisco: Jossey-Bass. Kaiser, D. E., & Webb, O. G. (1974). The responsibilities of the school business administrator in small school districts (Research Bulletin No. 16). Chicago, IL: Association of School Business Officials. (ERIC Document Reproduction Service No. ED 103 943). Konnert, M. W., & Augenstein, J. J. (1990). The superintendency in the nineties: What superintendents and board members need to know. Lancaster, PA: Technomic Publishing Company. Kussy, K. W. (1995). The superintendent’s role in the transformation of instruction. Dissertation Abstracts International, 56(07), 2508A. (UMI No. 9539827). Larson, L., Bussom, R., & Vicars, W. (1981). The nature of a school superintendent’s work. Final Technical Report. Carbondale, IL: Southern Illinois University Department of Administrative Sciences. (ERIC Document Reproduction Service No. ED 210782). Leithwood, K., Louis, K.S., Anderson, S., Wahlstrom, K. (2004). How leadership influences student learning. New York, NY: The Wallace Foundation. Retrieved March 15, 2008, from http://www.wallacefunds.org. Lindsey, C. Q. (1989). The daily administration work behavior and activities of selected superintendents in small, medium, and large-sized school systems in the state of Tennessee. Dissertation Abstracts International, 51(04), 1068A. (UMI No. 9021035). Mintzberg, H. (1973). The nature of managerial work. New York: Harper & Row. Mulder, M., deJong, R. D., Koppelaar, L., & Verhage, J. (1986). Power, situation, and leader’s effectiveness: An organizational study. Journal of Applied Psychology, 71, 566–570. Mulder, M., Ritsema van Eck, J. R., & deJong, R. D. (1970). An organization in crisis and non- crisis conditions. Human Relations, 24, 19–41. Munther, T. A. (1997). Superintendent work activity: Variation by school district size. Dissertation Abstracts International, 59(06), 1855A. (UMI No. 9835862). Nichols, S. L., Glass, G. V., & Berliner, D. C. (2006). High-stakes testing and student achievement: Does accountability pressure increase student learning? Education Policy Analysis Archives, 14(1). Retrieved October 14, 2006, from http://epaa.asu.edu/epaa/v14n1/. Owen, J. C. (1998, April). The roles of the superintendent in creating a community climate for educational improvement. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA. (ERIC Document Reproduction Service No. ED 425 502). http://www.wallacefunds.org/� http://epaa.asu.edu/epaa/v14n1/� Superintendents' Time Usage 21 Parson, T. (1960). Structure and process in modern society. New York: The Free Press. Pedulla, J. J., Abrams, L. M., Madaus, G. F., Russell, M. K., Ramos, M. A., & Miao, J. (2003). Perceived effects of state-mandated testing programs on teaching and learning: Findings from a national survey of teachers. Boston, MA: Boston College, National Board on Educational Testing and Public Policy. Retrieved November 18, 2006, from http://www.bc.edu/research/nbetpp/statements/nbr2.pdf. Sabatino, R. J. (1993). A descriptive and comparative analysis of superintendents of small school districts. Dissertation Abstracts International, 54(12), 4326A. (UMI No. 9414836). Schoen, L., & Fusarelli, L.D. (2008). Innovation, NCLB, and the fear factor: The challenge of leading 21st-century schools in an era of accountability. Educational Policy, 22(1), 181– 203. Snipes, J., Doolittle, F., & Herlihy, C. (2002). Foundations for success: Case studies of how urban school systems improve student achievement. Washington, DC: Council of the Great City Schools. Tagg, G. J. (1982). The trials and tribulations of a rural superintendent. Paper presented at the Annual Convention of the American Association of School Administrators, New Orleans, LA. (ERIC Document Reproduction Service No. ED 225 749). Waters, J.T., & Marzano, R.J. (2006). School district leadership that works: the effect of superintendent leadership on student achievement. Denver, CO: Mid-continent Research for Education and Learning. Whitney, H., & Grogan, M. (2003). Superintendents’ responses to the achievement gap: An ethical critique. International Journal of Leadership in Education, 6(3), 223–237. Wirt, F. M. (1991). The missing link in instructional leadership: The superintendent, conflict, and maintenance. Urbana, IL: Beckman Institute for Advanced Science and Technology. (ERIC Document Reproduction Service No. ED 327 945). http://www.bc.edu/research/nbetpp/statements/nbr2.pdf� Education Policy Analysis Archives Vol. 17 No. 23 22 About the Author Kim Jones Trimble Local Schools Aimee Howley Ohio University Email: tl_kjones@seovec.org Kim Jones (Ed.D, Ohio University), a lifelong resident of northern Appalachia, is principal of Trimble Middle School in Glouster, Ohio. Her interests include rural issues and gifted education. Aimee Howley currently works as Associate Dean for Research and Graduate Studies in Ohio University’s College of Education. Her recent work focuses on rural education, school leadership, and gifted education. mailto:tl_kjones@seovec.org� Superintendents' Time Usage 23 Appendix A: Questionnaire Survey of Superintendent Work Life The activities performed by superintendents can be divided into three types. Please look at the activities described under each type of leadership below; then estimate what percentage of your work time you normally spend on each type of activities. NOTES: 1. Please make every attempt to estimate percentages of time actually spent in each type, rather than how you would prefer to spend your time. 2. Please remember that all types of activities are important to the performance of the superintendency. 3. Remember that information given will not be associated in print with any specific district or person. Total time spent on the activities in all three types should equal 100%. Type I activities include, but are not limited to the following types of functions. • shaping the mission of the district • establishing a district climate that signals a seriousness of purpose • designing rituals and structures • developing operational structures • planning for professional development Percentage of time spent on Type I activities = ______% Type II activities include, but are not limited to the following types of functions. • performing personnel functions (e.g., interviewing and evaluating personnel) • performing finance and budgeting functions • planning and managing facilities, and overseeing their construction Percentage of time spent on Type II activities = _____% Type III activities include, but are not limited to the following types of functions. • securing funding • equitably distributing resources • negotiating and lobbying • garnering public support • listening and responding to concerns of various constituent groups Percentage of time spent on Type III activities = _____% TOTAL OF TYPE I, TYPE II, and TYPE III activities = 100% Please rate the extensiveness of accountability measures in your state. Education Policy Analysis Archives Vol. 17 No. 23 24 Very extensive Extensive Moderately extensive Not very extensive Testing requirements 4 3 2 1 Sanctions to districts 4 3 2 1 Sanctions to schools 4 3 2 1 Rewards to districts 4 3 2 1 Rewards to schools 4 3 2 1 How would you rate your state’s support for local control of schools? _____ very supportive of local control _____ supportive of local control _____ unsupportive of local control _____ extremely unsupportive of local control DEMOGRAPHIC INFORMATION As much as possible, please supply single-numeral answers for A, B, and C (e.g., 1440 ADM, 12%, 2.5%, .3%). Please avoid ranges, such as “5–10%” or “less than 1%”. A. _______ What is the enrollment (ADM) of your district? B. _______ % What percentage of students in your district is eligible for free or reduced lunch? C. _______ % What percentage of students in your district comes from minority-group backgrounds? D. Select the term below which best describes the locale in which your district is situated. ________ Rural areas are sparsely populated places, usually outside of cities. Small towns (that is, towns with populations under 24,999) are also considered rural. ________ Suburban areas include locales on the fringe of large and midsized cities as well as large towns with populations of at least 25,000 people but fewer than 50,000 people. ________ Urban areas include large and midsized cities (that is, cities with populations of at least 50,000 people). This completes the survey. Thank you very much. Superintendents' Time Usage 25 EDUCATION POLICY ANALYSIS ARCHIVES http://epaa.asu.edu Editor: Sherman Dorn, University of South Florida Production Assistant: Chris Murrell, Arizona State University Editorial Assistant: Judy Castillo, University of South Florida General questions about appropriateness of topics or particular articles may be addressed to the Editor, Sherman Dorn, epaa-editor@shermandorn.com. Editorial Board Noga Admon Jessica Allen Cheryl Aman Michael W. Apple David C. Berliner Damian Betebenner Robert Bickel Robert Bifulco Anne Black Henry Braun Nick Burbules Marisa Cannata Casey Cobb Arnold Danzig Linda Darling-Hammond Chad d'Entremont John Diamond Amy Garrett Dikkers Tara Donohue Gunapala Edirisooriya Camille Farrington Gustavo Fischman Chris Frey Richard Garlikov Misty Ginicola Gene V Glass Harvey Goldstein Jake Gross Hee Kyung Hong Aimee Howley Craig B. Howley William Hunter Jaekyung Lee Benjamin Levin Jennifer Lloyd Sarah Lubienski Les McLean Roslyn Arlin Mickelson Heinrich Mintrop Shereeza Mohammed Michele Moses Sharon L. Nichols Sean Reardon A.G. Rud Ben Superfine Cally Waite John Weathers Kevin Welner Ed Wiley Terrence G. Wiley Kyo Yamashiro Stuart Yeh Education Policy Analysis Archives Vol. 17 No. 23 26 EDUCATION POLICY ANALYSIS ARCHIVES http://epaa.asu.edu New Scholar Board English Language Articles 2007–2009 Wendy Chi Corinna Crane Jenny DeMonte Craig Esposito Timothy Ford Samara Foster Melissa L. Freeman Kimberly Howard Nils Kauffman Felicia Sanders Kenzo Sung Tina Trujillo Larisa Warhol Superintendents' Time Usage 27 Archivos Analíticos de Políticas E ducativas http://epaa.asu.edu Editor Gustavo E. Fischman Arizona State University Asistentes editoriales: Rafael O. Serrano (ASU) & Lucia Terra (UBC) Hugo Aboites UAM-Xochimilco, México Armando Alcántara Santuario CESU, México Claudio Almonacid Avila UMCE, Chile Dalila Andrade de Oliveira UFMG, Brasil Alejandra Birgin FLACSO-UBA, Argentina Sigfredo Chiroque IPP, Perú Mariano Fernández Enguita Universidad de Salamanca. España Gaudêncio Frigotto UERJ, Brasil Roberto Leher UFRJ, Brasil Nilma Lino Gomes UFMG, Brasil Pia Lindquist Wong CSUS, USA María Loreto Egaña PIIE, Chile Alma Maldonado University of Arizona, USA José Felipe Martínez Fernández UCLA, USA Imanol Ordorika IIE-UNAM, México Vanilda Paiva UERJ, Brasil Miguel A. Pereyra Universidad de Granada, España Mónica Pini UNSAM, Argentina Romualdo Portella de Oliveira Universidade de São Paulo, Brasil Paula Razquin UNESCO, Francia José Ignacio Rivas Flores Universidad de Málaga, España Diana Rhoten SSRC, USA José Gimeno Sacristán Universidad de Valencia, España Daniel Schugurensky UT-OISE Canadá Susan Street CIESAS Occidente,México Nelly P. Stromquist USC, USA Daniel Suárez LPP-UBA, Argentina Antonio Teodoro Universidade Lusófona, Lisboa Jurjo Torres Santomé Universidad de la Coruña, España Lílian do Valle UERJ, Brasil http://epaa.asu.edu/epaa/board/schugur.html� http://epaa.asu.edu/epaa/board/torres.html� Volume 17 Number 23 December 4, 2009 ISSN 1068–2341 Introduction Theoretical Framework Related Literature Methods Population and Sample Instrumentation and Variables Data Collection and Analysis Findings How Superintendents Allocate Time to Leadership Roles Real and Perceived Stringency Predictors of Perceived Stringency Predictors of Managerial Leadership Influence of State Policy Environment Summary of Findings Limitations Discussion References Appendix A: Questionnaire Survey of Superintendent Work Life NOTES: Production Assistant: Chris Murrell, Arizona State University Editorial Assistant: Judy Castillo, University of South Florida