This work is licensed under a Creative Commons Attribution 4.0 International License. Identifying Trauma-Related and Mental Health Needs: The Implementation of Screening in California’s Child Welfare Systems Brent R. Crandal Andrea L. Hazen Jennifer Rolls Reutz Abstract: A central aspect of trauma-informed care in child welfare (CW) systems is the use of a trauma-informed screening process. This includes the use of a broadly administered measurement approach to assist professionals in identifying current trauma- related symptomology or a history of potentially traumatizing events. With a high prevalence of unmet mental health needs among CW-involved children, screening can be a crucial step as systems strive to identify children impacted by trauma. This paper offers a summary of CW screening approaches in county-administered CW systems across California. Through a web-administered survey, 46 county administrators reported on their screening practices and perceptions. Information about ages of children screened and screening tools used, perceptions of screening implementation priorities, degree of implementation and satisfaction with screening processes is provided. Several implementation considerations for future trauma-informed care efforts are offered including maintaining a focus on childhood trauma, closing the science-practice gap, and evaluating the state of the science. Keywords: Childhood trauma; trauma-informed care; screening; implementation; child welfare With ongoing policy, research, and implementation efforts, screening has become a central and active aspect of trauma-informed care (TIC; Hanson & Lang, 2016). A number of national organizations have encouraged the use of broadly administered measurement approaches to assist practitioners in identifying current trauma-related symptomology or potentially traumatic events in a child’s history, including the U.S. Department of Health and Human Services (DHHS), Substance Abuse and Mental Health Services Administration (SAMHSA; DHHS, SAMHSA, 2011); the National Child Traumatic Stress Network (NCTSN; 2007); the Attorney General’s National Task Force on Children Exposed to Violence (2012); and the DHHS, Administration for Children and Families (ACF), Administration on Children, Youth and Families, Children’s Bureau (DHHS, ACF, 2011). By and large, these organizations have emphasized the role of screening and identification as part of TIC in child welfare (CW) systems. The role of CW systems includes promoting safety when children are at risk for maltreatment and enhancing well- being in instances where child maltreatment has occurred, making these systems particularly well-positioned to identify children who have been adversely impacted by maltreatment. Given the advancing research on the lasting impact of adverse childhood ______________________ Brent R. Crandal, PhD, Co-Director of the California Screening, Assessment, and Treatment Initiative, Chadwick Center for Children and Families, Rady Children’s Hospital, San Diego, California; Andrea L. Hazen, PhD, Research Scientist at the Child and Adolescent Services Research Center and the Chadwick Center for Children and Families, Rady Children’s Hospital, San Diego, California; Jennifer Rolls Reutz, MPH, Co-Director of the California Evidence-Based Clearinghouse for Child Welfare, Chadwick Center for Children and Families, Rady Children’s Hospital, San Diego, California Copyright © 2017 Authors, Vol. 18 No. 1 (Spring 2017), 335-348, DOI: 10.18060/21278 https://creativecommons.org/licenses/by/4.0/ Crandal et al./IDENTIFYING NEED AND TIC 336 experiences across the lifespan (e.g., obesity, depression, heart disease, smoking, alcoholism; Felitti et al., 1998; Larkin, Felitti, & Anda, 2014), linking CW’s trauma screening efforts with a thorough mental health (MH) assessment and trauma-focused interventions could contribute to meaningful public health benefits. As Ko and colleagues (2008) point out, “For the child welfare system to become increasingly trauma-informed, effective trauma screening and assessment protocols are needed at every level” (Ko et al.; p. 398). In the U.S. general population, 61.8% of adolescents have been found to experience one or more potentially traumatic events (PTE), such as interpersonal violence, accidents, injuries, or witnessing others experience a PTE, with 32.7% experiencing 2 or more PTEs (McLaughlin et al., 2013). Almost all children who become involved in CW have been impacted by maltreatment, a specific subset of PTE (DHHS, 2016) and 61.8% of the children and youth involved in current investigations are estimated to have previous reports of maltreatment (Horwitz et al., 2012), indicating that the maltreatment has persisted over a period of time. Although experiencing PTE is fairly common in childhood, it is more common and more persistent for CW-involved children and youth, and children who experienced multiple PTEs are more likely to develop posttraumatic stress disorder (PTSD; McLaughlin et al., 2013). CW systems are also well-positioned to identify children impacted by other forms of MH impairment. Almost one-quarter of adolescents (22.2%) in the general population have experienced a significant MH need during their lives (Merikangas et al., 2010). In contrast, approximately half (47.9%) of a nationally representative sample of children and youth investigated by CW services for child maltreatment were identified as having a significant MH need (e.g., emotional and behavioral problems; Burns et al., 2004), indicating a high rate of MH need among CW-involved children and youth. Moreover, the second wave of the National Survey of Child and Adolescence Well- Being uncovered a stark underutilization of MH services among children and youth with significant MH need involved in CW services, with only one-third (33.3%) of these youth receiving MH services (Horwitz et al., 2012). A disproportionate underutilization of MH services has been well-established among children and youth of color with significant MH need who are involved in CW compared to their white counterparts (Garland et al., 2000; Garland, Landsverk, & Lau, 2003; Horwitz et al., 2012; Kim & Garcia, 2016). While underutilization of MH services is problematic in the general population (Merikangas et al., 2010), CW-involved children and youth, who are already connected to social services providers and might presumably have greater access to other MH services, are still much more likely to have unmet MH needs. This is particularly true for CW-involved children and youth of color. With longstanding leadership from organizations like SAMHSA, NCTSN, and ACF, these findings have contributed to ongoing policy changes at federal, state, and local levels, resulting in widespread screening implementation efforts in CW systems across the nation. In California, similar to many other states, class action litigation has been spurred by advocacy groups on behalf of former CW-involved youth whose MH needs were unmet while involved in CW services (Kosanovich, Joseph, & Hasbargen, 2005). The Katie A. et ADVANCES IN SOCIAL WORK, Spring 2017, 18(1) 337 al. v. Diana Bonta et al. Class Action Settlement Agreement (Case No. CV-02-05662 AHM [SHx]) [now referred to as Pathways to Mental Health Services (California Department of Social Services [DSS] & California Department of Health Care Services, n.d.)] established the requirement for each of California’s 58 county systems to implement screening procedures for identifying children and youth involved in CW with significant MH needs to help increase their access to MH assessment and treatment. Technical assistance and implementation materials, including monthly phone calls, a practice manual, and a review of screening tools (Crandal & Conradi, 2013), have been provided by the state through Pathways to Mental Health Services. State leaders have facilitated opportunities to support California’s county leaders with the development of procedures to identify children and youth involved in CW whose well-being has been disrupted, particularly as a result of maltreatment, and ensure referral to assessment and treatment (see California Department of Health Services, 2017; California Department of Social Services, 2017 for more information). Despite this new energy behind screening among children and youth involved with CW, there has also been considerable autonomy and some ambiguity for CW administrators and staff to implement the actual screening programs for the children and youth they serve, both in California and across the country. ACF has provided funding to technical assistance teams in multiple states across three cohorts to support state screening efforts by way of five-year grants (DHHS, ACF, 2011). However, in many CW systems, the mandates for screening led administrators to rapidly implement a screening process without piloting, technical assistance collaboration, or detailed planning. Questions remain regarding the constructs targeted by screening practices, the screening tools utilized, the ways tools are utilized, the ways screening practices are tied to intervention, how key decision points are prioritized, and how decision makers perceive their implementation efforts. To date, there has been no systematic evaluation of how screening efforts have been implemented by CW leaders and staff. The California screening implementation under Pathways to Mental Health Services presents an opportunity to investigate how CW systems have responded to screening mandates and to offer new frameworks for other CW systems moving to implement similar screening processes. The current study provides an investigation into new screening implementation efforts in CW services by characterizing California’s CW systems’ screening approaches, offering examples of how this aspect of TIC has been implemented in practice, and evaluating the diverse attempts to implement and sustain screening from a trauma-informed framework. Research Questions  Following statewide implementation efforts, what are the characteristics of screening approaches used in county CW systems to identify trauma-related and MH needs?  In response to policy mandates accompanied by broad implementation support, what are CW leaders’ perceptions of the selection and implementation of screening approaches for identifying trauma-related and MH needs? Crandal et al./IDENTIFYING NEED AND TIC 338 Methods Procedure California’s CW system is county-administered, with oversight provided by the state’s DSS. The authors developed a web-administered survey to obtain information on MH and trauma screening practices in each county. The survey invitation was disseminated through an email from the state’s association of human service directors to the association’s representative in each county CW agency. The California DSS also endorsed the need for counties to complete the survey. The email recipient was asked to identify one respondent in their county with knowledge of screening practices for children involved with CW, from either the county CW or MH agency (based on the particular county system responsible for screening in that county) to complete the survey. In order to maximize the response rate, two reminder emails were sent by the state association. An in-person reminder was also provided at a standing monthly meeting attended by representatives from county CW agencies and staff from the California DSS. The survey was administered between February 24, 2016, and March 23, 2016. Sample The survey was completed by a respondent from 46 of the 58 counties in California. The breakout of respondents by position in their agency was as follows: director or chief, 13.0%; assistant or deputy director, 19.6%; manager, 47.8%; supervisor, 6.5%; and other, 13.0%. The participating counties represented 96.8% of the state’s population according to 2010 census information (U.S. Census Bureau, 2015), and they represented 97.4% of the 46,261 CW case openings that occurred in all counties in the state between April 1, 2015 and March 31, 2016 (Webster et al., 2016). Based on the National Center for Health Statistics’ 2013 Urban-Rural Classification Scheme for Counties (Ingram & Franco, 2014), the percentage of counties in the sample in each urban-rural category and the percentage of counties in that category statewide, shown in parentheses, were as follows: 17.4% were large central metro (13.8% of counties in the state), 15.2% were large fringe metro (13.8% of counties in the state), 23.9% were medium metro (22.4% of counties in the state), 13.0% were small metro (13.8% of counties in the state), 13.0% were micropolitan (13.8% of counties in the state), and 17.4% were noncore (22.4% of counties in the state). Measure The web-based survey contained questions on screening practices for identifying MH and trauma-related needs of children involved with the CW system. Respondents were asked to indicate the extent to which screening had been implemented in their county (e.g., full implementation, partial implementation, implementation being planned, or no plans for implementation), the degree of satisfaction with current screening procedures, and whether changes in screening procedures were being considered. The survey contained a list of tools commonly used to screen or assess MH and trauma-related symptoms (see Table 1), and respondents were asked to indicate which tools were being used or considered by their county. An open field was included so respondents could also report on tools that did not appear on the list. An additional question asked about the age groups of children ADVANCES IN SOCIAL WORK, Spring 2017, 18(1) 339 being screened or being considered for screening (ranging from infants to transition-age youth). Finally, respondents were asked to rank order a list of 10 considerations (see Table 2) for determining a screening procedure/selecting screening tool(s) ranging from 1 (most important) to 10 (least important). Results Screening Implementation Status With regard to implementation status, 84.8% (n=39) of respondents reported that a screening procedure to identify MH and/or trauma-related needs of children involved with CW had been fully implemented in their county, 13.0% (n=6) indicated a screening procedure had been partially implemented, and 2.2% (n=1) reported that a screening procedure was being planned. Those who indicated that screening had been fully or partially implemented (n=45) were asked whether changes to screening were being considered (e.g., “We are thinking about changing our current screening tool(s)/procedures for MH and/or trauma-related needs”) and about satisfaction with screening (e.g., “We are satisfied with our current screening tool(s)/procedures for MH and/or trauma-related needs”). Both questions were rated on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree). Out of the 45 participants who answered the question, 20% (n=9) agreed that they were thinking about changing current screening tool(s)/procedures, 26.7% (n=12) were not sure, 37.8% (n=17) disagreed, and 15.6% (n=7) strongly disagreed (M=2.51, SD=0.99). As for their satisfaction with current screening tool(s)/procedures, 20% (n=9) of respondents strongly agreed they were satisfied, 57.8% (n=26) agreed, 15.6% (n=7) were not sure, 4.4% (n=2) disagreed, and 2.2% (n=1) strongly disagreed (M=3.89, SD=0.86). Screening Tools Being Used and Under Consideration Of the 46 participants, 44 reported use of at least one of the tools listed in the survey or reported use of at least one other tool that was not listed to screen for MH and/or trauma- related needs. Information on reported use of each tool for these 44 participants is shown in Table 1. The list of tools was presented in alphabetical order in the survey, but in Table 1, the tools are grouped into categories: tools to assess MH symptoms completed by caregivers and/or youth; tools to assess trauma-related symptoms completed by caregivers and/or youth; tools completed by providers; and unknown. Approximately half of the participants (52.3%; n=23) reported use of provider-completed tools only, 40.9% (n=18) reported use of both provider-completed and caregiver- and/or youth-completed tools (MH and/or trauma), and 6.8% (n=3) reported use of caregiver- and/or youth-completed tools only (MH and/or trauma). Almost a quarter (23.9%, n=11) of the 46 participants reported that at least one tool was being considered for use in their county to screen for MH and/or trauma-related needs. Information on tools being considered is also reported in Table 1. Of the 10 participants who answered the follow-up questions, 20.0% (n=2) were considering a provider- completed tool, 40.0% (n=4) were considering one or more caregiver- and/or youth- Crandal et al./IDENTIFYING NEED AND TIC 340 completed tools, and 40.0% (n=4) were considering both provider-completed and caregiver-and/or youth-completed tools. Table 1. Screening Tools Being Used and Under Consideration Being Used (n=44) Being Considered (n=11) Screening Tools n % n % Mental Health Symptoms – Caregiver- or Youth-Completed Ages and Stages Questionnaire: Social-Emotional (ASQ-SE) 18 40.9% 1 9.1% Child Behavior Checklist (CBCL) 3 6.8% 1 9.1% Pediatric Symptom Checklist (PSC) 1 9.1% Strengths and Difficulties Questionnaire (SDQ) 4 9.1% 2 18.2% Treatment Outcome Package (TOP) 4 36.4% Other 1 2.3% At least one caregiver-and/or youth-completed mental health tool 20 45.5% 8* 80.0% Trauma Symptoms – Caregiver- or Youth-Completed Acute Stress Checklist for Children (ASC-Kids) 3 6.8% 1 9.1% Child PTSD Symptom Checklist (CPSS) 1 9.1% Children’s Revised Impact of Event Scale (CRIES/CRIES-8) 1 9.1% Screen for Child Anxiety Related Disorder Brief Assessment of PTS Symptoms (SCARED-PTS) 3 6.8% 2 18.2% Trauma Symptom Checklist for Children (TSCC) 1 2.3% 1 9.1% Trauma Symptom Checklist for Young Children (TSCYC) 1 9.1% UCLA PTSD Reaction Index (UCLA PTSD RI) 2 4.5% 1 9.1% Other 2 4.5% 1 9.1% At least one caregiver- or youth-completed trauma tool 10 22.7% 2* 20.0% Provider-Completed Child and Adolescent Needs and Strengths-Mental Health or Trauma Version (CANS) 14 31.8% 6 54.5% Mental Health Screening Tool (MHST) 27 61.4% 2 18.2% Structured Decision Making (SDM)** 14 31.8% Agency-developed tool 2 4.5% At least one provider-completed tool 41 93.2% 6 60.0% Tool Unspecified by Respondent 2 4.5% 1 9.1% * number of respondents for these items=10 ** This row offers information on perception of use of SDM for screening purposes but is not representative of the proportion of counties who use SDM throughout the state for other purposes. Age Groups for Screening The following proportion of county administrator respondents (n=46) reported screening or planning to screen these different age groups of children: infant (0-1 years) 84.8%, toddler (2-3 years) 91.3%, preschool (4-5 years) 97.8%, middle childhood (6-11 ADVANCES IN SOCIAL WORK, Spring 2017, 18(1) 341 years) 100%, younger adolescent (12-14 years) 100%, older adolescent (15-18 years) 100%, and transition-age youth (19-21 years) 71.7%. Considerations for Determining Screening Tool(s) or Procedures Respondents’ ranking of considerations for determining screening tool(s) or procedures are reported in Table 2. A list of 10 considerations was provided in the survey and the respondent was asked to place the items in order of importance. The item “It’s evidence-based or supported by research” was ranked as most important by 56.5% (n=26) of respondents (Mdn=1.0), and the item “The tool(s) was designed to be completed by staff” was ranked as most important by 19.6% (n=9) of respondents (Mdn=3.0). Half of the items were ranked as most important by less than 10% of respondents, and three items were not ranked as most important by any of the respondents. Table 2. Ranking of Considerations for Selecting Screening Tool(s)/Procedures Considerations Median Range* High to Low % of respondents that ranked consideration as most important Other counties are already using it 6.0 1-10 8.7% It satisfies stakeholders (like county or state administrators) 5.0 1-10 4.3% It’s evidence-based or supported by research 1.0 1-10 56.5% Children, youth, and families like it 6.5 2-10 Staff like it 6.0 2-10 It doesn’t add extra strain on staff 6.0 1-10 4.3% It makes sense to me 7.0 2-10 The costs involved in using it 7.0 1-10 2.2% The tool(s) was designed to be completed by staff 3.0 1-10 19.6% The tool(s) was designed to be completed by parents/ caregivers and/or youth 8.0 1-10 4.3% *1=most important, 10=least important Discussion This evaluation of the Pathways to Mental Health Services screening process implementation offers several findings germane to TIC. Most participants perceived their screening process as fully implemented and expressed satisfaction with the process. Generally, these processes included screening all or nearly all ages of children and youth served, most commonly with practitioner-rated tools that examine general child functioning, potential for risk, or family strengths and needs. Survey results also showed that a majority of respondents collectively viewed “evidence-based or supported by research” as the top consideration when determining a screening tool or process in their respective counties. Although these findings are specific to California’s implementation of screening for CW-involved children, there are implementation considerations demonstrated here that can inform future attempts to broadly implement TIC. Crandal et al./IDENTIFYING NEED AND TIC 342 TIC Implementation Consideration 1: Maintaining Focus on Childhood Trauma After longstanding national emphasis on screening in CW as a crucial component of TIC, California’s statewide screening implementation ultimately occurred as a result of class action litigation with an emphasis on access to MH services. A focus on MH services was intended to convey an inclusive array of services, targeting trauma-related as well as other MH needs a child may have. The California DSS offered a practice model and technical assistance which included emphasis on the importance and role of TIC in this implementation effort. Disconcertingly, however, an open-ended focus on broad MH may have diluted the salience of identifying PTSD- and trauma-related needs for the CW- involved population at the county level, as evidenced by the 36 counties (78.3%) whose respondents reported no trauma-related content or results included in their screening tool approach. For more than a decade, TIC researchers have highlighted the importance of linking trauma-related needs with research-based trauma treatment services (Kerns et al., 2016; Ko et al., 2008; Taylor, Wilson, & Igelman, 2006), rather than general MH services (Leslie, Hurlburt, Landsverk, Barth, & Slymen, 2004). Advocates of TIC need to ensure the mission and meaning of TIC is directly translated into specific policies and implementation practices in future efforts, particularly within large multilayered systems where aspirational aspects of an effort may become attenuated across layers. TIC Implementation Consideration 2: Closing the Science-Practice Gap Of the four most commonly used tools used for screening reported in this survey, three are completed by professionals involved in the case, rather than by direct report from the child or caregiver. While there are examples of professional- or practitioner-completed measurement tools performing well and providing meaningful data, they are generally less represented in measurement literature (Crandal et al., 2015). This may, in part, be due to the risk for measurement error because the targeted construct is distanced from the measurement source. For example, measuring a child’s trauma history or symptoms from the point of view of a professional produces a score that represents the professional’s knowledge of the child’s history or symptoms, which can vary widely based on each professional’s interactions with the child, familiarity with the child’s case, understanding of screening procedures, or skill investigating childhood trauma. High caseloads, overburdened workers, and strained organizations or systems may exacerbate these potential sources for systematic measurement error (Podsakoff, MacKenzie, Lee, & Podsakoff, 2003). Since the psychometric performance of the practitioner-completed measurement method is not clearly established, particularly in applied settings, there is cause for caution when interpreting results from professional-rated screening tools. Additionally, literature review of peer-reviewed published research on several of the most commonly reported tools used for screening in the respondent counties suggested these tools were not developed for use as MH or trauma screening tools and have not been evaluated for performance when used to assist professionals making screening decisions (i.e., cut scores, ADVANCES IN SOCIAL WORK, Spring 2017, 18(1) 343 sensitivity, specificity, predictive power; Crandal & Conradi, 2013; Haynes, Smith, & Hunsley, 2011). Given these measurement concerns, the commonly implemented screening tools are often those with uncertain performance. Nonetheless, a majority of survey respondents ranked “It is evidence-based or supported by research” as the highest priority consideration when determining screening tools or procedures. This illustration of a science-practice gap in CW has been noted by others (Burns et al., 2004; Raghavan, Inoue, Ettner, Hamilton, & Landsverk, 2010). In his study of the use of research evidence in public youth‐serving systems, Palinkas (2015) found that systems leaders tend to rely on the availability of resources, local indications of a need, and their personal experience when deciding if they will use evidence to make changes. CW leaders were more likely than other system leaders to ignore evidence when making changes (Palinkas, 2015). Emerging literature on addressing the science-practice gap in CW calls for research-practice partnerships that build on cumulative and collaborative efforts to close the science-practice gap (Aarons & Chaffin, 2013; Palinkas, 2015; Palinkas, Short, & Wong, 2015; Testa et al., 2014). Future TIC implementation efforts in CW should address the science-practice gap beginning with an awareness of the need for collaboration among leaders with diverse science- and practice-related expertise. TIC Implementation Consideration 3: Evaluating the State of the Science While there are research-practice partnership and implementation models for expanding access to evidence-based practices for child-welfare-involved children (Palinkas et al., 2015; Testa et al., 2014), these models have focused on increasing access to established evidence-based treatments. Evidence-based screening for CW-involved youth, on the other hand, is still taking shape. Evidence-based screening is commonly misrepresented as merely the use of tools that have produced data that was found to have strong reliability and validity, sometimes without regard for screening-specific test performance (e.g., sensitivity, specificity, predictive power). There are measurement tools which have performed well when screening for general MH needs (Gardner, Lucas, Kolko, & Campo, 2007; Goodman, Ford, Simmons, Gatward, & Meltzer, 2000), as well as screening tools developed to detect trauma-related need or assess histories of childhood traumatic stress (Conradi, Wherry, & Kisiel, 2011; Crandal & Conradi, 2013). However, only recently have these tools been evaluated in broad CW contexts to identify children who might benefit from further MH assessment and treatment (Kerns et al., 2016). Nonetheless, “screening should involve a system, not just a test,” (Raffle & Gray, 2007, p. 42) and a screening system that is evidence-based includes evaluation of the screening test performance as well as the outcomes for individuals involved in the process. To date, TIC advocates do not have sufficient information about screening programs to determine how many children with positive screens are found to have serious MH conditions and benefit from treatment, how many children with positive screens are found to have no serious MH condition or do not benefit from treatment, how many children with negative screens later demonstrate significant MH need, or which services might be Crandal et al./IDENTIFYING NEED AND TIC 344 appropriate for children with negative screen results. Researchers, policy makers, administrators, and other stakeholders are embarking on a nascent application of a longstanding element of TIC. The barriers identified in the Pathways to Mental Health Services screening implementation process bring to light the importance of acceptability and feasibility in existing evidence-based screening models. Meaningful steps remain to understand and implement this crucial component of identifying children whose well-being has been disrupted by traumatic events and develop evidence-based screening processes that are feasible to implement in CW systems. Limitations The current study offers a point in time glimpse of an on-going, expansive implementation effort in a large state. There are a number of factors that have facilitated effective and ineffective aspects of implementation at the national, state, county, and local levels that are beyond the scope of this project. Furthermore, although attempts were made to identify the most appropriate respondent, data were collected based on report from a single representative from each county. Accuracy of the reported information was not assessed and the extent to which social desirability influenced responses is unknown. County screening programs are likely to involve multiple stakeholders with a range of perspectives and there may be additional information that was not captured based on the methodology used in this study. Respondents from different counties may have different perceptions of screening and the distinction of screening from assessment, which could contribute to imprecision in the survey responses. Finally, given the large county- administered organization of California’s CW services, these findings may not generalize to all other CW settings. Future Research Future attempts to explore broad screening implementation could include evaluations of fidelity and sustainment of the implementation effort (e.g., training and professional development among direct service staff, quality assurance monitoring, evaluating perceptions of the practice among staff providing the service) as well as evaluation of the effectiveness of the implemented TIC practices. Additionally, TIC implementation models would be useful to support CW organizations looking to implement specific practices. For example, Kerns and colleagues (2016) describe an approach to strengthening the CW workforce capacity to identify trauma symptoms for children and youth involved in services. This articles describes different screening approaches that were implemented or under consideration for implementation and leadership perceptions of those approaches in the context of a statewide effort. An implementation model, on the other hand, would examine the lessons learned from researchers and practitioners and concretize an implementation approach designed to be translated to different CW organizations. While further steps are needed to make trauma-related and mental health screening more accessible and practical for CW systems, this study offers information and considerations intended to encourage the progress of this crucial element of TIC. ADVANCES IN SOCIAL WORK, Spring 2017, 18(1) 345 References Aarons, G. A., & Chaffin, M. (2013). Scaling-up evidence-based practices in child welfare services systems. CYF News. Retrieved from http://www.apa.org/pi/families/resources/newsletter/2013/04/child-welfare.aspx Attorney General’s National Task Force on Children Exposed to Violence. (2012). Defending childhood. Washington, DC: Department of Justice. Burns, B. J., Phillips, S. D., Wagner, H. R., Barth, R. P., Kolko, D. J., Campbell, Y., & Landsverk, J. (2004). Mental health need and access to mental health services by youths involved with child welfare: A national survey. Journal of the American Academy of Child & Adolescent Psychiatry, 43, 960-970. doi: https://doi.org/10.1097/01.chi.0000127590.95585.65 California Department of Health Services [CDHS]. (2017). Katie A. Settlement Agreement Implementation. Retrieved from http://www.dhcs.ca.gov/Pages/KatieAImplementation.aspx California Department of Social Services [CDSS], & California Department of Health Care Services [CDHCS]. (n.d.). Pathways to mental health services: Core practice model guide. Retrieved from Katie A. Settlement Agreement Implementation website: http://www.dhcs.ca.gov/Documents/KACorePracticeModelGuideFINAL3-1-13.pdf CDSS. (2017). Welcome to the Information and Resource Guide. Retrieved from http://www.cdss.ca.gov/inforesources/Guide Conradi, L., Wherry, J., & Kisiel, C. (2011). Linking child welfare and mental health using trauma-informed screening and assessment practices. Child Welfare, 90(6), 129-147. Crandal, B., & Conradi, L. (2013). Review of child and adolescent trauma screening tools. San Diego, CA: Rady Children's Hospital, Chadwick Center for Children and Families. Crandal, B. R., Foster, S. L., Chapman, J. E., Cunningham, P. B., Brennan, P. A., & Whitmore, E. A. (2015). Therapist perception of treatment outcome: Evaluating treatment outcomes among youth with antisocial behavior problems. Psychological Assessment, 27(2), 710-725. doi: https://doi.org/10.1037/a0038555 Felitti, V. J., Anda, R. F., Nordenberg, D., Williamson, D. F., Spitz, A. M., Edwards, V., ... Marks, J. S. (1998). Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults: The Adverse Childhood Experiences (ACE) Study. American Journal of Preventive Medicine, 14(4), 245-258. doi: https://doi.org/10.1016/S0749-3797(98)00017-8 Gardner, W., Lucas, A., Kolko, D. J., & Campo, J. V. (2007). Comparison of the PSC-17 and alternative mental health screens in an at-risk primary care sample. Journal of the American Academy of Child & Adolescent Psychiatry, 46(5), 611-618. doi: https://doi.org/10.1097/chi.0b013e318032384b Garland, A. F., Hough, R. L., Landsverk, J. A., McCabe, K. M., Yeh, M., Ganger, W. C., & Reynolds, B. J. (2000). Racial and ethnic variations in mental health care utilization among children in foster care. Children's Services: Social Policy, Research, and Practice, 3, 133-146. doi: https://doi.org/10.1207/S15326918CS0303_1 http://www.apa.org/pi/families/resources/newsletter/2013/04/child-welfare.aspx https://doi.org/10.1097/01.chi.0000127590.95585.65 http://www.dhcs.ca.gov/Pages/KatieAImplementation.aspx http://www.dhcs.ca.gov/Documents/KACorePracticeModelGuideFINAL3-1-13.pdf http://www.cdss.ca.gov/inforesources/Guide https://doi.org/10.1037/a0038555 https://doi.org/10.1016/S0749-3797(98)00017-8 https://doi.org/10.1097/chi.0b013e318032384b https://doi.org/10.1207/S15326918CS0303_1 Crandal et al./IDENTIFYING NEED AND TIC 346 Garland, A. F., Landsverk, J. A., & Lau, A. S. (2003). Racial/ethnic disparities in mental health service use among children in foster care. Children and Youth Services Review, 25, 491-507. doi: https://doi.org/10.1016/S0190-7409(03)00032-X Goodman, R., Ford, T., Simmons, H., Gatward, R., & Meltzer, H. (2000). Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. The British Journal of Psychiatry, 177(6), 534-539. doi: https://doi.org/10.1192/bjp.177.6.534 Hanson, R. F., & Lang, J. (2016). A critical look at trauma-informed care among agencies and systems serving maltreated youth and their families. Child Maltreatment, 21(2), 95-100. doi: https://doi.org/10.1177/1077559516635274 Haynes, S. N., Smith, G. T., & Hunsley, J. D. (2011). Scientific foundations of clinical assessment. New York: Taylor & Francis. Horwitz, S. M., Hurlburt, M. S., Goldhaber-Fiebert, J. D., Heneghan, A. M., Zhang, J., Rolls- Reutz, J., ... Stein, R. E. (2012). Mental health services use by children investigated by child welfare agencies. Pediatrics, 130, 861-869. doi: https://doi.org/10.1542/peds.2012- 1330 Ingram, D. D., & Franco, S. J. (2014). 2013 NCHS urban–rural classification scheme for counties. Vital and Health Statistics, 2(166), 1-73. Retrieved from https://www.cdc.gov/nchs/data/series/sr_02/sr02_166.pdf Kerns, S. E., Pullmann, M. D., Negrete, A., Uomoto, J. A., Berliner, L., Shogren, D., ... Putnam, B. (2016). Development and implementation of a child welfare workforce strategy to build a trauma-informed system of support for foster care. Child Maltreatment, 21(2), 135-146. doi: https://doi.org/10.1177/1077559516633307 Kim, M., & Garcia, A. R. (2016). Measuring racial/ethnic disparities in mental health service use among children referred to the child welfare system. Child Maltreatment, 21(3), 218- 227. doi: https://doi.org/10.1177/1077559516656397 Ko, S. J., Ford, J. D., Kassam-Adams, N., Berkowitz, S. J., Wilson, C., Wong, M., ... Layne, C. M. (2008). Creating trauma-informed systems: Child welfare, education, first responders, health care, juvenile justice. Professional Psychology: Research and Practice, 39(4), 396-404. doi: https://doi.org/10.1037/0735-7028.39.4.396 Kosanovich, A., Joseph, R. M., & Hasbargen, K. (2005). Child welfare consent decrees: Analysis of thirty-five court actions from 1995 to 2005. Retrieved from The Hill’s website: http://thehill.com/sites/default/files/consentdecrees_0.pdf Larkin, H., Felitti, V. J., & Anda, R. F. (2014). Social work and adverse childhood experiences research: Implications for practice and health policy. Social Work in Public Health, 29, 1-16. doi: https://doi.org/10.1080/19371918.2011.619433 Leslie, L. K., Hurlburt, M. S., Landsverk, J., Barth, R., & Slymen, D. J. (2004). Outpatient mental health services for children in foster care: A national perspective. Child Abuse & Neglect, 28, 697–712. doi: https://doi.org/10.1016/j.chiabu.2004.01.004 McLaughlin, K. A., Koenen, K. C., Hill, E. D., Petukhova, M., Sampson, N. A., Zaslavsky, A. M., & Kessler, R. C. (2013). Trauma exposure and posttraumatic stress disorder in a https://doi.org/10.1016/S0190-7409(03)00032-X https://doi.org/10.1192/bjp.177.6.534 https://doi.org/10.1177/1077559516635274 https://doi.org/10.1542/peds.2012-1330 https://doi.org/10.1542/peds.2012-1330 https://www.cdc.gov/nchs/data/series/sr_02/sr02_166.pdf https://doi.org/10.1177/1077559516633307 https://doi.org/10.1177/1077559516656397 https://doi.org/10.1037/0735-7028.39.4.396 http://thehill.com/sites/default/files/consentdecrees_0.pdf https://doi.org/10.1080/19371918.2011.619433 https://doi.org/10.1016/j.chiabu.2004.01.004 ADVANCES IN SOCIAL WORK, Spring 2017, 18(1) 347 national sample of adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 52(8), 815-830. doi: https://doi.org/10.1016/j.jaac.2013.05.011 Merikangas, K. R., He, J. P., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., … Swendsen, J. (2010). Lifetime prevalence of mental disorders in US adolescents: Results from the National Comorbidity Survey Replication–Adolescent Supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 49, 980-989. doi: https://doi.org/10.1016/j.jaac.2010.05.017 National Child Traumatic Stress Network. (2007). Creating trauma-informed systems. Retrieved from http://www.nctsn.org/resources/topics/creating-trauma-informed-systems Palinkas, L. (2015). Innovation and the use of research evidence in public youth-serving systems. A Forum hosted by the American Youth Policy Forum. Retrieved from http://www.aypf.org/resources/examining-strategies-to-improve-the-use-of-research- evidence-in-child-welfare/ Palinkas, L. A., Short, C., & Wong, M. (2015). Research-practice partnerships for implementation of evidence-based practices in child welfare and child mental health. Retrieved from http://wtgrantfoundation.org/resource/research-practice-policy- partnerships-for-implementation-of-evidence-based-practices-in-child-welfare-and-child- mental-health Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879-903. doi: https://doi.org/10.1037/0021-9010.88.5.879 Raffle, A. E., & Gray, J. A. M. (2007). Screening: Evidence and practice. New York: Oxford University Press. doi: https://doi.org/10.1093/acprof:oso/9780199214495.001.0001 Raghavan, R., Inoue, M., Ettner, S. L., Hamilton, B. H., & Landsverk, J. (2010). A preliminary analysis of the receipt of mental health services consistent with national standards among children in the child welfare system. American Journal of Public Health, 100(4), 742-749. doi: https://doi.org/10.2105/AJPH.2008.151472 Taylor, N., Wilson, C., & Igelman, R. (2006). In pursuit of a more trauma-informed child welfare system. APSAC Advisor, 18, 4-9. Testa, M. F., DePanfilis, D., Huebner, R., Dionne, R., Deakins, B., & Baldwin, M. (2014). Bridging the gap between research and practice: The work of the steering team for the child welfare research and evaluation translational framework workgroup. Journal of Public Child Welfare, 8(4), 333-353. doi: https://doi.org/10.1080/15548732.2014.915910 U.S. Census Bureau. (2015). Annual estimates of the resident population: April 1, 2010 to July 1, 2015. Source: U.S. Census Bureau, Population Division Release Dates: For the United States, regions, divisions, states, and Puerto Rico Commonwealth, December 2015. For counties, municipios, metropolitan statistical areas, micropolitan statistical areas, metropolitan divisions, and combined statistical areas, March 2016. For Cities and Towns (Incorporated Places and Minor Civil Divisions), May 2016. U.S. Department of Health and Human Services, Administration for Children and Families, Administration on Children, Youth and Families, Children’s Bureau. (2011). Bryan https://doi.org/10.1016/j.jaac.2013.05.011 https://doi.org/10.1016/j.jaac.2010.05.017 http://www.nctsn.org/resources/topics/creating-trauma-informed-systems http://www.aypf.org/resources/examining-strategies-to-improve-the-use-of-research-evidence-in-child-welfare/ http://www.aypf.org/resources/examining-strategies-to-improve-the-use-of-research-evidence-in-child-welfare/ http://wtgrantfoundation.org/resource/research-practice-policy-partnerships-for-implementation-of-evidence-based-practices-in-child-welfare-and-child-mental-health http://wtgrantfoundation.org/resource/research-practice-policy-partnerships-for-implementation-of-evidence-based-practices-in-child-welfare-and-child-mental-health http://wtgrantfoundation.org/resource/research-practice-policy-partnerships-for-implementation-of-evidence-based-practices-in-child-welfare-and-child-mental-health https://doi.org/10.1037/0021-9010.88.5.879 https://doi.org/10.1093/acprof:oso/9780199214495.001.0001 https://doi.org/10.2105/AJPH.2008.151472 https://doi.org/10.1080/15548732.2014.915910 Crandal et al./IDENTIFYING NEED AND TIC 348 Samuels, Commissioner, Testimony before the Subcommittee on Federal Financial Management, Government Information, Federal Services, and International Security Senate Committee on Homeland Security and Governmental Affairs United States Senate December 1, 2011. Retrieved from http://www.hhs.gov/asl/testify/2011/06/t20110616a.html U.S. Department of Health and Human Services, Administration for Children and Families, Administration on Children, Youth and Families, Children’s Bureau. (2016). Child maltreatment 2014. Available from http://www.acf.hhs.gov/programs/cb/research-data- technology/statistics-research/child-maltreatment U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. (2011). Leading change: A plan for SAMHSA’s roles and actions 2011-2014. (HHS Publication No. [SMA] 11-4629). Rockville, MD: Author. Webster, D., Armijo, M., Lee, S., Dawson, W., Magruder, J., Exel, M., … & Kai, C. (2016). CCWIP reports. Retrieved from University of California at Berkeley California Child Welfare Indicators Project’s website: http://cssr.berkeley.edu/ucb_childwelfare Author note: Address correspondence to: Brent Crandal, PhD, Chadwick Center for Children and Families, Rady Children’s Hospital, 3020 Children’s Way, MC 5131, San Diego, CA 92123, bcrandal@rchsd.org This study was supported by the Children’s Bureau, Administration of Children, Youth, and Families, Grant #90C01101. The authors would like to thank the California Department of Social Services and California Welfare Directors Association administrators and staff who helped administer the survey used in this study, as well as the county administrators and staff who provided responses to the survey. We would also like to thank Charles Wilson, Lisa Conradi, Jared Martin, and Jennifer Demaree for their contributions to this project. http://www.hhs.gov/asl/testify/2011/06/t20110616a.html http://www.acf.hhs.gov/programs/cb/research-data-technology/statistics-research/child-maltreatment http://www.acf.hhs.gov/programs/cb/research-data-technology/statistics-research/child-maltreatment http://cssr.berkeley.edu/ucb_childwelfare mailto:bcrandal@rchsd.org