child and family policy logo images: child with blocks, child smiling, circle of kids
Bridging the gap between research and public policy to improve the lives of children.

Child and Family Support Team Evaluation

Evaluating the North Carolina School-based Child and Family Support Teams

-Goal: To evaluate the CFST initiative and provide information for continuous improvement for those implementing the program. We will monitor the following outcomes:

  • Child, school and community outcomes
  • Information on the child and family team process
  • Parent and youth satisfaction with their involvement in the program
  • Perceptions from the nurse/social workers, community agencies, principals

Outcomes of Interest
  • ADMINISTRATIVE DATA
    • NC Public Schools
      • End of Year test scores
      • Attendance
      • Probability of being retained
      • Probability of dropping out of school
      • Probability of being suspended or expelled
      • Number of Infractions (disciplinary infractions
    • Social Services
      • Probability of receiving an out-of-home placement
      • Average length of stay among youth who enter foster carE
      • Probability of having an investigation
    • Juvenile Justice
      • Probability of being placed in detention facility or youth development center
      • Court referrals
  • SURVEY DATA
    • Students
      • Satisfaction with the Process
      • Satisfaction with the Outcomes
      • Changes in relationships with teachers, peers and family members
      • Changes in perceptions of school outcomes
    • Parents
      • Parents perception of the child and family team process
      • Parent satisfaction with the student's outcomes
      • Parent involvement in school
    • School Outcomes
      • Program Implementation Fidelity
      • Organizational Readiness to Change
    • Teacher Outcomes
      • Turnover Rate
      • Satisfaction with health and human services supports provided to assist them in achieving success in schools
    • Community
      • Collaboration across social service agencies

Propensity Score Matching

-One challenge with the design of the Child and Family Support Team Initiative is that neither the schools nor the students are randomly assigned to the program. In order to create an equivalent control group so that we can compare outcomes for schools and students we will use propensity score matching. Propensity scores are a statistical tool for matching two groups based on a host of characteristics. In this case, we can match students based on previous school achievement, demographic characteristics as well as school characteristics. For schools, we can match schools based on characteristics such as teacher tenure, percent of students receiving free and reduced lunch, average test scores, etc.

Once we have a control group we can compare change over time that occurs among students who are and are not involved with child and family support teams. Similarly we can compare changes over time for matched schools that do and do not have a child and family support team.

Continuous Quality Improvement Process

-One of the primary goals of our evaluation is to provide feedback to the program administrators. In particular we will examine what factors are related to success and try to provide this information quickly.