Evaluation Components for NYS Systems of Care

  • Document also available in Portable Document Format (PDF)
Source Perspective captured Questions Answered
Administrative Records Information collected on every enrolled youth/young adult What does the service population look like? Are we capturing the participants we hope to serve with this project?
Interviews with individuals involved with implementation
  • Facilitation Team
  • County leads
  • Supervisors
  • Peer TA state leads
  • Others who are strongly involved in implementation
How are different providers experiencing implementation? What are the successes and challenges?
Focus groups with recipients of Wraparound
  • Youth and Young Adults
  • Caregivers
How are youth and family participants experiencing Wraparound? What are the successes and challenges?
Meeting Notes review
  • Those attending implementation, county, and NYS team meetings
How is implementation going? What are the county/state priorities? What challenges have arisen, and how were they resolved?
Monthly County Reports
  • Supervisors/Leads for care managers, youth peers, and family peers
What is happening on the county level? What are the successes and challenges? What do counties need more assistance with?
IPP/Infrastructure Survey
  • County Supervisors/Leads (from monthly report responses)
  • State Project Directors
Is state and local infrastructure developing to support SOC? 4 specific indicators tracked:
  • Policy changes
  • Peer involvement in services
  • Individuals attending SOC trainings
  • Collaborative agreements completed between agencies/parties
Wraparound Fidelity Measures: WFI-EZ Survey
  • Youth and young adults
  • Caregivers
  • Facilitation Team
  • Other team members
Is Wraparound being delivered to NWI standards? How are team members experiencing Wraparound?
Wraparound Fidelity Measures: Team Observation Measure Direct Observation Is Wraparound being delivered to NWI standards? Is the meeting process operating according to the standards of Wraparound?
Wraparound Fidelity Measures: Document Assessment and Review Tool Review of Documentation Is Wraparound being delivered to NWI standards? Is the documentation available to assess whether standards are met? Does documentation offer support that Wraparound standards are being met in practice?
Interviews with Youth and Caregivers
  • Youth and Young Adults
  • Caregivers
How are outcomes changing during the Wraparound process?
  • Symptomology
  • Functioning
  • School Attendance
  • Arrests
  • Social Support
  • Caregiver Strain (Caregivers only)
  • Youth & Family Empowerment
  • Hope (Youth only) How are youth and family satisfied with services?
  • Perception of Care
CANS-NY Care mangers perspective of youth and family strengths and needs Are youth and caregiver strengths and needs changing during the Wraparound process? (e.g. a reduction in needs, or severity of needs, or an increase in strengths)
Medicaid data Services use and cost (for Medicaid participants only) Are participants experiencing a change in service use during and after the Wraparound process? (e.g., a reduction in formal services) Are participants using high cost/emergency services during and after Wraparound? (e.g., ER visits, RTFs, mental health inpatient stays)