Description

The Team Observation Measure (TOM), version 2.0  is designed to assess adherence to standards of high-quality Wraparound observed during team meeting sessions. The TOM consists of 36 indicators, organized into seven subscales - five dedicated to the key elements of Wraparound (as trained by the National Wraparound Implementation Center and assessed by the WFI-EZ), one that evaluates meeting attendance, and one that assesses facilitation skills: 

  • Full Meeting Attendance 

  • Effective Teamwork 

  • Driven by Strengths and Families 

  • Based on Priority Needs 

  • Use of Natural and Community Supports 

  • Outcomes-Based Process 

  • Skilled Facilitation  

 USES

The TOM 2.0 is administered by external evaluators or local-level supervisors during Wraparound team meetings. Working alone or in pairs, trained raters indicate whether or not each indicator was in evidence during the Wraparound team meeting session. These ratings are translated into a score for each subscale, as well as a total fidelity score for the session overall. 

LEARN MORE 

A series of three validation studies provide data on the reliability and validity of the TOM. The first examined data drawn from 1,078 Wraparound team meetings that were submitted by 59 unique sites. The research team found high levels of internal consistency, meaning that individual items reliably assessed what they were intended to assess: Wraparound fidelity. A second study of 23 team meeting observations was designed to assess inter-rater reliability. For this study, the research team examined TOM scores for pairs of raters who were trained on TOM observation and scoring procedures. Results of this analysis indicated substantial agreement across raters, although such agreement tended to be highest when both raters were external to the provider organizations that comprised the sample. The final study in this series focused on the validity of the TOM. In this analysis, the research team examined associations between TOM scores and those from the Wraparound Fidelity Index – 4 (WFI-4). The sample for this study included 47 of the 59 Wraparound sites included in Study 1. Findings were mixed with a large correlation between TOM and WFI-4 measures at the program level, but a small correlation at the site level and no correlation at the team level. Together, these findings provide evidence that the TOM is a reliable and valid indicator of Wraparound fidelity; however. For more information on the methods and results of these studies, please click here.