caa a22 4500 606152997 CHVBK 20210128100551.0 cr unu---uuuuu 210128e20150101xx s 000 0 eng 10.1007/s11121-014-0488-9 doi (NATIONALLICENCE)springer-10.1007/s11121-014-0488-9 Observational Measures of Implementer Fidelity for a School-Based Preventive Intervention: Development, Reliability, and Validity [Elektronische Daten] [Wendi Cross, Jennifer West, Peter Wyman, Karen Schmeelk-Cone, Yinglin Xia, Xin Tu, Michael Teisl, C. Brown, Marion Forgatch] Current measures of implementer fidelity often fail to adequately measure core constructs of adherence and competence, and their relationship to outcomes can be mixed. To address these limitations, we used observational methods to assess these constructs and their relationships to proximal outcomes in a randomized trial of a school-based preventive intervention (Rochester Resilience Project) designed to strengthen emotion self-regulation skills in first-third graders with elevated aggressive-disruptive behaviors. Within the intervention group (n = 203), a subsample (n = 76) of students was selected to reflect the overall sample. Implementers were 10 paraprofessionals. Videotaped observations of three lessons from year 1 of the intervention (14 lessons) were coded for each implementer-child dyad on adherence (content) and competence (quality). Using multilevel modeling, we examined how much of the variance in the fidelity measures was attributed to implementer and to the child within implementer. Both measures had large and significant variance accounted for by implementer (competence, 68%; adherence, 41%); child within implementer did not account for significant variance indicating that ratings reflected stable qualities of the implementer rather than the child. Raw adherence and competence scores shared 46% of variance (r = .68). Controlling for baseline differences and age, the amount (adherence) and quality (competence) of program delivered predicted children's enhanced response to the intervention on both child and parent reports after 6months, but not on teacher report of externalizing behavior. Our findings support the use of multiple observations for measuring fidelity and that adherence and competence are important components of fidelity which could be assessed by many programs using these methods. Society for Prevention Research, 2014 Implementer fidelity nationallicence Measurement nationallicence Adherence nationallicence Competence nationallicence Observation nationallicence Cross Wendi Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut West Jennifer Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut Wyman Peter Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut Schmeelk-Cone Karen Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut Xia Yinglin Department of Biostatistics and Computational Biology, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut Tu Xin Department of Biostatistics and Computational Biology, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut Teisl Michael Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut Brown C. Department of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA aut Forgatch Marion Oregon Social Learning Center, Eugene, OR, USA aut Prevention Science Springer US; http://www.springer-ny.com 16/1(2015-01-01), 122-132 1389-4986 16:1<122 2015 16 11121 https://doi.org/10.1007/s11121-014-0488-9 text/html Onlinezugriff via DOI BK010053 XK010053 XK010000 Metadata rights reserved Springer special CC-BY-NC licence nationallicence 1 research-article jats NATIONALLICENCE NATIONALLICENCE NL-springer NATIONALLICENCE 856 40 https://doi.org/10.1007/s11121-014-0488-9 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Cross Wendi Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut NATIONALLICENCE 700 1- West Jennifer Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut NATIONALLICENCE 700 1- Wyman Peter Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut NATIONALLICENCE 700 1- Schmeelk-Cone Karen Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut NATIONALLICENCE 700 1- Xia Yinglin Department of Biostatistics and Computational Biology, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut NATIONALLICENCE 700 1- Tu Xin Department of Biostatistics and Computational Biology, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut NATIONALLICENCE 700 1- Teisl Michael Department of Psychiatry, School of Medicine and Dentistry, University of Rochester, Rochester, NY, USA aut NATIONALLICENCE 700 1- Brown C. Department of Psychiatry and Behavioral Sciences, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA aut NATIONALLICENCE 700 1- Forgatch Marion Oregon Social Learning Center, Eugene, OR, USA aut NATIONALLICENCE 773 0- Prevention Science Springer US; http://www.springer-ny.com 16/1(2015-01-01), 122-132 1389-4986 16:1<122 2015 16 11121