Interrater reliability of the Wolf Motor Function Test-Functional Ability Scale: why it matters.

MedStar author(s):
Citation: Neurorehabilitation & Neural Repair. 29(5):436-43, 2015 Jun.PMID: 25323459Institution: MedStar National Rehabilitation NetworkForm of publication: Journal ArticleMedline article type(s): Journal Article | Research Support, N.I.H., ExtramuralYear: 2015Local holdings: Available online from MWHC library: 2006 - 2009, Available in print through MWHC library: 1999 - March 2006ISSN:
  • 1545-9683
Name of journal: Neurorehabilitation and neural repairAbstract: BACKGROUND: One important objective for clinical trialists in rehabilitation is determining efficacy of interventions to enhance motor behavior. In part, limitation in the precision of measurement presents a challenge. The few valid, low-cost observational tools available to assess motor behavior cannot escape the variability inherent in test administration and scoring. This is especially true when there are multiple evaluators and raters, as in the case of multisite randomized controlled trials (RCTs). One way to enhance reliability and reduce variability is to implement rigorous quality control (QC) procedures.CONCLUSIONS AND IMPLICATIONS: A systematic focus-group process was shown to be an effective method to improve reliability of observational assessment tools for motor behavior in neurorehabilitation. A reduction in noise-related variability in performance assessments will increase power and potentially lower the number needed to treat. Improved precision of measurement can lead to more cost-effective and efficient clinical trials. Finally, we suggest that improved precision in measures of motor behavior may provide more insight into recovery mechanisms than a single measure of movement time alone.Copyright © The Author(s) 2014.METHODS: The QC process, a systematic focus-group collaboration, was developed and used for a phase III RCT, which enlisted multiple evaluators and an experienced WMFT-FAS rater panel.OBJECTIVE: This article describes a systematic QC process used to refine the administration and scoring procedures for the Wolf Motor Function Test (WMFT)-Functional Ability Scale (FAS).RESULTS: After 3 staged refinements to the administration and scoring instructions, we achieved a sufficiently high interrater reliability (weighted kappa = 0.8).All authors: Dromerick AW, Duff SV, He J, Lane CJ, Nelsen MA, Rowe VT, Winstein CJ, Wolf SLFiscal year: FY2015Digital Object Identifier: Date added to catalog: 2016-05-24
Holdings
Item type Current library Collection Call number Status Date due Barcode
Journal Article MedStar Authors Catalog Article 25323459 Available 25323459

Available online from MWHC library: 2006 - 2009, Available in print through MWHC library: 1999 - March 2006

BACKGROUND: One important objective for clinical trialists in rehabilitation is determining efficacy of interventions to enhance motor behavior. In part, limitation in the precision of measurement presents a challenge. The few valid, low-cost observational tools available to assess motor behavior cannot escape the variability inherent in test administration and scoring. This is especially true when there are multiple evaluators and raters, as in the case of multisite randomized controlled trials (RCTs). One way to enhance reliability and reduce variability is to implement rigorous quality control (QC) procedures.

CONCLUSIONS AND IMPLICATIONS: A systematic focus-group process was shown to be an effective method to improve reliability of observational assessment tools for motor behavior in neurorehabilitation. A reduction in noise-related variability in performance assessments will increase power and potentially lower the number needed to treat. Improved precision of measurement can lead to more cost-effective and efficient clinical trials. Finally, we suggest that improved precision in measures of motor behavior may provide more insight into recovery mechanisms than a single measure of movement time alone.Copyright © The Author(s) 2014.

METHODS: The QC process, a systematic focus-group collaboration, was developed and used for a phase III RCT, which enlisted multiple evaluators and an experienced WMFT-FAS rater panel.

OBJECTIVE: This article describes a systematic QC process used to refine the administration and scoring procedures for the Wolf Motor Function Test (WMFT)-Functional Ability Scale (FAS).

RESULTS: After 3 staged refinements to the administration and scoring instructions, we achieved a sufficiently high interrater reliability (weighted kappa = 0.8).

English

Powered by Koha