MASTER scale for methodological quality assessment: Reliability assessment and update

Abstract

In evidence synthesis of analytical studies, methodological quality (mQ) assessment is necessary to determine the extent to which internal validity safeguards are implemented in the included studies against a list of selected safeguards in an assessment tool. Such mQ tools consist of internal validity safeguards that are checked against those put in place by researchers when they undertake research to guard against systematic error in the design, conduct, and analysis of a study. However, consistency or agreement among the individuals undertaking an assessment of implemented safeguards in published research against those listed in a mQ tool needs to be documented to ensure that the tool is reliable. Therefore mQ tools need to have their interrater reliability tested in order to ensure the consistency of their use in research.