Home > FAQ > How do I fix a misclassified study design that changes my appraisal tool?

How do I fix a misclassified study design that changes my appraisal tool?

November 2, 2026
study design classificationcritical appraisal toolsrisk of bias assessmentsystematic review methodsevidence synthesis

Re-read the methods and results to confirm the actual design, reapply the matching appraisal tool, then record the corrected label and flag any downstream appraisal or synthesis changes.

A design label drives which appraisal instrument you use. The NHLBI quality tools are design-specific and focus reviewers on internal validity and flaws in study methods or implementation, so a wrong label points you at the wrong set of questions. For randomized trials, RoB 2 assesses a specific trial result across bias domains using signalling questions and written justifications, producing low risk, some concerns, or high risk judgements. A reporting checklist such as CONSORT 2025 supports complete reporting of randomized trials; it is not a design or quality appraisal tool, so it cannot substitute for the appraisal step.

  1. Re-read the methods and results sections and write down what the study actually did: how participants were assigned, what was compared, and how outcomes were measured. Expected result: a short factual description of the design that you can match against a design typology.
  2. Compare that description to the design typology you are using and assign the corrected label. Expected result: a single design label you can defend from the methods text, with the specific sentences that support it noted.
  3. Reapply the appraisal instrument that matches the corrected label, answering each signalling question or tool item and recording a written justification. Expected result: a new appraisal judgement tied to the corrected design.
  4. Record the corrected label and the new appraisal in your data-extraction or source list, keeping the original entry visible so the change is traceable. Expected result: an audit trail showing what changed and why.
  5. Flag every downstream item that used the old label, such as synthesis groupings, evidence tables, or summary judgements, and update each one. Expected result: a consistent record where the label and appraisal agree throughout.

When the methods text is ambiguous about assignment or comparison, mark the design as unresolved and check the full text or supplementary material before reapplying a tool. The NHLBI tools require users to define their own judgement parameters, so document the criteria you apply at each step.

←
PreviousHow do I fix a meta-analysis that pooled studies with incompatible designs?
NextHow do I fix a missing-outcome-data problem in my pooled analysis?
→