GRACE Checklist (Good ReseArch for Comparative Effectiveness)
The GRACE Checklist is a tool used to assess the quality of observational studies that compare the effectiveness or safety of different treatments in real-world settings. It helps identify studies reliable enough to support health technology assessments and decision-making.
At a glance
Use when
Assessing the methodological quality of observational studies for inclusion in systematic reviews, HTAs, or regulatory and reimbursement decision-making
Avoid when
Evaluating interventional studies (e.g., RCTs) or non-comparative observational research
Inputs
Observational comparative effectiveness study (e.g., cohort, case-control) comparing treatments (drugs, devices, procedures)
Outputs
Quality assessment score indicating methodological rigor and reliability of the study
How it works
The GRACE Checklist is a validated assessment tool designed for noninterventional comparative effectiveness research. It evaluates methodological rigor in observational studies through criteria such as use of concurrent comparators, new user design, equivalent outcome measurement, adjustment for confounders, handling of immortal time bias, and use of sensitivity analyses. Validated via classification and regression tree (CART) analysis against expert quality ratings, citation frequency, and journal impact factor, it demonstrates high sensitivity (71.43%) and specificity (80.95%) in identifying high-quality studies when using a composite quality outcome.
- HTA domains
- Clinical Effectiveness, Safety, Organisational aspects
- Assumptions
- High-quality observational studies should minimize bias through appropriate design and analysis choices; reliability can be predicted by specific methodological features
- Strengths
- Empirically validated using expert judgment, citation metrics, and journal impact factors,Demonstrates high sensitivity and specificity in identifying high-quality studies,Includes predictive items strongly associated with study quality, such as sensitivity analyses and proper handling of bias
- Limitations
- Developed and validated primarily by employees of a company providing services to the biopharmaceutical industry, raising potential conflict of interest concerns,May be less applicable to non-observational or non-comparative study designs,Validation based on a limited sample of 28 articles and 56 assessments
- Also known as
- Good Research for Comparative Effectiveness Checklist, GRACE Guidelines
Questions this answers
- › Is the observational study design robust enough to support reliable comparative effectiveness conclusions?
- › Are key biases such as immortal time bias adequately addressed?
- › Are outcomes measured equivalently across study groups?
- › Are known confounders and effect modifiers accounted for in the analysis?
- › Does the study use sensitivity analyses to test the robustness of results?
- › Is the study suitable for inclusion in health technology assessments?
References & sources
Similar by meaning
- Generalized Risk-Adjusted Cost-Effectiveness (GRACE)
- ISPOR Prospective Observational Studies to Assess Comparative Effectiveness Good Research Practices Task Force Report
- ISPOR Good Research Practices for Retrospective Database Analysis Checklist (Part I)
- Good Practices for Real-World Data Studies of Treatment Effectiveness
- JBI revised critical appraisal tool for RCTs
Beta record. Generated from the primary source via AI extraction and independent audit, pending final human review.