REPEAT Initiative (Reproducible Evidence: Practices to Enhance and Achieve Transparency)
The REPEAT Initiative aims to improve the reliability of real-world evidence studies by trying to reproduce published results using the same clinical data. It checks how well findings can be repeated and looks at how completely the original studies reported their methods. This helps decision-makers trust the evidence used for approving treatments and coverage policies.
At a glance
Use when
Assessing the reliability of real-world evidence for regulatory or coverage decisions, evaluating transparency of study reporting, improving methodological standards in observational research
Avoid when
When original study data or methods are entirely inaccessible or proprietary, or when rapid evidence synthesis is required without time for replication attempts
Inputs
Published real-world evidence studies, clinical practice data (e.g., electronic health records, claims databases), study protocols and reporting guidelines
Outputs
Reproduced effect sizes, reproducibility assessment, reporting completeness evaluation, recommendations for improved transparency
How it works
The REPEAT Initiative assessed reproducibility of 150 real-world evidence studies by reproducing effect sizes using the same healthcare databases as the original studies. It also evaluated reporting completeness in 250 studies. A high correlation (Pearson r = 0.85) was found between original and reproduced effect sizes, with median relative effect magnitude of 1.0 [IQR: 0.9–1.1]. Discrepancies were largely attributable to incomplete reporting and data updates. The initiative supports improved methodological transparency to enhance validity and regulatory/coverage decision-making.
- HTA domains
- Clinical Effectiveness, Costs & Economic Evaluation, Safety
- Assumptions
- Original studies used data sources that are accessible or reconstructable; sufficient detail is available to replicate analysis methods; updated data versions do not invalidate comparisons
- Strengths
- Systematically evaluates reproducibility across a large number of studies,Uses actual clinical practice data from the same databases as original studies,Highlights the impact of reporting quality on reproducibility
- Limitations
- Reproduction may be limited by access to exact data versions used in original studies,Some discrepancies may stem from data updates rather than methodological flaws,Focuses on statistical reproducibility, not necessarily clinical validity
- Also known as
- REPEAT Initiative
Questions this answers
References & sources
Similar by meaning
Beta record. Generated from the primary source via AI extraction and independent audit, pending final human review.