Corresponding Author: Nancy J. Butcher, PhD, Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children, 686 Bay St, Toronto, ON M5G 0A4, Canada (nancy.butcher@sickkids.ca).
Accepted for Publication: October 28, 2022.
Published Online: December 13, 2022. doi:10.1001/jama.2022.21243
Author Contributions: Dr Butcher had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.
Concept and design: All authors.
Acquisition, analysis, or interpretation of data: All authors.
Drafting of the manuscript: Butcher.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: Monsour.
Obtained funding: Offringa.
Administrative, technical, or material support: Monsour, Mew, Baba.
Supervision: Butcher, Offringa.
Conflict of Interest Disclosures: Dr Butcher reported receiving grant funding from CHILD-BRIGHT and the Cundill Centre for Child and Youth Depression at the Centre for Addiction and Mental Health (CAMH) and receiving personal fees from Nobias Therapeutics. Ms Mew reported receiving salary support through a Canadian Institutes of Health Research doctoral foreign study award. Dr Grimshaw reported holding a Canada research chair in health knowledge transfer and uptake and receiving funding from the Ontario Ministry of Health, the Ottawa Hospital Academic Medical Organization, the National Institute of Health Research, and the National Health and Medical Research Council. Dr Kelly reported receiving funding from the Canadian Cancer Society, Research Manitoba, the Children’s Hospital Research Institute of Manitoba, Mitacs, and the SickKids Foundation. Dr Askie reported being a co-convenor of the Cochrane Prospective Meta-Analysis Methods Group. Dr Farid-Kapadia reported currently being an employee of Hoffmann La-Roche and holding shares in the company. Dr Williamson reported chairing the COMET initiative management group. Dr Szatmari reported receiving funding from the CAMH. Dr Tugwell reported co-chairing the OMERACT executive committee; receiving personal fees from the Reformulary Group, UCB Pharma GmbH, Parexel International, PRA Health Sciences, Amgen, AstraZeneca, Bristol Myers Squibb, Celgene, Eli Lilly, Genentech, Roche, Genzyme, Sanofi, Horizon Therapeutics, Merck, Novartis, Pfizer, PPD Inc, QuintilesIMS (now IQVIA), Regeneron Pharmaceuticals, Savient Pharmaceuticals, Takeda Pharmaceutical Co Ltd, Vertex Pharmaceuticals, Forest Pharmaceuticals, and Bioiberica; serving on data and safety monitoring boards for UCB Pharma GmbH, Parexel International, and PRA Health Sciences; and receiving unrestricted educational grants from the American College of Rheumatology and the European League of Rheumatology. Dr Monga reported receiving funding from the Cundill Centre for Child and Youth Depression at CAMH; receiving royalties from Springer for Assessing and Treating Anxiety Disorders in Young Children; and receiving personal fees from the TD Bank Financial Group for serving as a chair in child and adolescent psychiatry. Dr Ungar reported being supported by the Canada research chair in economic evaluation and technology assessment in child health. No other disclosures were reported.
Funding/Support: This work, project 148953, received financial support from the Canadian Institutes of Health Research.
Role of the Funder/Sponsor: The Canadian Institutes of Health Research had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Disclaimers: Dr Golub is Executive Deputy Editor of JAMA, but he was not involved in any of the decisions regarding review of the manuscript or its acceptance. This article reflects the views of the authors, the Delphi panelists, and the consensus meeting panelists and may not represent the views of the broader stakeholder groups, the authors’ institutions, or other affiliations.
Additional Contributions: We gratefully acknowledge the additional contributions made by the project core team, the executive team, the operations team, the Delphi panelists, and the international consensus meeting panelists (eAppendix 3 in the Supplement). We thank Andrea Chiaramida, BA, for administrative project support and Lisa Stallwood, MSc, for administrative manuscript support (both with The Hospital for Sick Children). We thank Petros Pechlivanoglou, PhD, and Robin Hayeems, PhD, for piloting and providing feedback on the format of the Delphi survey (both with The Hospital for Sick Children). None of these individuals received compensation for their role in the study.
Additional Information: The project materials and data are publicly available on the Open Science Framework at https://osf.io/arwy8/.
5.Calvert
M , Kyte
D , Mercieca-Bebber
R ,
et al; the SPIRIT-PRO Group. Guidelines for inclusion of patient-reported outcomes in clinical trial protocols: the SPIRIT-PRO extension.
JAMA. 2018;319(5):483-494. doi:
10.1001/jama.2017.21903PubMedGoogle ScholarCrossref 10.Kampman
JM , Sperna Weiland
NH , Hollmann
MW , Repping
S , Hermanides
J . High incidence of outcome switching observed in follow-up publications of randomized controlled trials: meta-research study.
J Clin Epidemiol. 2021;137:236-240. doi:
10.1016/j.jclinepi.2021.05.003PubMedGoogle ScholarCrossref 13.Mayo-Wilson
E , Fusco
N , Li
T , Hong
H , Canner
JK , Dickersin
K ; MUDS investigators. Multiple outcomes and analyses in clinical trials create challenges for interpretation and research synthesis.
J Clin Epidemiol. 2017;86:39-50. doi:
10.1016/j.jclinepi.2017.05.007PubMedGoogle ScholarCrossref 14.Butcher
NJ , Monsour
A , Mew
EJ ,
et al. Improving outcome reporting in clinical trial reports and protocols: study protocol for the Instrument for reporting Planned Endpoints in Clinical Trials (InsPECT).
Trials. 2019;20(1):161. doi:
10.1186/s13063-019-3248-0PubMedGoogle ScholarCrossref 17.Butcher
NJ , Monsour
A , Mew
EJ ,
et al. Guidelines for reporting outcomes in trial reports: the CONSORT-Outcomes 2022 extension.
JAMA. 2022;328(22):2252-2264. doi:
10.1001/jama.2022.21022Google Scholar 18.Butcher
NJ , Mew
EJ , Saeed
L ,
et al. Guidance for reporting outcomes in clinical trials: scoping review protocol.
BMJ Open. 2019;9(2):e023001.
PubMedGoogle Scholar 19.Hoffmann
TC , Glasziou
PP , Boutron
I ,
et al. Better reporting of interventions: Template for Intervention Description and Replication (TIDieR) checklist and guide.
BMJ. 2014;348:g1687. doi:
10.1136/bmj.g1687PubMedGoogle ScholarCrossref 21.Cordoba
G , Schwartz
L , Woloshin
S , Bae
H , Gøtzsche
PC . Definition, reporting, and interpretation of composite outcomes in clinical trials: systematic review.
BMJ. 2010;341:c3920. doi:
10.1136/bmj.c3920PubMedGoogle ScholarCrossref 25.de Vet
HCW , Terwee
CB , Mokkink
LB , Knol
DL .
Measurement in Medicine. Cambridge University Press; 2011. doi:
10.1017/CBO9780511996214 26.Cook
JA , Hislop
J , Adewuyi
TE ,
et al. Assessing methods to specify the target difference for a randomised controlled trial: DELTA (Difference ELicitation in TriAls) review.
Health Technol Assess. 2014;18(28). doi:
10.3310/hta18280Google ScholarCrossref 28.de Vet
HC , Beckerman
H , Terwee
CB , Terluin
B , Bouter
LM . Definition of clinical differences.
J Rheumatol. 2006;33(2):434-435.
PubMedGoogle Scholar 30.COSMIN. Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) is an initiative of an international multidisciplinary team of researchers. Accessed April 13, 2021.
https://www.cosmin.nl/ 31.Hopewell
S , Dutton
S , Yu
LM , Chan
AW , Altman
DG . The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed.
BMJ. 2010;340:c723. doi:
10.1136/bmj.c723PubMedGoogle ScholarCrossref 33.Mokkink
LB , Terwee
CB , Patrick
DL ,
et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes.
J Clin Epidemiol. 2010;63(7):737-745. doi:
10.1016/j.jclinepi.2010.02.006PubMedGoogle ScholarCrossref 36.Cook
JA , Julious
SA , Sones
W ,
et al. Practical help for specifying the target difference in sample size calculations for RCTs: the DELTA
2 five-stage study, including a workshop.
Health Technol Assess. 2019;23(60):1-88. doi:
10.3310/hta23600PubMedGoogle ScholarCrossref 37.Cook
JA , Julious
SA , Sones
W ,
et al. DELTA
2 guidance on choosing the target difference and undertaking and reporting the sample size calculation for a randomised controlled trial.
BMJ. 2018;363:k3750-k3750. doi:
10.1136/bmj.k3750PubMedGoogle ScholarCrossref 44.Gorst
SL , Prinsen
CAC , Salcher-Konrad
M , Matvienko-Sikar
K , Williamson
PR , Terwee
CB . Methods used in the selection of instruments for outcomes included in core outcome sets have improved since the publication of the COSMIN/COMET guideline.
J Clin Epidemiol. 2020;125:64-75. doi:
10.1016/j.jclinepi.2020.05.021PubMedGoogle ScholarCrossref 45.Collister
D , Bangdiwala
S , Walsh
M ,
et al. Patient reported outcome measures in clinical trials should be initially analyzed as continuous outcomes for statistical significance and responder analyses should be reserved as secondary analyses.
J Clin Epidemiol. 2021;134:95-102. doi:
10.1016/j.jclinepi.2021.01.026PubMedGoogle ScholarCrossref 46.Kravitz
RL , Duan
N ; DEcIDE Methods Center N-of-1 Guidance Panel, eds. Design and Implementation of N-of-1 Trials: A User’s Guide. Agency for Healthcare Research and Quality; 2014.
48.Woaye-Hune
P , Hardouin
JB , Lehur
PA , Meurette
G , Vanier
A . Practical issues encountered while determining minimal clinically important difference in patient-reported outcomes.
Health Qual Life Outcomes. 2020;18(1):156. doi:
10.1186/s12955-020-01398-wPubMedGoogle ScholarCrossref 49.Mouelhi
Y , Jouve
E , Castelli
C , Gentile
S . How is the minimal clinically important difference established in health-related quality of life instruments? review of anchors and methods.
Health Qual Life Outcomes. 2020;18(1):136. doi:
10.1186/s12955-020-01344-wPubMedGoogle ScholarCrossref 51.Devji
T , Carrasco-Labra
A , Qasim
A ,
et al. Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study.
BMJ. 2020;369:m1714. doi:
10.1136/bmj.m1714PubMedGoogle ScholarCrossref 55.Butcher
NJ , Mew
E , Monsour
A ,
et al. A scoping review of outcome-reporting recommendations for clinical trial protocols and reports. Accessed April 26, 2022.
https://osf.io/6f5x7/ 60.Cohen
SB , Strand
V , Aguilar
D , Ofman
JJ . Patient- versus physician-reported outcomes in rheumatoid arthritis patients treated with recombinant interleukin-1 receptor antagonist (anakinra) therapy.
Rheumatology (Oxford). 2004;43(6):704-711. doi:
10.1093/rheumatology/keh152PubMedGoogle ScholarCrossref