[Skip to Content]
[Skip to Content Landing]

Weighing the Benefits and Risks of Proliferating Observational Treatment AssessmentsObservational Cacophony, Randomized Harmony

Educational Objective
To understand the benefits and risks of proliferating observational treatment assessments
1 Credit CME

Amid the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic, substantial effort is being directed toward mining databases and publishing case series and reports that may provide insights into the epidemiology and clinical management of coronavirus disease 2019 (COVID-19). However, there is growing concern about whether attempts to infer causation about the benefits and risks of potential therapeutics from nonrandomized studies are providing insights that improve clinical knowledge and accelerate the search for needed answers, or whether these reports just add noise, confusion, and false confidence. Most of these studies include a caveat indicating that “randomized clinical trials are needed.” But disclaimers aside, does this approach help make the case for well-designed randomized clinical trials (RCTs) and accelerate their delivery?1 Or do observational studies reduce the likelihood of a properly designed trial being performed, thereby delaying the discovery of reliable truth?

Sign in to take quiz and track your certificates

Buy This Activity
Our websites may be periodically unavailable between 12:00am CT March 25, 2023 and 4:00pm CT March 26, 2023 for regularly scheduled maintenance.

JN Learning™ is the home for CME and MOC from the JAMA Network. Search by specialty or US state and earn AMA PRA Category 1 Credit(s)™ from articles, audio, Clinical Challenges and more. Learn more about CME/MOC

CME Disclosure Statement: Unless noted, all individuals in control of content reported no relevant financial relationships. If applicable, all relevant financial relationships have been mitigated.

Article Information

Corresponding Author: Robert M. Califf, MD, Verily Life Sciences, 269 E Grand Ave, South San Francisco, CA 94080 (robertcaliff@verily.com).

Published Online: July 31, 2020. doi:10.1001/jama.2020.13319

Conflict of Interest Disclosures: Dr Califf reported being head of clinical policy and strategy at Verily Life Sciences and Google Health, an adjunct professor of medicine at Duke University and Stanford University, a board member for Cytokinetics, and former commissioner for the FDA. Dr Hernandez reported receipt of grants and personal fees from AstraZeneca, Amgen, Boehringer Ingelheim, Novartis, and Merck, personal fees from Bayer, and grants from Janssen and Verily, as well as being the principal investigator for the Healthcare Worker Exposure & Outcomes Research (HEROES) Program funded by the Patient-Centered Outcomes Research Institute. Dr Landray reported receipt of grants from Boehringer Ingelheim, Novartis, The Medicines Company, Merck, Sharp & Dohme, and UK Biobank and being co–chief investigator for the RECOVERY trial of potential treatments for hospitalized patients with COVID-19, funded by UK Research & Innovation and the National Institute for Health Research (NIHR).

Funding/Support: Dr Landray is supported by Health Data Research UK, the NIHR Oxford Biomedical Research Centre, and the Medical Research Council Population Health Research Unit.

Role of the Funder/Sponsor: Supporters had no role in the preparation, review, or approval of the manuscript or decision to submit the manuscript for publication.

Additional Contributions: We thank Jonathan McCall, MS (Duke Forge, Duke University), for editorial assistance. No compensation other than usual salary was received.

References
1.
Kalil  AC .  Treating COVID-19—off-label drug use, compassionate use, and randomized clinical trials during pandemics.   JAMA. 2020;323(19):1897-1898. doi:10.1001/jama.2020.4742PubMedGoogle ScholarCrossref
2.
Halpern  SD , Truog  RD , Miller  FG .  Cognitive bias and public health policy during the COVID-19 pandemic.   JAMA. Published online June 29, 2020. doi:10.1001/jama.2020.11623PubMedGoogle Scholar
3.
Corrigan-Curay  J , Sacks  L , Woodcock  J .  Real-world evidence and real-world data for evaluating drug safety and effectiveness.   JAMA. 2018;320(9):867-868. doi:10.1001/jama.2018.10136PubMedGoogle ScholarCrossref
4.
Collins  R , Bowman  L , Landray  M , Peto  R .  The magic of randomization versus the myth of real-world evidence.   N Engl J Med. 2020;382(7):674-678. doi:10.1056/NEJMsb1901642PubMedGoogle ScholarCrossref
5.
London  AJ , Kimmelman  J .  Against pandemic research exceptionalism.   Science. 2020;368(6490):476-477. doi:10.1126/science.abc1731PubMedGoogle ScholarCrossref
6.
Mehra  MR , Ruschitzka  F , Patel  AN .  Retraction—hydroxychloroquine or chloroquine with or without a macrolide for treatment of COVID-19: a multinational registry analysis.   Lancet. 2020;395(10240):1820. doi:10.1016/S0140-6736(20)31324-6PubMedGoogle ScholarCrossref
7.
Horby  P , Mafham  M , Linsell  L ,  et al. Effect of hydroxychloroquine in hospitalized patients with COVID-19: preliminary results from a multi-centre, randomized, controlled trial. medRxiv. Preprint posted July 15, 2020. doi:10.1101/2020.07.15.20151852
8.
Q&A: Hydroxychloroquine and COVID-19. World Health Organization website. Published June 19, 2020. Accessed July 5, 2020. https://www.who.int/news-room/q-a-detail/q-a-hydroxychloroquine-and-covid-19
9.
Horby  P , Lim  WS , Emberson  J ,  et al. Effect of dexamethasone in hospitalized patients with COVID-19: preliminary report. medRxiv. Preprint posted June 22, 2020. doi:10.1101/2020.06.22.20137273
10.
Joyner  MJ , Bruno  KA , Klassen  SA ,  et al.  Safety update: COVID-19 convalescent plasma in 20,000 hospitalized patients.   Mayo Clin Proc. Published online July 19, 2020. doi:10.1016/j.mayocp.2020.06.028Google Scholar
AMA CME Accreditation Information

Credit Designation Statement: The American Medical Association designates this Journal-based CME activity activity for a maximum of 1.00  AMA PRA Category 1 Credit(s)™. Physicians should claim only the credit commensurate with the extent of their participation in the activity.

Successful completion of this CME activity, which includes participation in the evaluation component, enables the participant to earn up to:

  • 1.00 Medical Knowledge MOC points in the American Board of Internal Medicine's (ABIM) Maintenance of Certification (MOC) program;;
  • 1.00 Self-Assessment points in the American Board of Otolaryngology – Head and Neck Surgery’s (ABOHNS) Continuing Certification program;
  • 1.00 MOC points in the American Board of Pediatrics’ (ABP) Maintenance of Certification (MOC) program;
  • 1.00 Lifelong Learning points in the American Board of Pathology’s (ABPath) Continuing Certification program; and
  • 1.00 CME points in the American Board of Surgery’s (ABS) Continuing Certification program

It is the CME activity provider's responsibility to submit participant completion information to ACCME for the purpose of granting MOC credit.

Close
Want full access to the AMA Ed Hub?
After you sign up for AMA Membership, make sure you sign in or create a Physician account with the AMA in order to access all learning activities on the AMA Ed Hub
Buy this activity
Close
Want full access to the AMA Ed Hub?
After you sign up for AMA Membership, make sure you sign in or create a Physician account with the AMA in order to access all learning activities on the AMA Ed Hub
Buy this activity
Close
With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Education Center Collection Sign In Modal Right
Close

Name Your Search

Save Search
With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Close
Close

Lookup An Activity

or

My Saved Searches

You currently have no searches saved.

Close

My Saved Courses

You currently have no courses saved.

Close