Frequency of Adverse Events in the Placebo Arms of COVID-19 Vaccine Trials | Clinical Pharmacy and Pharmacology | JN Learning | AMA Ed Hub [Skip to Content]
[Skip to Content Landing]

Frequency of Adverse Events in the Placebo Arms of COVID-19 Vaccine TrialsA Systematic Review and Meta-analysis

Educational Objective
To identify the key insights or developments described in this article
1 Credit CME
Key Points

Question  What was the frequency of adverse events (AEs) in the placebo groups of COVID-19 vaccine trials?

Findings  In this systematic review and meta-analysis of 12 articles including AE reports for 45 380 trial participants, systemic AEs were experienced by 35% of placebo recipients after the first dose and 32% after the second. Significantly more AEs were reported in the vaccine groups, but AEs in placebo arms (“nocebo responses”) accounted for 76% of systemic AEs after the first COVID-19 vaccine dose and 52% after the second dose.

Meaning  This study found that the rate of nocebo responses in placebo arms of COVID-19 vaccine trials was substantial; this finding should be considered in public vaccination programs.

Abstract

Importance  Adverse events (AEs) after placebo treatment are common in randomized clinical drug trials. Systematic evidence regarding these nocebo responses in vaccine trials is important for COVID-19 vaccination worldwide especially because concern about AEs is reported to be a reason for vaccination hesitancy.

Objective  To compare the frequencies of AEs reported in the placebo groups of COVID-19 vaccine trials with those reported in the vaccine groups.

Data Sources  For this systematic review and meta-analysis, the Medline (PubMed) and Cochrane Central Register of Controlled Trials (CENTRAL) databases were searched systematically using medical subheading terms and free-text keywords for trials of COVID-19 vaccines published up to July 14, 2021.

Study Selection  Randomized clinical trials of COVID-19 vaccines that investigated adults aged 16 years or older were selected if they assessed solicited AEs within 7 days of injection, included an inert placebo arm, and provided AE reports for both the vaccine and placebo groups separately. Full texts were reviewed for eligibility by 2 independent reviewers.

Data Extraction and Synthesis  Data extraction and quality assessment were performed independently by 2 reviewers, adhering to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guideline and using the Cochrane risk-of-bias tool. Meta-analyses were based on random-effects models.

Main Outcomes and Measures  The primary outcomes were the proportions of placebo recipients reporting overall, systemic, and local (injection-site) AEs as well as logarithmic odds ratios (ORs) to evaluate group differences. Outcomes were tested for significance using z tests with 95% CIs.

Results  Twelve articles with AE reports for 45 380 participants (22 578 placebo recipients and 22 802 vaccine recipients) were analyzed. After the first dose, 35.2% (95% CI, 26.7%-43.7%) of placebo recipients experienced systemic AEs, with headache (19.3%; 95% CI, 13.6%-25.1%) and fatigue (16.7%; 95% CI, 9.8%-23.6%) being most common. After the second dose, 31.8% (95% CI, 28.7%-35.0%) of placebo recipients reported systemic AEs. The ratio between placebo and vaccine arms showed that nocebo responses accounted for 76.0% of systemic AEs after the first COVID-19 vaccine dose and for 51.8% after the second dose. Significantly more vaccine recipients reported AEs, but the group difference for systemic AEs was small after the first dose (OR, −0.47; 95% CI, −0.54 to −0.40; P < .001; standardized mean difference, −0.26; 95% CI, −0.30 to −0.22) and large after the second dose (OR, −1.36; 95% CI, −1.86 to −0.86; P < .001; standardized mean difference, −0.75; 95% CI, −1.03 to −0.47).

Conclusions and Relevance  In this systematic review and meta-analysis, significantly more AEs were reported in vaccine groups compared with placebo groups, but the rates of reported AEs in the placebo arms were still substantial. Public vaccination programs should consider these high rates of AEs in placebo arms.

Sign in to take quiz and track your certificates

Buy This Activity

JN Learning™ is the home for CME and MOC from the JAMA Network. Search by specialty or US state and earn AMA PRA Category 1 CME Credit™ from articles, audio, Clinical Challenges and more. Learn more about CME/MOC

CME Disclosure Statement: Unless noted, all individuals in control of content reported no relevant financial relationships. If applicable, all relevant financial relationships have been mitigated.

Article Information

Accepted for Publication: November 22, 2021.

Published: January 18, 2022. doi:10.1001/jamanetworkopen.2021.43955

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2022 Haas JW et al. JAMA Network Open.

Correction: This article was corrected on February 11, 2022, to fix an error in Figure 1.

Corresponding Author: Julia W. Haas, PhD, Program in Placebo Studies, Beth Israel Deaconess Medical Center, 330 Brookline Ave, Ste 1309, Boston, MA 02215 (juliawhaas@gmail.com).

Author Contributions: Dr Haas and Ms Bender contributed equally to this study. Dr Rief and Prof Kaptchuk contributed equally to this study. Dr Haas and Ms Bender had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Haas, Bender, Ballou, Wilhelm, Miller, Kaptchuk.

Acquisition, analysis, or interpretation of data: Haas, Bender, Kelley, Rief, Kaptchuk.

Drafting of the manuscript: Haas, Bender, Kaptchuk.

Critical revision of the manuscript for important intellectual content: Bender, Ballou, Kelley, Wilhelm, Miller, Rief, Kaptchuk.

Statistical analysis: Haas, Bender, Kelley, Wilhelm.

Obtained funding: Haas.

Administrative, technical, or material support: Rief.

Supervision: Ballou, Kelley, Wilhelm, Rief, Kaptchuk.

Conflict of Interest Disclosures: Dr Haas reported receiving a postdoctoral scholarship from the German Academic Exchange Service (Deutscher Akademischer Austauschdienst) during the conduct of the study. No other disclosures were reported.

References
1.
World Health Organisation. WHO coronavirus (COVID-19) dashboard. 2021. Accessed November 10, 2021. https://covid19.who.int/
2.
Khubchandani  J , Sharma  S , Price  JH , Wiblishauser  MJ , Sharma  M , Webb  FJ .  COVID-19 vaccination hesitancy in the United States: a rapid national assessment.   J Community Health. 2021;46(2):270-277. doi:10.1007/s10900-020-00958-x PubMedGoogle ScholarCrossref
3.
Razai  MS , Chaudhry  UAR , Doerholt  K , Bauld  L , Majeed  A .  COVID-19 vaccination hesitancy.   BMJ. 2021;373(n1138):n1138. doi:10.1136/bmj.n1138 PubMedGoogle Scholar
4.
Robinson  E , Jones  A , Lesser  I , Daly  M .  International estimates of intended uptake and refusal of COVID-19 vaccines: a rapid systematic review and meta-analysis of large nationally representative samples.   Vaccine. 2021;39(15):2024-2034. doi:10.1016/j.vaccine.2021.02.005 PubMedGoogle ScholarCrossref
5.
World Health Organization. Ten threats to global health in 2019. Accessed September 1, 2021. https://www.who.int/news-room/spotlight/ten-threats-to-global-health-in-2019
6.
Taylor  S , Landry  CA , Paluszek  MM , Groenewoud  R , Rachor  GS , Asmundson  GJG .  A proactive approach for managing COVID-19: the importance of understanding the motivational roots of vaccination hesitancy for SARS-CoV2.   Front Psychol. 2020;11:575950. doi:10.3389/fpsyg.2020.575950 PubMedGoogle Scholar
8.
Smith  LE , Amlôt  R , Weinman  J , Yiend  J , Rubin  GJ .  Why do parents not re-vaccinate their child for influenza? a prospective cohort study.   Vaccine. 2020;38(27):4230-4235. doi:10.1016/j.vaccine.2020.04.029 PubMedGoogle ScholarCrossref
9.
Schmid  P , Rauber  D , Betsch  C , Lidolt  G , Denker  ML .  Barriers of influenza vaccination intention and behavior—a systematic review of influenza vaccine hesitancy, 2005-2016.   PLoS One. 2017;12(1):e0170550. doi:10.1371/journal.pone.0170550 PubMedGoogle Scholar
10.
Ramsey  MA , Marczinski  CA .  College students’ perceptions of H1N1 flu risk and attitudes toward vaccination.   Vaccine. 2011;29(44):7599-7601. doi:10.1016/j.vaccine.2011.07.130 PubMedGoogle ScholarCrossref
11.
Gorman  JR , Brewer  NT , Wang  JB , Chambers  CD .  Theory-based predictors of influenza vaccination among pregnant women.   Vaccine. 2012;31(1):213-218. doi:10.1016/j.vaccine.2012.10.064 PubMedGoogle ScholarCrossref
12.
Sun  KS , Lam  TP , Kwok  KW , Lam  KF , Wu  D , Ho  PL .  Seasonal influenza vaccine uptake among Chinese in Hong Kong: barriers, enablers and vaccination rates.   Hum Vaccin Immunother. 2020;16(7):1675-1684. doi:10.1080/21645515.2019.1709351 PubMedGoogle ScholarCrossref
13.
Howick  J , Webster  R , Kirby  N , Hood  K .  Rapid overview of systematic reviews of nocebo effects reported by patients taking placebos in clinical trials.   Trials. 2018;19(1):674. doi:10.1186/s13063-018-3042-4 PubMedGoogle ScholarCrossref
14.
Barsky  AJ , Saintfort  R , Rogers  MP , Borus  JF .  Nonspecific medication side effects and the nocebo phenomenon.   JAMA. 2002;287(5):622-627. doi:10.1001/jama.287.5.622 PubMedGoogle ScholarCrossref
15.
Rief  W , Barsky  AJ , Glombiewski  JA , Nestoriuc  Y , Glaesmer  H , Braehler  E .  Assessing general side effects in clinical trials: reference data from the general population.   Pharmacoepidemiol Drug Saf. 2011;20(4):405-415. doi:10.1002/pds.2067 PubMedGoogle ScholarCrossref
16.
Benedetti  F , Lanotte  M , Lopiano  L , Colloca  L .  When words are painful: unraveling the mechanisms of the nocebo effect.   Neuroscience. 2007;147(2):260-271. doi:10.1016/j.neuroscience.2007.02.020 PubMedGoogle ScholarCrossref
17.
Amanzio  M , Corazzini  LL , Vase  L , Benedetti  F .  A systematic review of adverse events in placebo groups of anti-migraine clinical trials.   Pain. 2009;146(3):261-269. doi:10.1016/j.pain.2009.07.010 PubMedGoogle ScholarCrossref
18.
Rief  W , Nestoriuc  Y , von Lilienfeld-Toal  A ,  et al.  Differences in adverse effect reporting in placebo groups in SSRI and tricyclic antidepressant trials: a systematic review and meta-analysis.   Drug Saf. 2009;32(11):1041-1056. doi:10.2165/11316580-000000000-00000 PubMedGoogle ScholarCrossref
19.
Pan  Y , Kinitz  T , Stapic  M , Nestoriuc  Y .  Minimizing drug adverse events by informing about the nocebo effect—an experimental study.   Front Psychiatry. 2019;10:504. doi:10.3389/fpsyt.2019.00504 PubMedGoogle ScholarCrossref
20.
Ballou  S , Iturrino  J , Rangan  V ,  et al.  Improving medication tolerance: a pilot study in disorders of gut-brain interaction treated with tricyclic antidepressants.   J Clin Gastroenterol. 2021;(June). doi:10.1097/MCG.0000000000001575 PubMedGoogle Scholar
21.
Faasse  K , Huynh  A , Pearson  S , Geers  AL , Helfer  SG , Colagiuri  B .  The influence of side effect information framing on nocebo effects.   Ann Behav Med. 2019;53(7):621-629. doi:10.1093/abm/kay071 PubMedGoogle ScholarCrossref
22.
Wilhelm  M , Rief  W , Doering  BK .  Decreasing the burden of side effects through positive message framing: an experimental proof-of-concept study.   Int J Behav Med. 2018;25(4):381-389. doi:10.1007/s12529-018-9726-z PubMedGoogle ScholarCrossref
23.
O’Connor  AM , Pennie  RA , Dales  RE .  Framing effects on expectations, decisions, and side effects experienced: the case of influenza immunization.   J Clin Epidemiol. 1996;49(11):1271-1276. doi:10.1016/S0895-4356(96)00177-1 PubMedGoogle ScholarCrossref
24.
Howe  LC , Leibowitz  KA , Perry  MA ,  et al.  Changing patient mindsets about non-life-threatening symptoms during oral immunotherapy: a randomized clinical trial.   J Allergy Clin Immunol Pract. 2019;7(5):1550-1559. doi:10.1016/j.jaip.2019.01.022 PubMedGoogle ScholarCrossref
25.
Mitsikostas  DD , Mantonakis  L , Chalarakis  N .  Nocebo in clinical trials for depression: a meta-analysis.   Psychiatry Res. 2014;215(1):82-86. doi:10.1016/j.psychres.2013.10.019 PubMedGoogle ScholarCrossref
26.
Benedetti  F , Amanzio  M , Vighetti  S , Asteggiano  G .  The biochemical and neuroendocrine bases of the hyperalgesic nocebo effect.   J Neurosci. 2006;26(46):12014-12022. doi:10.1523/JNEUROSCI.2947-06.2006 PubMedGoogle ScholarCrossref
27.
Palermo  S , Giovannelli  F , Bartoli  M , Amanzio  M .  Are patients with schizophrenia spectrum disorders more prone to manifest nocebo-like-effects? a meta-analysis of adverse events in placebo groups of double-blind antipsychotic trials.   Front Pharmacol. 2019;10:502. doi:10.3389/fphar.2019.00502 PubMedGoogle ScholarCrossref
28.
Mahr  A , Golmard  C , Pham  E , Iordache  L , Deville  L , Faure  P .  Types, frequencies, and burden of nonspecific adverse events of drugs: analysis of randomized placebo-controlled clinical trials.   Pharmacoepidemiol Drug Saf. 2017;26(7):731-741. doi:10.1002/pds.4169 PubMedGoogle ScholarCrossref
29.
Bender  F , Rief  W , Wilhelm  M . Really just a little prick? a meta-analysis on adverse events in placebo control groups of seasonal influenza vaccination RCTs. Abstract #O1505. Third International Conference of the Society for Interdisciplinary Placebo Studies (SIPS); May 26-28, 2021; Baltimore, MD.
30.
Amanzio  M , Cipriani  GE , Bartoli  M .  How do nocebo effects in placebo groups of randomized controlled trials provide a possible explicative framework for the COVID-19 pandemic?   Expert Rev Clin Pharmacol. 2021;14(4):439-444. doi:10.1080/17512433.2021.1900728 PubMedGoogle ScholarCrossref
31.
Rief  W . Fear of adverse effects and COVID-19 vaccine hesitancy: recommendations of the treatment expectation expert group. JAMA Heal Forum. 2021;2(4):e210804. doi:10.1001/jamahealthforum.2021.0804
32.
Page  MJ , McKenzie  JE , Bossuyt  PM ,  et al.  The PRISMA 2020 statement: an updated guideline for reporting systematic reviews.   BMJ. 2021;372(n71):n71. doi:10.1136/bmj.n71 PubMedGoogle Scholar
33.
Higgins  JPT , Altman  DG , Gøtzsche  PC ,  et al; Cochrane Bias Methods Group; Cochrane Statistical Methods Group.  The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials.   BMJ. 2011;343:d5928. doi:10.1136/bmj.d5928 PubMedGoogle ScholarCrossref
34.
Microsoft Excel. Microsoft Corporation; 2018. Accessed August 16, 2019. https://office.microsoft.com/excel
35.
JASP. Version 0.14.1. JASP; 2020. Accessed May 21, 2021. https://jasp-stats.org/download/
36.
Higgins  JPT , Thompson  SG .  Quantifying heterogeneity in a meta-analysis.   Stat Med. 2002;21(11):1539-1558. doi:10.1002/sim.1186 PubMedGoogle ScholarCrossref
37.
Duval  S , Tweedie  R .  Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis.   Biometrics. 2000;56(2):455-463. doi:10.1111/j.0006-341X.2000.00455.x PubMedGoogle ScholarCrossref
38.
Baden  LR , El Sahly  HM , Essink  B ,  et al; COVE Study Group.  Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine.   N Engl J Med. 2020;384(5):403-416. doi:10.1056/NEJMoa2035389 PubMedGoogle ScholarCrossref
39.
Heath  PT , Galiza  EP , Baxter  DN ,  et al; 2019nCoV-302 Study Group.  Safety and efficacy of NVX-CoV2373 COVID-19 vaccine.   N Engl J Med. 2021;385(13):1172-1183. doi:10.1056/NEJMoa2107659 PubMedGoogle ScholarCrossref
40.
Walsh  EE , Frenck  RWJ  Jr , Falsey  AR ,  et al.  Safety and immunogenicity of two RNA-based COVID-19 vaccine candidates.   N Engl J Med. 2020;383(25):2439-2450. doi:10.1056/NEJMoa2027906 PubMedGoogle ScholarCrossref
41.
Richmond  P , Hatchuel  L , Dong  M ,  et al.  Safety and immunogenicity of S-Trimer (SCB-2019), a protein subunit vaccine candidate for COVID-19 in healthy adults: a phase 1, randomised, double-blind, placebo-controlled trial.   Lancet. 2021;397(10275):682-694. doi:10.1016/S0140-6736(21)00241-5 PubMedGoogle ScholarCrossref
42.
Sadoff  J , Le Gars  M , Shukarev  G ,  et al.  Interim results of a phase 1-2a trial of Ad26.COV2.S COVID-19 vaccine.   N Engl J Med. 2021;384(19):1824-1835. doi:10.1056/NEJMoa2034201 PubMedGoogle ScholarCrossref
43.
Chu  L , McPhee  R , Huang  W ,  et al; mRNA-1273 Study Group.  A preliminary report of a randomized controlled phase 2 trial of the safety and immunogenicity of mRNA-1273 SARS-CoV-2 vaccine.   Vaccine. 2021;39(20):2791-2799. doi:10.1016/j.vaccine.2021.02.007 PubMedGoogle ScholarCrossref
44.
Keech  C , Albert  G , Cho  I ,  et al.  Phase 1-2 trial of a SARS-CoV-2 recombinant spike protein nanoparticle vaccine.   N Engl J Med. 2020;383(24):2320-2332. doi:10.1056/NEJMoa2026920 PubMedGoogle ScholarCrossref
45.
Li  J , Hui  A , Zhang  X ,  et al.  Safety and immunogenicity of the SARS-CoV-2 BNT162b1 mRNA vaccine in younger and older Chinese adults: a randomized, placebo-controlled, double-blind phase 1 study.   Nat Med. 2021;27(6):1062-1070. doi:10.1038/s41591-021-01330-9 PubMedGoogle ScholarCrossref
46.
Goepfert  PA , Fu  B , Chabanon  A-L ,  et al.  Safety and immunogenicity of SARS-CoV-2 recombinant protein vaccine formulations in healthy adults: interim results of a randomised, placebo-controlled, phase 1-2, dose-ranging study.   Lancet Infect Dis. 2021;21(9):1257-1270. doi:10.1016/S1473-3099(21)00147-X PubMedGoogle ScholarCrossref
47.
Madhi  SA , Baillie  V , Cutland  CL ,  et al; NGS-SA Group; Wits-VIDA COVID Group.  Efficacy of the ChAdOx1 nCoV-19 COVID-19 vaccine against the B.1.351 variant.   N Engl J Med. 2021;384(20):1885-1898. doi:10.1056/NEJMoa2102214 PubMedGoogle ScholarCrossref
48.
Polack  FP , Thomas  SJ , Kitchin  N ,  et al; C4591001 Clinical Trial Group.  Safety and efficacy of the BNT162b2 mRNA COVID-19 vaccine.   N Engl J Med. 2020;383(27):2603-2615. doi:10.1056/NEJMoa2034577 PubMedGoogle ScholarCrossref
49.
Shinde  V , Bhikha  S , Hoosain  Z ,  et al; 2019nCoV-501 Study Group.  Efficacy of NVX-CoV2373 COVID-19 vaccine against the B.1.351 variant.   N Engl J Med. 2021;384(20):1899-1909. doi:10.1056/NEJMoa2103055 PubMedGoogle ScholarCrossref
50.
Chappell  KJ , Mordant  FL , Li  Z ,  et al.  Safety and immunogenicity of an MF59-adjuvanted spike glycoprotein-clamp vaccine for SARS-CoV-2: a randomised, double-blind, placebo-controlled, phase 1 trial.   Lancet Infect Dis. 2021;21(10):1383-1394. doi:10.1016/S1473-3099(21)00200-0 PubMedGoogle ScholarCrossref
51.
Rief  W , Glombiewski  JA .  The hidden effects of blinded, placebo-controlled randomized trials: an experimental investigation.   Pain. 2012;153(12):2473-2477. doi:10.1016/j.pain.2012.09.007 PubMedGoogle ScholarCrossref
52.
Centers for Disease Control and Prevention. Moderna COVID-19 vaccine overview and safety. Updated November 19, 2021. Accessed August 16, 2021. https://www.cdc.gov/coronavirus/2019-ncov/vaccines/different-vaccines/Moderna.html
53.
Centers for Disease Control and Prevention. Pfizer-BioNTech COVID-19 vaccine (also known as COMIRNATY) overview and safety. Updated November 19, 2021. Accessed August 16, 2021. https://www.cdc.gov/coronavirus/2019-ncov/vaccines/different-vaccines/Pfizer-BioNTech.html
54.
Centers for Disease Control and Prevention. Johnson & Johnson’s Janssen COVID-19 vaccine overview and safety. Updated October 29, 2021. Accessed August 16, 2021. https://www.cdc.gov/coronavirus/2019-ncov/vaccines/different-vaccines/janssen.html
55.
Reidenberg  MM , Lowenthal  DT .  Adverse nondrug reactions.   N Engl J Med. 1968;279(13):678-679. doi:10.1056/NEJM196809262791304 PubMedGoogle ScholarCrossref
56.
Wells  RE , Kaptchuk  TJ .  To tell the truth, the whole truth, may do patients harm: the problem of the nocebo effect for informed consent.   Am J Bioeth. 2012;12(3):22-29. doi:10.1080/15265161.2011.652798 PubMedGoogle ScholarCrossref
57.
Rief  W , Glombiewski  JA , Barsky  AJ . Generic assessment of side effects. 2009. Accessed June 21, 2021. http://www.gase-scale.com/Instruction_GASE.pdf
If you are not a JN Learning subscriber, you can either:
Subscribe to JN Learning for one year
Buy this activity
jn-learning_Modal_Multimedia_LoginSubscribe_Purchase
Close
If you are not a JN Learning subscriber, you can either:
Subscribe to JN Learning for one year
Buy this activity
jn-learning_Modal_Multimedia_LoginSubscribe_Purchase
Close
With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Education Center Collection Sign In Modal Right
Close

Name Your Search

Save Search
Close
With a personal account, you can:
  • Track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
jn-learning_Modal_SaveSearch_NoAccess_Purchase
Close

Lookup An Activity

or

Close

My Saved Searches

You currently have no searches saved.

Close

My Saved Courses

You currently have no courses saved.

Close
With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Education Center Collection Sign In Modal Right
Close