Effect of Text Message Reminders and Vaccine Reservations on Adherence to a Health System COVID-19 Vaccination Policy: A Randomized Clinical Trial | Vaccination | JN Learning | AMA Ed Hub

[Skip to Content]

Read Article Claim CME

Key Points

Question Can a behavioral nudge delivered through text messages with a reserved date for vaccination over a 2-week period accelerate employee adherence with a health system COVID-19 vaccination policy?

Findings In this randomized clinical trial of 2000 participants, the behavioral nudge delivered through text messages significantly increased adherence to the health system COVID-19 vaccination policy by 4.9 percentage points compared with the control group during the 2-week intervention period. At the 4-week time point near the vaccination policy deadline, there was no longer a significant difference in the overall adherence rate between groups.

Meaning This randomized clinical trial found that a behavioral nudge delivered by text message with a reserved date for vaccination accelerated adherence to a health system COVID-19 vaccination policy; however, other approaches may be needed to change overall adherence rates by the time of the policy deadline.

Abstract

Importance Many organizations implemented COVID-19 vaccination requirements during the pandemic, but the best way to increase adherence to these policies is unknown.

Objective To evaluate if behavioral nudges delivered through text messages could accelerate adherence to a health system’s COVID-19 vaccination policy.

Design, Setting, and Participants This randomized clinical trial was conducted within Ascension health system from October 11 to November 8, 2021. Participants included health system employees in the Midwest or South US who were not adherent with the vaccination policy 1 month before its deadline. Data were analyzed from November 17, 2021, to February 25, 2022.

Interventions Participants were randomly assigned to control or to receive a text message intervention that stated a vaccine had been reserved for the participant, with a scheduled date for vaccination within a 2-week period. Participants could reschedule to a different date within the period or upload a copy of their vaccination card. Follow-up text message reminders were sent the day before and the day of the appointment.

Main Outcomes and Measures The primary outcome was adherence to the health system’s vaccination policy during the 2-week intervention. Secondary outcomes included time to vaccination during a 4-week follow-up period.

Results The sample included 2000 participants (mean [SD] age, 36.4 [12.3] years; 1724 [86.2%] women), with 1000 participants randomized to the control group and 1000 participants randomized to the intervention group. Overall, there were 164 Hispanic participants (8.2%), 46 non-Hispanic Asian participants (2.3%), 202 non-Hispanic Black participants (10.1%), and 1418 non-Hispanic White participants (70.9%). By the end of the 2-week intervention, 363 participants in the text message nudge group (36.3%) and 318 participants in the control group (31.8%) were adherent with the vaccination policy, representing a significant increase of 4.9 (95% CI, 0.8 to 9.1) percentage points in adjusted analyses comparing the nudge group with the control group (P = .02). Among participants who became adherent by the end of the 4-week follow-up period, the text message nudge significantly reduced time to adherence by a mean of 2.4 (95% CI, 2.1 to 4.7) days (P < .001) and a median of 5.0 (95% CI, 2.5 to 7.7) days (P < .001) compared with the control group. At 4 weeks, overall vaccination adherence was no longer different between groups (control: 477 participants [47.7%]; intervention: 472 participants [47.2%]).

Conclusions and Relevance This randomized clinical trial found that a behavioral nudge delivered through text messages accelerated adherence to a health system’s COVID-19 vaccination policy but did change overall adherence by the time of the policy deadline.

Trial Registration ClinicalTrials.gov Identifier: NCT05037201

Claim CME

Sign in to take quiz and track your certificates

Buy This Activity

Article Information

Accepted for Publication: May 29, 2022.

Published: July 20, 2022. doi:10.1001/jamanetworkopen.2022.22116

Open Access: This is an open access article distributed under the terms of the CC-BY License. © 2022 Patel MS et al. JAMA Network Open.

Corresponding Author: Mitesh S. Patel, MD, MBA, Ascension, 4600 Edmundson Rd, St Louis, MO 63134 (mitesh.patel3@ascension.org).

Author Contributions: Dr. Patel had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Patel, Fogel, Habash, Brinson, Price, Yehia.

Acquisition, analysis, or interpretation of data: Patel, Winegar, Horseman, Ottenbacher, Habash, Dukes, Brinson, Price, Masoudi, Cacchione.

Drafting of the manuscript: Patel, Dukes, Brinson.

Critical revision of the manuscript for important intellectual content: Fogel, Winegar, Horseman, Ottenbacher, Habash, Dukes, Brinson, Price, Masoudi, Cacchione, Yehia.

Statistical analysis: Winegar, Horseman, Dukes, Price.

Obtained funding: Patel.

Administrative, technical, or material support: Winegar, Ottenbacher, Dukes, Brinson, Price, Cacchione, Yehia.

Supervision: Patel, Fogel, Winegar, Price.

Conflict of Interest Disclosures: Dr Patel reported receiving personal fees from Catalyst Health, Humana, and GlaxoSmithKline outside the submitted work. No other disclosures were reported.

Funding/Support: This study was funded internally by Ascension.

Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

References

Richardson S , Hirsch JS , Narasimhan M , et al; the Northwell COVID-19 Research Consortium. Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized with COVID-19 in the New York City area. JAMA. 2020;323(20):2052-2059. doi:10.1001/jama.2020.6775 PubMed Google Scholar Crossref

Huang C , Huang L , Wang Y , et al. 6-month consequences of COVID-19 in patients discharged from hospital: a cohort study. Lancet. 2021;397(10270):220-232. doi:10.1016/S0140-6736(20)32656-8 PubMed Google Scholar Crossref

Patel M . Test behavioural nudges to boost COVID immunization. Nature. 2021;590(7845):185. doi:10.1038/d41586-021-00329-z PubMed Google Scholar Crossref

Volpp KG , Cannuscio CC . Incentives for immunity—strategies for increasing COVID-19 vaccine uptake. N Engl J Med. 2021;385(1):e1. doi:10.1056/NEJMp2107719 PubMed Google Scholar Crossref

Walkey AJ , Law A , Bosch NA . Lottery-based incentive in Ohio and COVID-19 vaccination rates. JAMA. 2021;326(8):766-767. doi:10.1001/jama.2021.11048 PubMed Google Scholar Crossref

Acharya B , Dhakal C . Implementation of state vaccine incentive lottery programs and uptake of COVID-19 vaccinations in the United States. JAMA Netw Open. 2021;4(12):e2138238. doi:10.1001/jamanetworkopen.2021.38238 PubMed Google Scholar Crossref

Largent EA , Persad G , Sangenito S , Glickman A , Boyle C , Emanuel EJ . US public attitudes toward COVID-19 vaccine mandates. JAMA Netw Open. 2020;3(12):e2033324. doi:10.1001/jamanetworkopen.2020.33324 PubMed Google Scholar Crossref

President Biden to announce new actions to get more Americans vaccinated and slow the spread of the delta variant. News release. The White House. July 29, 2021. Accessed January 15, 2022. https://www.whitehouse.gov/briefing-room/statements-releases/2021/07/29/fact-sheet-president-biden-to-announce-new-actions-to-get-more-americans-vaccinated-and-slow-the-spread-of-the-delta-variant/

VA mandates COVID-19 vaccines among its medical employees including VHA facilities staff. News release. Office of Public and Intergovernmental Affairs. July 26, 2021. Accessed January 15, 2022. https://www.va.gov/opa/pressrel/pressrelease.cfm?id=5696

Biden Administration announces details of two major vaccination policies. News release. The White House. November 4, 2021. Accessed January 15, 2022. https://www.whitehouse.gov/briefing-room/statements-releases/2021/11/04/fact-sheet-biden-administration-announces-details-of-two-major-vaccination-policies/

Gostin LO , Salmon DA , Larson HJ . Mandating COVID-19 vaccines. JAMA. 2021;325(6):532-533. doi:10.1001/jama.2020.26553 PubMed Google Scholar Crossref

Active Army achieves 98 percent vaccination rate with less than one percent refusal rate. News release. US Army. December 16, 2021. Accessed January 15, 2022. https://www.army.mil/article/252821/active_army_achieves_98_percent_vaccination_rate_with_less_than_one_percent_refusal_rate

Koenig D . United Airlines says 97% of US employees have been vaccinated. AP News. September 22, 2021. Accessed January 15, 2022. https://apnews.com/article/business-health-coronavirus-pandemic-de26955d518a498c5ffb26160d9c623d

Hersch L , Corkery M . How Tyson Foods got 60,500 workers to get the Coronavirus vaccine quickly. The New York Times. Accessed January 15, 2022. https://www.nytimes.com/2021/11/04/business/tyson-vaccine-mandate.html

Patel MS , Volpp KG , Asch DA . Nudge units to improve the delivery of health care. N Engl J Med. 2018;378(3):214-216. doi:10.1056/NEJMp1712984 PubMed Google Scholar Crossref

Reñosa MDC , Landicho J , Wachinger J , et al. Nudging toward vaccination: a systematic review. BMJ Glob Health. 2021;6(9):e006237. doi:10.1136/bmjgh-2021-006237 PubMed Google Scholar Crossref

Chapman GB , Li M , Colby H , Yoon H . Opting in vs opting out of influenza vaccination. JAMA. 2010;304(1):43-44. doi:10.1001/jama.2010.892 PubMed Google Scholar Crossref

Milkman KL , Patel MS , Gandhi L , et al. A megastudy of text-based nudges encouraging patients to get vaccinated at an upcoming doctor’s appointment. Proc Natl Acad Sci U S A. 2021;118(20):e2101165118. doi:10.1073/pnas.2101165118 PubMed Google Scholar Crossref

Dai H , Saccardo S , Han MA , et al. Behavioural nudges increase COVID-19 vaccinations. Nature. 2021;597(7876):404-409. doi:10.1038/s41586-021-03843-2 PubMed Google Scholar Crossref

Deke J . Using the linear probability model to estimate impacts on binary outcomes in randomized controlled trials: evaluation technical assistance update for OAH & ACYF teenage pregnancy prevention grantees, brief 6. Accessed January 15, 2022. https://opa.hhs.gov/sites/default/files/2020-07/lpm-tabrief.pdf

Koenker R . Quantile Regression. Cambridge University Press; 2005. doi:10.1017/CBO9780511754098

Efron B , Tibshirani R . An Introduction to the Bootstrap. Chapman and Hall; 1993. doi:10.1007/978-1-4899-4541-9

CDC expands eligibility for COVID-19 booster shots to all adults. News release. Centers for Disease Control and Prevention. November 19, 2021. Accessed January 15, 2022. https://www.cdc.gov/media/releases/2021/s1119-booster-shots.html

Crane MA , Romley JA , Faden RR . Tracking COVID-19 booster doses in the US States. News release. Johns Hopkins Berman Institute of Bioethics. December 22, 2021. Accessed January 15, 2022. https://bioethics.jhu.edu/news-events/news/tracking-covid-19-booster-doses-in-the-us-states/

AMA CME Accreditation Information

Credit Designation Statement: The American Medical Association designates this Journal-based CME activity activity for a maximum of 1.00  AMA PRA Category 1 Credit(s)™. Physicians should claim only the credit commensurate with the extent of their participation in the activity.

Successful completion of this CME activity, which includes participation in the evaluation component, enables the participant to earn up to:

1.00 Medical Knowledge MOC points in the American Board of Internal Medicine's (ABIM) Maintenance of Certification (MOC) program;;
1.00 Self-Assessment points in the American Board of Otolaryngology – Head and Neck Surgery’s (ABOHNS) Continuing Certification program;
1.00 MOC points in the American Board of Pediatrics’ (ABP) Maintenance of Certification (MOC) program;
1.00 Lifelong Learning points in the American Board of Pathology’s (ABPath) Continuing Certification program; and
1.00 CME points in the American Board of Surgery’s (ABS) Continuing Certification program

It is the CME activity provider's responsibility to submit participant completion information to ACCME for the purpose of granting MOC credit.