[Skip to Content]
Outline
Quiz
PDF
Infectious Diseases

Effect of Antibiotic-Prescribing Feedback to High-Volume Primary Care Physicians on Number of Antibiotic PrescriptionsA Randomized Clinical Trial

Educational Objective
To evaluate peer-comparison audit and feedback to high-prescribing primary care physicians (PCPs) and assess the effect of targeted messaging on avoiding unnecessary antibiotic prescriptions and avoiding long-duration prescribing.
1 Credit CME
JAMA Internal Medicine
September 1, 2021
Original Investigation
Kevin L. Schwartz, MD1,2,3;
Noah Ivers, MD2,4,5;
Bradley J. Langford, PharmD1,6;
Monica Taljaard, PhD7,8;
Drew Neish, MSc9;
Kevin A. Brown, PhD1,2;
Valerie Leung, BScPhm1,10;
Nick Daneman, MD1,11,12;
Javed Alloo, MD13,14;
Michael Silverman, MD15,16;
Emily Shing, MPH1;
Jeremy M. Grimshaw, PhD7,17;
Jerome A. Leis, MD11,12;
Julie H. C. Wu, MSc1;
Gary Garber, MD1,7,17
Author Affiliations
  • 1Public Health Ontario, Toronto, Ontario, Canada
  • 2Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
  • 3Unity Health Toronto, Toronto, Ontario, Canada
  • 4Institute for Health System Solutions and Virtual Care, Women’s College Hospital, Toronto, Ontario, Canada
  • 5Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
  • 6Hotel Dieu Shaver Health and Rehabilitation Centre, St Catharines, Ontario, Canada
  • 7Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
  • 8School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
  • 9IQVIA, Montreal, Quebec, Canada
  • 10Michael Garron Hospital, Toronto East Health Network, Toronto, Ontario, Canada
  • 11Sunnybrook Health Sciences Centre, Toronto, Ontario, Canada
  • 12Division of Infectious Diseases, Department of Medicine, University of Toronto, Toronto, Ontario, Canada
  • 13Section on General and Family Practice, Ontario Medical Association, Toronto, Ontario, Canada
  • 14Ontario College of Family Physicians, Toronto, Ontario
  • 15Division of Infectious Diseases, Western University, London, Ontario, Canada
  • 16Department of Epidemiology and Biostatistics, Western University, London, Ontario, Canada
  • 17Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
Read article on JAMA Network

MOC/CME Information

editorial comment icon
Editorial
Comment
 related articles icon
Related
Articles
 author interview icon
Interviews
 multimedia icon
Multimedia
Read Article Take Quiz
Key Points

Question  Does providing a single, mailed, peer-comparison letter on antibiotic use to high-prescribing primary care physicians targeting either initiation or duration of antibiotic treatment modify prescribing behavior?

Findings  In this randomized clinical trial of 3500 primary care physicians in Ontario, Canada, receipt of a letter targeting appropriate antibiotic durations resulted in a statistically significant 4.8% relative reduction in total antibiotic use.

Meaning  A single, peer-comparison, antibiotic-feedback letter to high-prescribing physicians can be effective and cost saving, especially if it includes targeted messaging on appropriate durations of antibiotic prescriptions.

Abstract

Importance  Antibiotic overuse contributes to adverse drug effects, increased costs, and antimicrobial resistance.

Objective  To evaluate peer-comparison audit and feedback to high-prescribing primary care physicians (PCPs) and assess the effect of targeted messaging on avoiding unnecessary antibiotic prescriptions and avoiding long-duration prescribing.

Design, Setting, and Participants  In this 3-arm randomized clinical trial, administrative data collected from IQVIA’s Xponent database were used to recruit the highest quartile of antibiotic-prescribing PCPs (n = 3500) in Ontario, Canada.

Interventions  Physicians were randomized 3:3:1 to receive a mailed letter sent in December 2018 addressing antibiotic treatment initiation (n = 1500), a letter addressing prescribing duration (n = 1500), or no letter (control; n = 500). Outliers at the 99th percentile at baseline for each arm were excluded from analysis.

Main Outcomes and Measures  The primary outcome was total number of antibiotic prescriptions over 12 months postintervention. Secondary outcomes were number of prolonged-duration prescriptions (>7 days) and antibiotic drug costs (in Canadian dollars). Robust Poisson regression controlling for baseline prescriptions was used for analysis.

Results  Of the 3465 PCPs included in analysis, 2405 (69.4%) were male, and 2116 (61.1%) were 25 or more years from their medical graduation. At baseline, PCPs receiving the antibiotic initiation letter and duration letter prescribed an average of 988 and 1000 antibiotic prescriptions, respectively; at 12 months postintervention, these PCPs prescribed an average of 849 and 851 antibiotic prescriptions, respectively. For the primary outcome of total antibiotic prescriptions 12 months postintervention, there was no statistically significant difference in total antibiotic use between PCPs who received the initiation letter compared with controls (relative risk [RR], 0.96; 97.5% CI, 0.92-1.01; P = .06) and a small statistically significant difference for the duration letter compared with controls (RR, 0.95; 97.5% CI, 0.91-1.00; P = .01). For PCPs receiving the duration letter, this corresponds to an average of 42 fewer antibiotic prescriptions over 12 months. There was no statistically significant difference between the letter arms. For the initiation letter, compared with controls there was an RR of 0.98 (97.5% CI, 0.93-1.03; P = .42) and 0.97 (97.5% CI, 0.92-1.02; P = .19) for the outcomes of prolonged-duration prescriptions and antibiotic drug costs, respectively. At baseline, PCPs who received the duration letter prescribed an average of 332 prolonged-duration prescriptions with $14 470 in drug costs. There was an 8.1% relative reduction (RR, 0.92; 97.5% CI, 0.87-0.97; P < .001) in prolonged-duration prescriptions, and a 6.1% relative reduction in antibiotic drug costs (RR, 0.94; 97.5% CI, 0.89-0.99; P = .01). This corresponds to an average of 24 fewer prolonged-duration prescriptions and $771 in drug cost savings per PCP over 12 months.

Conclusions and Relevance  In this randomized clinical trial, a single mailed letter to the highest-prescribing PCPs in Ontario, Canada providing peer-comparison feedback, including messaging on limiting antibiotic-prescribing durations, led to statistically significant reductions in total and prolonged-duration antibiotic prescriptions, as well as drug costs.

Trial Registration  ClinicalTrials.gov Identifier: NCT03776383

Sign in to take quiz and track your certificates

Buy This Activity

JN Learning™ is the home for CME and MOC from the JAMA Network. Search by specialty or US state and earn AMA PRA Category 1 Credit(s)™ from articles, audio, Clinical Challenges and more. Learn more about CME/MOC

Related Articles

  1. High-Volume Prescribers Drive Antibiotic Use in Medicare Part D

CME Disclosure Statement: Unless noted, all individuals in control of content reported no relevant financial relationships. If applicable, all relevant financial relationships have been mitigated.

See More About

Infectious Diseases Antibiotic Use, Overuse, Resistance, Stewardship Health Care Quality
Article Information

Accepted for Publication: April 27, 2021.

Published Online: July 6, 2021. doi:10.1001/jamainternmed.2021.2790

Corresponding Author: Kevin L. Schwartz, MD, Public Health Ontario, 480 University Ave, Ste 300, Toronto, ON M5G 1V2, Canada (kevin.schwartz@oahpp.ca).

Author Contributions: Mr Neish had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Schwartz, Ivers, Langford, Taljaard, Daneman, Alloo, Silverman, Grimshaw, Wu, Garber.

Acquisition, analysis, or interpretation of data: Schwartz, Ivers, Langford, Taljaard, Neish, Brown, Leung, Daneman, Alloo, Shing, Grimshaw, Leis.

Drafting of the manuscript: Schwartz, Neish, Silverman.

Critical revision of the manuscript for important intellectual content: Ivers, Langford, Taljaard, Brown, Leung, Daneman, Alloo, Silverman, Shing, Grimshaw, Leis, Wu, Garber.

Statistical analysis: Taljaard, Neish, Brown, Shing.

Obtained funding: Schwartz.

Administrative, technical, or material support: Schwartz, Langford, Leung, Leis, Wu, Garber.

Supervision: Taljaard, Silverman, Garber.

Other—partnership development and implementation support: Alloo.

Conflict of Interest Disclosures: Dr Ivers reported support from a Canada Research Chair (Tier 2) in Implementation of Evidence-Based Practice and a Clinician Scholar award from the Department of Family and Community Medicine at the University of Toronto, as well as grants from the Canadian Institutes of Health Research and the Joint Programming Initiative on Antimicrobial Resistance outside the submitted work. Dr Alloo reported grants from the University of Toronto and personal fees from Novo Nordisk, Roche, Eli Lilly, AstraZeneca, Memotext, the Centre for Addiction and Mental Health, Trillium Health Partners, Ontario College of Family Physicians, and the Section on General and Family Practice at Ontario Medical Association outside the submitted work. Dr Leis reported personal fees from Choosing Wisely Canada during the conduct of the study. No other disclosures were reported.

Funding/Support: This study was funded by Public Health Ontario and a Canadian Institutes of Health Research Strategy for Patient-Oriented Research Innovative Clinical Trials grant (application No. 398514).

Role of the Funder/Sponsor: The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Disclaimer: The lead author, Dr Schwartz, affirms that this article is an honest, accurate, and transparent account of the study being reported. No important aspects have been omitted, and any discrepancies from the original protocol have been explained.

Data Sharing Statement: See Supplement 3.

Additional Contributions: We thank our lived-experience patient partners Emily Angl, BMSc, and Barbara Sklar, RN, BAEd/ADED, for their contributions to this study. Ms Angl received compensation through the study funding for her time consulting on this article.

References
1.
O’Neill  J . Tackling drug-resistant infections globally: final report and recommendations. Review on Antimicrobial Resistance. May 2016. Accessed May 24, 2021. https://www.biomerieuxconnection.com/wp-content/uploads/2018/04/Tackling-Drug-Resistant-Infections-Globally_-Final-Report-and-Recommendations.pdf
2.
Low  M , Neuberger  A , Hooton  TM ,  et al.  Association between urinary community-acquired fluoroquinolone-resistant Escherichia coli and neighbourhood antibiotic consumption: a population-based case-control study.   Lancet Infect Dis. 2019;19(4):419-428. doi:10.1016/S1473-3099(18)30676-5 PubMedGoogle ScholarCrossref
3.
Bell  BG , Schellevis  F , Stobberingh  E , Goossens  H , Pringle  M .  A systematic review and meta-analysis of the effects of antibiotic consumption on antibiotic resistance.   BMC Infect Dis. 2014;14(1):13. doi:10.1186/1471-2334-14-13 PubMedGoogle ScholarCrossref
4.
Costelloe  C , Metcalfe  C , Lovering  A , Mant  D , Hay  AD .  Effect of antibiotic prescribing in primary care on antimicrobial resistance in individual patients: systematic review and meta-analysis.   BMJ. 2010;340:c2096. doi:10.1136/bmj.c2096 PubMedGoogle ScholarCrossref
5.
Nelson  RE , Hatfield  KM , Wolford  H ,  et al.  National estimates of healthcare costs associated with multidrug-resistant bacterial infections among hospitalized patients in the United States.   Clin Infect Dis. 2021;72(suppl 1):S17-S26. doi:10.1093/cid/ciaa1581PubMedGoogle ScholarCrossref
6.
Shehab  N , Lovegrove  MC , Geller  AI , Rose  KO , Weidle  NJ , Budnitz  DS .  US emergency department visits for outpatient adverse drug events, 2013-2014.   JAMA. 2016;316(20):2115-2125. doi:10.1001/jama.2016.16201 PubMedGoogle ScholarCrossref
7.
Canadian Antimicrobial Resistance Surveillance System—update 2020. Public Health Agency of Canada. Updated July 9, 2020. Accessed May 24, 2021. https://www.canada.ca/en/public-health/services/publications/drugs-health-products/canadian-antimicrobial-resistance-surveillance-system-2020-report.html
8.
Schwartz  KL , Langford  BJ , Daneman  N ,  et al.  Unnecessary antibiotic prescribing in a Canadian primary care setting: a descriptive analysis using routinely collected electronic medical record data.   CMAJ Open. 2020;8(2):E360-E369. doi:10.9778/cmajo.20190175 PubMedGoogle ScholarCrossref
9.
Fleming-Dutra  KE , Hersh  AL , Shapiro  DJ ,  et al.  Prevalence of inappropriate antibiotic prescriptions among US ambulatory care visits, 2010-2011.   JAMA. 2016;315(17):1864-1873. doi:10.1001/jama.2016.4151 PubMedGoogle ScholarCrossref
10.
Chua  KP , Fischer  MA , Linder  JA .  Appropriateness of outpatient antibiotic prescribing among privately insured US patients: ICD-10-CM based cross sectional study.   BMJ. 2019;364:k5092. doi:10.1136/bmj.k5092 PubMedGoogle Scholar
11.
Schwartz  KL , Brown  KA , Etches  J ,  et al.  Predictors and variability of antibiotic prescribing amongst family physicians.   J Antimicrob Chemother. 2019;74(7):2098-2105. doi:10.1093/jac/dkz112 PubMedGoogle ScholarCrossref
12.
Hicks  LA , Taylor  THJ  Jr , Hunkler  RJUS .  U.S. outpatient antibiotic prescribing, 2010.   N Engl J Med. 2013;368(15):1461-1462. doi:10.1056/NEJMc1212055 PubMedGoogle ScholarCrossref
13.
Fernandez-Lazaro  CI , Brown  KA , Langford  BJ , Daneman  N , Garber  G , Schwartz  KL .  Late-career physicians prescribe longer courses of antibiotics.   Clin Infect Dis. 2019;69(9):1467-1475. doi:10.1093/cid/ciy1130 PubMedGoogle ScholarCrossref
14.
King  LM , Hersh  AL , Hicks  LA , Fleming-Dutra  KE .  Duration of outpatient antibiotic therapy for common outpatient infections, 2017.   Clin Infect Dis. 2020;ciaa1404. PubMedGoogle Scholar
15.
Ivers  N , Jamtvedt  G , Flottorp  S ,  et al.  Audit and feedback: effects on professional practice and healthcare outcomes.   Cochrane Database Syst Rev. 2012;6(6):CD000259. doi:10.1002/14651858.CD000259.pub3 PubMedGoogle Scholar
16.
Nudge vs superbugs: a behavioural economics trial to reduce the overprescribing of antibiotics. Australian Government, Department of Health, Department of the Prime Minister and Cabinet. June 2018. Accessed May 24, 2021. https://behaviouraleconomics.pmc.gov.au/sites/default/files/projects/report-nudge-vs-superbugs.pdf
17.
King  LM , Fleming-Dutra  KE , Hicks  LA .  Advances in optimizing the prescription of antibiotics in outpatient settings.   BMJ. 2018;363:k3047. doi:10.1136/bmj.k3047PubMedGoogle Scholar
18.
McCullough  AR , Rathbone  J , Parekh  S , Hoffmann  TC , Del Mar  CB .  Not in my backyard: a systematic review of clinicians’ knowledge and beliefs about antibiotic resistance.   J Antimicrob Chemother. 2015;70(9):2465-2473. doi:10.1093/jac/dkv164 PubMedGoogle ScholarCrossref
19.
Altamimi  S , Khalil  A , Khalaiwi  KA , Milner  RA , Pusic  MV , Al Othman  MA .  Short-term late-generation antibiotics versus longer term penicillin for acute streptococcal pharyngitis in children.   Cochrane Database Syst Rev. 2012;(8):CD004872. doi:10.1002/14651858.CD004872.pub3 PubMedGoogle Scholar
20.
Uranga  A , España  PP , Bilbao  A ,  et al.  Duration of antibiotic treatment in community-acquired pneumonia: a multicenter randomized clinical trial.   JAMA Intern Med. 2016;176(9):1257-1265. doi:10.1001/jamainternmed.2016.3633 PubMedGoogle ScholarCrossref
21.
Moran  GJ , Fang  E , Corey  GR , Das  AF , De Anda  C , Prokocimer  P .  Tedizolid for 6 days versus linezolid for 10 days for acute bacterial skin and skin-structure infections (ESTABLISH-2): a randomised, double-blind, phase 3, non-inferiority trial.   Lancet Infect Dis. 2014;14(8):696-705. doi:10.1016/S1473-3099(14)70737-6 PubMedGoogle ScholarCrossref
22.
Kim  DK , Kim  JH , Lee  JY ,  et al.  Reappraisal of the treatment duration of antibiotic regimens for acute uncomplicated cystitis in adult women: a systematic review and network meta-analysis of 61 randomised clinical trials.   Lancet Infect Dis. 2020;20(9):1080-1088. doi:10.1016/S1473-3099(20)30121-3 PubMedGoogle ScholarCrossref
23.
Stolbrink  M , Amiry  J , Blakey  JD .  Does antibiotic treatment duration affect the outcomes of exacerbations of asthma and COPD? a systematic review.   Chron Respir Dis. 2018;15(3):225-240. doi:10.1177/1479972317745734 PubMedGoogle ScholarCrossref
24.
Langford  BJ , Quirk  J , Carey  S , Daneman  N , Garber  GE .  Influencing duration of antibiotic therapy: a behavior change analysis in long-term care.   Am J Infect Control. 2019;47(12):1409-1414. doi:10.1016/j.ajic.2019.05.020 PubMedGoogle ScholarCrossref
25.
Kiefe  CI , Allison  JJ , Williams  OD , Person  SD , Weaver  MT , Weissman  NW .  Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial.   JAMA. 2001;285(22):2871-2879. doi:10.1001/jama.285.22.2871 PubMedGoogle ScholarCrossref
26.
Hallsworth  M , Chadborn  T , Sallis  A ,  et al.  Provision of social norm feedback to high prescribers of antibiotics in general practice: a pragmatic national randomised controlled trial.   Lancet. 2016;387(10029):1743-1752. doi:10.1016/S0140-6736(16)00215-4 PubMedGoogle ScholarCrossref
27.
Meeker  D , Linder  JA , Fox  CR ,  et al.  Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial.   JAMA. 2016;315(6):562-570. doi:10.1001/jama.2016.0275 PubMedGoogle ScholarCrossref
28.
Gulliford  MC , Prevost  AT , Charlton  J ,  et al.  Effectiveness and safety of electronically delivered prescribing feedback and decision support on antibiotic use for respiratory illness in primary care: REDUCE cluster randomised trial.   BMJ. 2019;364:l236. doi:10.1136/bmj.l236 PubMedGoogle Scholar
29.
Hicks  LA , Bartoces  MG , Roberts  RM ,  et al.  US outpatient antibiotic prescribing variation according to geography, patient population, and provider specialty in 2011.   Clin Infect Dis. 2015;60(9):1308-1316. doi:10.1093/cid/civ076 PubMedGoogle Scholar
30.
Schwartz  KL , Chen  C , Langford  BJ ,  et al.  Validating a popular outpatient antibiotic database to reliably identify high prescribing physicians for patients 65 years of age and older.   PLoS One. 2019;14(9):e0223097. doi:10.1371/journal.pone.0223097 PubMedGoogle Scholar
31.
Using antibiotics wisely. Choosing Wisely Canada. Accessed May 24, 2021. https://choosingwiselycanada.org/campaign/antibiotics/
32.
Spellberg  B , Rice  LB .  Duration of antibiotic therapy: shorter is better.   Ann Intern Med. 2019;171(3):210-211. doi:10.7326/M19-1509 PubMedGoogle ScholarCrossref
33.
Zou  GY , Donner  A .  Extension of the modified Poisson regression model to prospective studies with correlated binary data.   Stat Methods Med Res. 2013;22(6):661-670. doi:10.1177/0962280211427759 PubMedGoogle ScholarCrossref
34.
Hooper  R , Forbes  A , Hemming  K , Takeda  A , Beresford  L .  Analysis of cluster randomised trials with an assessment of outcome at baseline.   BMJ. 2018;360:k1121. doi:10.1136/bmj.k1121 PubMedGoogle Scholar
35.
Ivers  NM , Sales  A , Colquhoun  H ,  et al.  No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention.   Implement Sci. 2014;9(1):14. doi:10.1186/1748-5908-9-14PubMedGoogle ScholarCrossref
36.
Linder  JA , Meeker  D , Fox  CR ,  et al.  Effects of behavioral interventions on inappropriate antibiotic prescribing in primary care 12 months after stopping interventions.   JAMA. 2017;318(14):1391-1392. doi:10.1001/jama.2017.11152 PubMedGoogle ScholarCrossref
37.
Hemkens  LG , Saccilotto  R , Reyes  SL ,  et al.  Personalized prescription feedback to reduce antibiotic overuse in primary care: rationale and design of a nationwide pragmatic randomized trial.   BMC Infect Dis. 2016;16(1):421. doi:10.1186/s12879-016-1739-0 PubMedGoogle ScholarCrossref
38.
Fox  CR , Doctor  JN , Goldstein  NJ , Meeker  D , Persell  SD , Linder  JA .  Details matter: predicting when nudging clinicians will succeed or fail.   BMJ. 2020;370:m3256. doi:10.1136/bmj.m3256 PubMedGoogle Scholar
39.
Mehrotra  A , Linder  JA .  Tipping the balance toward fewer antibiotics.   JAMA Intern Med. 2016;176(11):1649-1650. doi:10.1001/jamainternmed.2016.6254 PubMedGoogle ScholarCrossref
40.
Hrisos  S , Eccles  M , Johnston  M ,  et al.  Developing the content of two behavioural interventions: using theory-based interventions to promote GP management of upper respiratory tract infection without prescribing antibiotics #1.   BMC Health Serv Res. 2008;8:11. doi:10.1186/1472-6963-8-11 PubMedGoogle ScholarCrossref
41.
Bui  TC , Krieger  HA , Blumenthal-Barby  JS .  Framing effects on physicians’ judgment and decision making.   Psychol Rep. 2015;117(2):508-522. doi:10.2466/13.PR0.117c20z0PubMedGoogle ScholarCrossref
42.
Ivers  N , Barnsley  J , Upshur  R ,  et al.  “My approach to this job is...one person at a time”: perceived discordance between population-level quality targets and patient-centred care.   Can Fam Physician. 2014;60(3):258-266.PubMedGoogle Scholar
43.
Kitano  T , Langford  BJ , Brown  KA ,  et al.  The association between high and unnecessary antibiotic prescribing: a cohort study using family physician electronic medical records.   Clin Infect Dis. 2021;72(9):e345-e351. doi:10.1093/cid/ciaa1139 PubMedGoogle ScholarCrossref
Close
Want full access to the AMA Ed Hub?
Become an AMA member now
After you sign up for AMA Membership, make sure you sign in or create a Physician account with the AMA in order to access all learning activities on the AMA Ed Hub
Buy this activity
Close
Want full access to the AMA Ed Hub?
Become an AMA member now
After you sign up for AMA Membership, make sure you sign in or create a Physician account with the AMA in order to access all learning activities on the AMA Ed Hub
Buy this activity
Close
With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Education Center Collection Sign In Modal Right
Close

Name Your Search

Save Search
Privacy Policy|Terms of Use
With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Close
Close

Lookup An Activity

or

My Saved Searches

You currently have no searches saved.

Close

My Saved Courses

You currently have no courses saved.

Close
Our website uses cookies to enhance your experience. By continuing to use our site, or clicking "Continue," you are agreeing to our Cookie Policy | Continue