[Skip to Content]
[Skip to Content Landing]

Effect of Peer Comparison Letters for High-Volume Primary Care Prescribers of Quetiapine in Older and Disabled AdultsA Randomized Clinical Trial

Educational Objective
To investigate if peer comparison letters targeting high-volume primary care prescribers of quetiapine meaningfully reduce their prescribing.
1 Credit CME
Key Points

Question  Can behavioral nudges reduce inappropriate prescribing of antipsychotic agents and raise clinical quality for older and disabled patients, who often receive these drugs?

Findings  In this randomized clinical trial, a peer comparison letter randomized across the 5055 highest Medicare prescribers of the antipsychotic quetiapine fumarate reduced prescribing for at least 2 years. Effects were larger than those observed in existing large-scale behavioral interventions, potentially because of the content of the peer comparison letter, which mentioned the potential for a review of prescribing activity.

Meaning  Behavioral nudge interventions can raise the quality of prescribing, but research is still needed on how to most precisely target unsafe prescribing behavior.


Importance  Antipsychotic agents, such as quetiapine fumarate, are frequently overprescribed for indications not supported by clinical evidence, potentially causing harm.

Objective  To investigate if peer comparison letters targeting high-volume primary care prescribers of quetiapine meaningfully reduce their prescribing.

Design, Setting, and Participants  Randomized clinical trial (intent to treat) conducted from 2015 to 2017 of prescribers and their patients nationwide in the Medicare program. The trial targeted the 5055 highest-volume primary care prescribers of quetiapine in 2013 and 2014 (approximately 5% of all primary care prescribers of quetiapine).

Interventions  Prescribers were randomized (1:1 ratio) to receive a placebo letter or 3 peer comparison letters stating that their quetiapine prescribing was high relative to their peers and was under review by Medicare.

Main Outcomes and Measures  The primary outcome was the total quetiapine days supplied by prescribers from the intervention start to 9 months. Secondary outcomes included quetiapine receipt from all prescribers by baseline patients, quetiapine receipt by patients with low-value or guideline-concordant indications for therapy, mortality, and hospital use. In exploratory analyses, the study followed outcomes to 2 years.

Results  Of the 5055 prescribers, 231 (4.6%) were general practitioners, 2428 (48.0%) were in family medicine, and 2396 (47.4%) were in internal medicine; 4155 (82.2%) were male. All were included in the analyses. Over 9 months, the treatment arm supplied 11.1% fewer quetiapine days per prescriber vs the control arm (2456 vs 2864 days; percentage difference, 11.1% fewer days; 95% CI, −13.1% to −9.2% days; P < .001; adjusted difference, −319 days; 95% CI, −374 to −263 days; P < .001), which persisted through 2 years (15.6% fewer days; 95% CI, −18.1% to −13.0%; P < .001). At the patient level, individuals in the treatment arm received 3.9% (95% CI, −5.0% to −2.9%; P < .001) fewer days of quetiapine from all prescribers over 9 months, with a larger decrease among patients with low-value vs guideline-concordant indications (−5.9% [95% CI, −8.0% to −3.9%] vs −2.4% [95% CI, −4.0% to −0.9%], P = .01 for test that effects were equal for both patient groups). There was no evidence of substitution to other antipsychotics, and 9-month mortality and hospital use were similar between the treatment vs control arms.

Conclusions and Relevance  Peer comparison letters caused substantial and durable reductions in quetiapine prescribing, with no evidence of negative effects on patients.

Trial Registration  ClinicalTrials.gov identifier: NCT02467933

Sign in to take quiz and track your certificates

Buy This Activity

JN Learning™ is the home for CME and MOC from the JAMA Network. Search by specialty or US state and earn AMA PRA Category 1 CME Credit™ from articles, audio, Clinical Challenges and more. Learn more about CME/MOC

Article Information

Accepted for Publication: May 31, 2018.

Corresponding Author: Adam Sacarny, PhD, Department of Health Policy and Management, Mailman School of Public Health, Columbia University, 722 W 168 St, Fourth Floor, New York, NY 10032 (ajs2102@columbia.edu).

Published Online: August 1, 2018. doi:10.1001/jamapsychiatry.2018.1867

Author Contributions: Dr Sacarny had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: Sacarny, Tetkoski, Yokum, Agrawal.

Acquisition, analysis, or interpretation of data: Sacarny, Barnett, Le, Yokum, Agrawal.

Drafting of the manuscript: Sacarny.

Critical revision of the manuscript for important intellectual content: All authors.

Statistical analysis: Sacarny, Barnett.

Obtained funding: Sacarny, Yokum.

Administrative, technical, or material support: Sacarny, Le, Tetkoski, Yokum, Agrawal.

Supervision: Sacarny, Agrawal.

Conflict of Interest Disclosures: None reported.

Funding/Support: We acknowledge the support of the Robert Wood Johnson Foundation, Abdul Latif Jameel Poverty Action Lab (J-PAL) North America, and the Laura and John Arnold Foundation (all to Dr Sacarny).

Role of the Funder/Sponsor: The funding sources had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Disclaimer: The views expressed in this publication represent those of the authors and not their respective organizations, including the Centers for Medicare & Medicaid Services (CMS). The contents of this publication were reviewed for compliance by CMS.

Alexander  GC, Gallagher  SA, Mascola  A, Moloney  RM, Stafford  RS.  Increasing off-label use of antipsychotic medications in the United States, 1995-2008.  Pharmacoepidemiol Drug Saf. 2011;20(2):177-184. doi:10.1002/pds.2082PubMedGoogle ScholarCrossref
Government Accountability Office (GAO).  Antipsychotic Drug Use: HHS Has Initiatives to Reduce Use Among Older Adults in Nursing Homes, but Should Expand Efforts to Other Settings. Washington, DC: GAO; 2015.
Semla  TP, Lee  A, Gurrera  R,  et al.  Off-label prescribing of second-generation antipsychotics to elderly veterans with posttraumatic stress disorder and dementia.  J Am Geriatr Soc. 2017;65(8):1789-1795. doi:10.1111/jgs.14897PubMedGoogle ScholarCrossref
Driessen  J, Baik  SH, Zhang  Y.  Trends in off-label use of second-generation antipsychotics in the Medicare population from 2006 to 2012.  Psychiatr Serv. 2016;67(8):898-903. doi:10.1176/appi.ps.201500316PubMedGoogle ScholarCrossref
Hwang  YJ, Dixon  SN, Reiss  JP,  et al.  Atypical antipsychotic drugs and the risk for acute kidney injury and other adverse outcomes in older adults: a population-based cohort study.  Ann Intern Med. 2014;161(4):242-248. doi:10.7326/M13-2796PubMedGoogle ScholarCrossref
Maust  DT, Kim  HM, Seyfried  LS,  et al.  Antipsychotics, other psychotropics, and the risk of death in patients with dementia: number needed to harm.  JAMA Psychiatry. 2015;72(5):438-445. doi:10.1001/jamapsychiatry.2014.3018PubMedGoogle ScholarCrossref
Maher  AR, Maglione  M, Bagley  S,  et al.  Efficacy and comparative effectiveness of atypical antipsychotic medications for off-label uses in adults: a systematic review and meta-analysis.  JAMA. 2011;306(12):1359-1369. doi:10.1001/jama.2011.1360PubMedGoogle ScholarCrossref
El-Saifi  N, Moyle  W, Jones  C, Tuffaha  H.  Quetiapine safety in older adults: a systematic literature review.  J Clin Pharm Ther. 2016;41(1):7-18. doi:10.1111/jcpt.12357PubMedGoogle ScholarCrossref
Maglione  M, Maher  AR, Hu  J,  et al.  Off-Label Use of Atypical Antipsychotics: An Update. Rockville, MD: Agency for Healthcare Research and Quality; 2011. http://www.ncbi.nlm.nih.gov/books/NBK66081/. Published September 2011. Accessed June 13, 2018.
Steinberg  M, Lyketsos  CG.  Atypical antipsychotic use in patients with dementia: managing safety concerns.  Am J Psychiatry. 2012;169(9):900-906. doi:10.1176/appi.ajp.2012.12030342PubMedGoogle ScholarCrossref
Schneider  LS, Dagerman  KS, Insel  P.  Risk of death with atypical antipsychotic drug treatment for dementia: meta-analysis of randomized placebo-controlled trials.  JAMA. 2005;294(15):1934-1943. doi:10.1001/jama.294.15.1934PubMedGoogle ScholarCrossref
Ballard  C, Margallo-Lana  M, Juszczak  E,  et al.  Quetiapine and rivastigmine and cognitive decline in Alzheimer’s disease: randomised double blind placebo controlled trial.  BMJ. 2005;330(7496):874. doi:10.1136/bmj.38369.459988.8FPubMedGoogle ScholarCrossref
American Psychiatric Association: Choosing Wisely. Five things physicians and patients should question. http://www.choosingwisely.org/societies/american-psychiatric-association/. Released September 20, 2013; recommendation 5 updated August 21, 2014; recommendation 3 updated April 22, 2015. Accessed September 26, 2017.
Seroquel (quetiapine fumarate). Highlights of prescribing information. http://www.accessdata.fda.gov/drugsatfda_docs/label/2016/020639s064lbl.pdf. Published June 2016. Accessed June 13, 2018.
American Geriatrics Society 2015 Beers Criteria Update Expert Panel.  American Geriatrics Society 2015 updated Beers Criteria for potentially inappropriate medication use in older adults.  J Am Geriatr Soc. 2015;63(11):2227-2246. doi:10.1111/jgs.13702PubMedGoogle ScholarCrossref
Office of Surveillance and Epidemiology, Center for Drug Evaluation and Research, US Food and Drug Administration. Pediatric postmarketing pharmacovigilance and drug utilization review: Seroquel and Seroquel XR. http://www.fda.gov/downloads/AdvisoryCommittees/CommitteesMeetingMaterials/PediatricAdvisoryCommittee/UCM494485.pdf. Published February 19, 2016. Accessed June 13, 2018.
Walton  SM, Schumock  GT, Lee  KV, Alexander  GC, Meltzer  D, Stafford  RS. Developing Evidence-Based Research Priorities for Off-Label Drug Use. Rockville, MD: Agency for Healthcare Research and Quality. Effective Health Care Research Report 12. https://effectivehealthcare.ahrq.gov/sites/default/files/pdf/off-label-use-research-priorities_research.pdf. Published May 2009. Accessed June 13, 2018.
Mitka  M.  CMS seeks to reduce antipsychotic use in nursing home residents with dementia.  JAMA. 2012;308(2):119, 121. doi:10.1001/jama.2012.7422PubMedGoogle ScholarCrossref
Avorn  J, Soumerai  SB, Everitt  DE,  et al.  A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes.  N Engl J Med. 1992;327(3):168-173. doi:10.1056/NEJM199207163270306PubMedGoogle ScholarCrossref
Thompson  A, Sullivan  SA, Barley  M,  et al.  The DEBIT trial: an intervention to reduce antipsychotic polypharmacy prescribing in adult psychiatry wards: a cluster randomized controlled trial.  Psychol Med. 2008;38(5):705-715. doi:10.1017/S003329170700147XPubMedGoogle ScholarCrossref
Arditi  C, Rège-Walther  M, Wyatt  JC, Durieux  P, Burnand  B.  Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes.  Cochrane Database Syst Rev. 2012;12:CD001175.PubMedGoogle Scholar
Meeker  D, Knight  TK, Friedberg  MW,  et al.  Nudging guideline-concordant antibiotic prescribing: a randomized clinical trial.  JAMA Intern Med. 2014;174(3):425-431. doi:10.1001/jamainternmed.2013.14191PubMedGoogle ScholarCrossref
Meeker  D, Linder  JA, Fox  CR,  et al.  Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial.  JAMA. 2016;315(6):562-570. doi:10.1001/jama.2016.0275PubMedGoogle ScholarCrossref
Hallsworth  M, Chadborn  T, Sallis  A,  et al.  Provision of social norm feedback to high prescribers of antibiotics in general practice: a pragmatic national randomised controlled trial.  Lancet. 2016;387(10029):1743-1752. doi:10.1016/S0140-6736(16)00215-4PubMedGoogle ScholarCrossref
Sacarny  A, Yokum  D, Finkelstein  A, Agrawal  S.  Medicare letters to curb overprescribing of controlled substances had no detectable effect on providers.  Health Aff (Millwood). 2016;35(3):471-479. doi:10.1377/hlthaff.2015.1025PubMedGoogle ScholarCrossref
Ivers  N, Jamtvedt  G, Flottorp  S,  et al.  Audit and feedback: effects on professional practice and healthcare outcomes.  Cochrane Database Syst Rev. 2012;(6):CD000259.PubMedGoogle Scholar
Tukey  JW.  Exploratory Data Analysis. Indianapolis, IN: Addison-Wesley Publishing Co; 1977.
Castro  L, Scartascini  C.  Tax compliance and enforcement in the Pampas: evidence from a field experiment.  J Econ Behav Organ. 2015;116:65-82. doi:10.1016/j.jebo.2015.04.002Google ScholarCrossref
Fellner  G, Sausgruber  R, Traxler  C.  Testing enforcement strategies in the field: threat, moral appeal and social information.  J Eur Econ Assoc. 2013;11(3):634-660. doi:10.1111/jeea.12013Google ScholarCrossref
Allcott  H, Rogers  T.  The Short-Run and Long-Run Effects of Behavioral Interventions: Experimental Evidence From Energy Conservation. Cambridge, MA: National Bureau of Economic Research; 2012. http://www.nber.org/papers/w18492.pdf. Published October 2012. Accessed August 25, 2016. doi:10.3386/w18492
Seroquel XR (quetiapine fumarate). Highlights of prescribing information. http://www.accessdata.fda.gov/drugsatfda_docs/label/2016/022047s038lbl.pdf. Published June 2016. Accessed June 13, 2018.
Cox  DR, McCullagh  P.  Some aspects of analysis of covariance.  Biometrics. 1982;38(3):541-561. doi:10.2307/2530040PubMedGoogle ScholarCrossref
Athey  S, Imbens  GW. The econometrics of randomized experiments. In: Banerjee AV, Duflo E, eds.  Handbook of Economic Field Experiments. Vol 1. New York, NY: Elsevier; 2017:73-140. doi:10.1016/bs.hefe.2016.10.003
Linder  JA, Meeker  D, Fox  CR,  et al.  Effects of behavioral interventions on inappropriate antibiotic prescribing in primary care 12 months after stopping interventions.  JAMA. 2017;318(14):1391-1392. doi:10.1001/jama.2017.11152PubMedGoogle ScholarCrossref
Agency for Healthcare Research and Quality. Alert fatigue. https://psnet.ahrq.gov/primers/primer/28/alert-fatigue. Last updated June 2017. Accessed June 13, 2018.
If you are not a JN Learning subscriber, you can either:
Subscribe to JN Learning for one year
Buy this activity
If you are not a JN Learning subscriber, you can either:
Subscribe to JN Learning for one year
Buy this activity
With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Education Center Collection Sign In Modal Right

Name Your Search

Save Search
With a personal account, you can:
  • Track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience

Lookup An Activity



My Saved Searches

You currently have no searches saved.

With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Education Center Collection Sign In Modal Right