Accepted for Publication: June 29, 2021.
Published Online: August 25, 2021. doi:10.1001/jamapsychiatry.2021.2318
Corresponding Author: John C. Fortney, PhD, Department of Psychiatry and Behavioral Sciences, School of Medicine, University of Washington, 1959 NE Pacific St, Box 356560, Seattle, WA 98195 (fortneyj@uw.edu).
Author Contributions: Drs Fortney and Hawrilenko had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: Fortney, Bauer, Cerimele, Pyne, Heagerty, Kaysen, Bowen, Moore, Metzger, Hafer, Unützer.
Acquisition, analysis, or interpretation of data: Fortney, Bauer, Cerimele, Pyne, Pfeiffer, Heagerty, Hawrilenko, Zielinski, Kaysen, Bowen, Moore, Ferro, Shushan, Nolan, Dalack, Unützer.
Drafting of the manuscript: Fortney, Hawrilenko, Bowen, Moore, Metzger, Hafer.
Critical revision of the manuscript for important intellectual content: Bauer, Cerimele, Pyne, Pfeiffer, Heagerty, Hawrilenko, Zielinski, Kaysen, Moore, Ferro, Shushan, Nolan, Dalack, Unützer.
Statistical analysis: Fortney, Heagerty, Hawrilenko.
Obtained funding: Fortney, Kaysen, Hafer.
Administrative, technical, or material support: Fortney, Bauer, Pfeiffer, Zielinski, Kaysen, Bowen, Moore, Ferro, Metzger, Shushan, Hafer, Nolan, Dalack, Unützer.
Study supervision: Fortney, Pyne, Kaysen, Unützer.
Conflict of Interest Disclosures: Drs Fortney, Bauer, Cerimele, Heagerty, Kaysen, Shushan, and Dalack have received grants from the Patient-Centered Outcomes Research Institute during the conduct of the study. Dr Bauer has received grants from the National Institutes of Health, Washington State Legislature Integrated Care Training Program, and Premera Blue Cross Rural Mental Health Integration Initiative outside the submitted work. Dr Pyne has received grants from the University of Arkansas for Medical Sciences during the conduct of the study. Dr Kaysen has received personal fees from Elsevier Publishing and honorarium for conducting trainings or workshops in cognitive processing therapy outside the submitted work. Dr Moore has received support from the University of Washington during the conduct of the study. No other disclosures were reported.
Funding/Support: This work was supported by a grant PCS-1406-19295 from the Patient-Centered Outcomes Research Institute to Drs Fortney and Unützer.
Role of the Funder/Sponsor: The funder had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Disclaimer: The statements in this article are solely the responsibility of the authors and do not necessarily represent the views of the Patient-Centered Outcomes Research Institute, its board of governors, or methodology committee.
Data Sharing Statement: See Supplement 3.
Additional Contributions: We thank the patients and staff of Family Health Centers, Omak, Washington; Moses Lake Community Health Center, Moses Lake, Washington; Sea Mar Community Health Centers, Seattle, Washington; Yakima Neighborhood Health Services, Yakima, Washington; Boston Mountain Rural Health Centers, Marshal, Arkansas; East Arkansas Family Health Center, West Memphis; Lee County Cooperative Clinic, Marianna, Arkansas; Cherry Health, Grand Rapids, Michigan; Family Medical Center, Temperance, Michigan; Great Lakes Bay Health Centers, Saginaw, Michigan; InterCare Community Health Network, Bangor, Michigan; and Upper Great Lakes Family Health Center, Calumet, Michigan. We thank the staff of the Community Health Plan of Washington, the Community Health Centers of Arkansas, and the Michigan Primary Care Association. We thank our policy advisory board: Donald Weaver, MD (National Association of Community Health Centers, Bethesda, Maryland); Ed Larkins, MHA (Family Medical Center); Jay Shore, MD (University of Colorado at Denver); LaShannon Spencer, MPA, MHSA (Community Health Centers of Arkansas, Little Rock); Nancy Speck, PhD (National Association for Rural Mental Health, Houston, Texas); Sara Coates, MA, MPH, and Dawne Velianoff, LMSW (Michigan Primary Care Association, Lansing); and Susan Ward-Jones, MD (East Arkansas Family Health Center). We thank our consumer advisor board: Bernadette McDonald, BS; Florence Fee, JD (No Health Without Mental Health, Arlington, Virginia); Ingrid Deetz, BS, Kevin Einbinder, BS, and Betsy O’Brien, BS (Depression and Bipolar Support Alliance, Chicago, Illinois); Kim Arnold, BS, Marquitta Magnini, BS, and Shawn McCown, BS (National Alliance on Mental Illness, Little Rock, Arkansas); Jode Freyholtz-London, AAS (Wellness in the Woods, Eagle Bend, Minnesota); and Tammy Heral and Jeremy Mullins. We thank the members of our external data safety monitoring board: Thomas Belin, PhD (University of California, Los Angeles); John Williams, MD (Duke University, Durham, North Carolina); and Mark Williams, MD (Mayo Clinic, Rochester, Minnesota). Also, thanks to our research staff Suzanne Hunter, BS, Jared Bechtel, BS, Diane Powers, MA, MBA, Shiyu Chen, MS, and Morgan Johnson, MS (Department of Psychiatry, University of Washington, Seattle); and Nick Ponomarev, PhD, and Dan Vakoch, MS (Social and Economic Sciences Research Center, Washington State University, Pullman). We thank the following electronic health record vendors for giving us substantial discounts on the user licenses for the telepsychiatrists and telepsychologists: NextGen Healthcare, eClinicalWorks, Centricity (GE Healthcare), Allscripts, and SuccessEHS, Inc. Members of the policy advisory board and consumer advisory board as well as our research staff were compensated for their work.
1.Wang
PS , Lane
M , Olfson
M , Pincus
HA , Wells
KB , Kessler
RC . Twelve-month use of mental health services in the United States: results from the National Comorbidity Survey Replication.
Arch Gen Psychiatry. 2005;62(6):629-640. doi:
10.1001/archpsyc.62.6.629PubMedGoogle ScholarCrossref 6.Fortney
JC , Heagerty
PJ , Bauer
AM ,
et al. Study to Promote Innovation in Rural Integrated Telepsychiatry (SPIRIT): rationale and design of a randomized comparative effectiveness trial of managing complex psychiatric disorders in rural primary care clinics.
Contemp Clin Trials. 2020;90:105873. doi:
10.1016/j.cct.2019.105873PubMedGoogle Scholar 8.Fortney
JC , Pyne
JM , Mouden
SB ,
et al. Practice-based versus telemedicine-based collaborative care for depression in rural federally qualified health centers: a pragmatic randomized comparative effectiveness trial.
Am J Psychiatry. 2013;170(4):414-425. doi:
10.1176/appi.ajp.2012.12050696PubMedGoogle ScholarCrossref 10.Fortney
JC , Veith
RC , Bauer
AM ,
et al. Developing telemental health partnerships between state medical schools and federally qualified health centers: navigating the regulatory landscape and policy recommendations.
J Rural Health. 2019;35(3):287-297. doi:
10.1111/jrh.12323PubMedGoogle ScholarCrossref 13.Fortney
JC , Pyne
JM , Ward-Jones
S ,
et al. Implementation of evidence-based practices for complex mood disorders in primary care safety net clinics.
Fam Syst Health. 2018;36(3):267-280. doi:
10.1037/fsh0000357PubMedGoogle ScholarCrossref 15.Jakupcak
M , Wagner
A , Paulson
A , Varra
A , McFall
M . Behavioral activation as a primary care-based treatment for PTSD and depression among returning veterans.
J Trauma Stress. 2010;23(4):491-495. doi:
10.1002/jts.20543PubMedGoogle ScholarCrossref 18.Monson
CM , Schnurr
PP , Resick
PA , Friedman
MJ , Young-Xu
Y , Stevens
SP . Cognitive processing therapy for veterans with military-related posttraumatic stress disorder.
J Consult Clin Psychol. 2006;74(5):898-907. doi:
10.1037/0022-006X.74.5.898PubMedGoogle ScholarCrossref 19.Otto
MW , Reilly-Harrington
NA , Knauz
RO , Henin
A , Kogan
JN , Sachs
GS . Managing Bipolar Disorder: A Cognitive Behavior Treatment Program. Oxford University Press; 2008.
21.Blevins
CA , Weathers
FW , Davis
MT , Witte
TK , Domino
JL . The Posttraumatic Stress Disorder Checklist for
DSM-
5 (PCL-5): development and initial psychometric evaluation.
J Trauma Stress. 2015;28(6):489-498. doi:
10.1002/jts.22059PubMedGoogle ScholarCrossref 22.Derogatis
LR . Symptom Checklist-90–Revised (SCL-90-R). In: American Psychiatric Association; Rush AJ, ed. Handbook of Psychiatric Measures. American Psychiatric Association; 2000:81-84.
34.Shah
AD , Bartlett
JW , Carpenter
J , Nicholas
O , Hemingway
H . Comparison of random forest and parametric imputation models for imputing missing data using MICE: a CALIBER study.
Am J Epidemiol. 2014;179(6):764-774. doi:
10.1093/aje/kwt312PubMedGoogle ScholarCrossref 37.Bauer
MS , McBride
L , Williford
WO ,
et al; Cooperative Studies Program 430 Study Team. Collaborative care for bipolar disorder: part II. impact on clinical outcome, function, and costs.
Psychiatr Serv. 2006;57(7):937-945. doi:
10.1176/ps.2006.57.7.937PubMedGoogle ScholarCrossref 39.Kudla
D , Lambert
M , Domin
S , Kasper
S , Naber
D . Effectiveness, tolerability, and safety of ziprasidone in patients with schizophrenia or schizoaffective disorder: results of a multi-centre observational trial.
Eur Psychiatry. 2007;22(3):195-202. doi:
10.1016/j.eurpsy.2006.06.004PubMedGoogle ScholarCrossref 40.Kilbourne
AM , Post
EP , Nossek
A , Drill
L , Cooley
S , Bauer
MS . Improving medical and psychiatric outcomes among individuals with bipolar disorder: a randomized controlled trial.
Psychiatr Serv. 2008;59(7):760-768. doi:
10.1176/ps.2008.59.7.760PubMedGoogle ScholarCrossref 41.Kilbourne
AM , Goodrich
D , Miklowitz
DJ , Austin
K , Post
EP , Bauer
MS . Characteristics of patients with bipolar disorder managed in VA primary care or specialty mental health care settings.
Psychiatr Serv. 2010;61(5):500-507. doi:
10.1176/ps.2010.61.5.500PubMedGoogle ScholarCrossref 42.Bartels
SJ , Coakley
EH , Zubritsky
C ,
et al; PRISM-E Investigators. Improving access to geriatric mental health services: a randomized trial comparing treatment engagement with integrated versus enhanced referral care for depression, anxiety, and at-risk alcohol use.
Am J Psychiatry. 2004;161(8):1455-1462. doi:
10.1176/appi.ajp.161.8.1455PubMedGoogle ScholarCrossref 43.Areán
PA , Ayalon
L , Jin
C ,
et al. Integrated specialty mental health care among older minorities improves access but not outcomes: results of the PRISMe study.
Int J Geriatr Psychiatry. 2008;23(10):1086-1092. doi:
10.1002/gps.2100PubMedGoogle ScholarCrossref 45.Engel
CC , Jaycox
LH , Freed
MC ,
et al. Centrally assisted collaborative telecare for posttraumatic stress disorder and depression among military personnel attending primary care: a randomized clinical trial.
JAMA Intern Med. 2016;176(7):948-956. doi:
10.1001/jamainternmed.2016.2402PubMedGoogle ScholarCrossref 49.Suppes
T , Rush
AJ , Dennehy
EB ,
et al; Texas Medication Algorithm Project. Texas Medication Algorithm Project, phase 3 (TMAP-3): clinical results for patients with a history of mania.
J Clin Psychiatry. 2003;64(4):370-382. doi:
10.4088/JCP.v64n0403PubMedGoogle ScholarCrossref 53.Carlo
AD , Drake
L , Ratzliff
ADH , Chang
D , Unützer
J . Sustaining the collaborative care model (CoCM): billing newly available CoCM
CPT codes in an academic primary care system.
Psychiatr Serv. 2020;71(9):972-974. doi:
10.1176/appi.ps.201900581PubMedGoogle ScholarCrossref