[Skip to Content]
[Skip to Content Landing]

A Simple Guide to Effect Size Measures

To identify the key insights or developments described in this article
1 Credit CME
Abstract

Importance  Effect size quantifies the magnitude of the difference or the strength of the association between variables. In clinical research it is important to calculate and report the effect size and the confidence interval (CI) because it is needed for sample size calculation, meaningful interpretation of results, and meta-analyses.

Observations  There are many different effect size measures that can be organized into 2 families or groups—d family and r family. The d family includes measures that quantify the differences between groups. The r family includes measures that quantify the strength of the association. Effect sizes that are presented in the same units as the characteristic being measured and compared are known as nonstandardized or simple effect sizes. The nonstandardized effect sizes have the advantage of being more informative, easier to interpret, and easier to evaluate in the light of clinical significance or practical relevance. Standardized effect sizes are unit-less and are helpful for combining and comparing effects of different outcome measures or across different studies (ie, meta-analysis).

Conclusions and Relevance  The choice of the correct effect size measure depends on the research question, study design, targeted audience, and the statistical assumptions being made. For a complete and meaningful interpretation of results from a clinical research study, the investigator should make clear the type of effect size being reported, its magnitude and direction, degree of uncertainty of the effect size estimate as presented by the CIs, and whether the results are compatible with a clinically meaningful effect.

Sign in to take quiz and track your certificates

Buy This Activity

JN Learning™ is the home for CME and MOC from the JAMA Network. Search by specialty or US state and earn AMA PRA Category 1 Credit(s)™ from articles, audio, Clinical Challenges and more. Learn more about CME/MOC

CME Disclosure Statement: Unless noted, all individuals in control of content reported no relevant financial relationships. If applicable, all relevant financial relationships have been mitigated.

Article Information

Accepted for Publication: January 27, 2023.

Published Online: March 23, 2023. doi:10.1001/jamaoto.2023.0159

Corresponding Author: Dorina Kallogjeri, MD, MPH, Clinical Outcomes Research Office, Department of Otolaryngology–Head and Neck Surgery, Washington University School of Medicine in St Louis, 660 S Euclid Ave, Campus Box 8115, St Louis, MO 63110 (kallogjerid@wustl.edu).

Author Contributions: All authors had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.

Concept and design: All authors.

Drafting of the manuscript: All authors.

Critical revision of the manuscript for important intellectual content: Kallogjeri.

Administrative, technical, or material support: Piccirillo.

Other - wrote the manuscript: Kallogjeri.

Conflict of Interest Disclosures: Dr Piccirillo reported that he developed the SNOT, SNORE, and NOSE-HHT instruments and receives royalty payments when Washington University licenses these instruments. No other conflicts were reported.

Disclaimer: Dr Piccirillo is Editior in Chief of JAMA Otolaryngology–Head and Neck Surgery. Dr Kallogjeri is the Statistics Editor of JAMA Otolaryngology–Head and Neck Surgery. They were not involved in the editorial decision regarding this manuscript.

References
1.
Piccirillo  JF .  Improving the quality of the reporting of research results.   JAMA Otolaryngol Head Neck Surg. 2016;142(10):937-939. doi:10.1001/jamaoto.2016.2670PubMedGoogle ScholarCrossref
2.
Kallogjeri  D , Francis  DO , Piccirillo  JF .  Use of confidence intervals to improve the quality of research results reporting and interpretation.   JAMA Otolaryngol Head Neck Surg. 2019;145(6):491-493. doi:10.1001/jamaoto.2019.0793PubMedGoogle ScholarCrossref
3.
Kallogjeri  D , Spitznagel  EL  Jr , Piccirillo  JF .  Importance of defining and interpreting a clinically meaningful difference in clinical research.   JAMA Otolaryngol Head Neck Surg. 2020;146(2):101-102. doi:10.1001/jamaoto.2019.3744PubMedGoogle ScholarCrossref
4.
Kelley  K , Preacher  KJ .  On effect size.   Psychol Methods. 2012;17(2):137-152. doi:10.1037/a0028086PubMedGoogle ScholarCrossref
5.
Cumming  G .  Understanding the New Statistics: Effect Sizes, Confidence Intervals, And Meta-Analysis. New York: Routledge; 2012.
6.
Amaral  EOS , Line  SRP .  Current use of effect size or confidence interval analyses in clinical and biomedical research.   Scientometrics. 2021;126(11):9133-9145. doi:10.1007/s11192-021-04150-3PubMedGoogle ScholarCrossref
7.
Ellis  PD .  The Essential Guide to Effect Sizes. Statistical Power, Meta-Analysis, and the Interpretation of Research Results. Cambridge University Press; 2015.
8.
Tait  S , Kallogjeri  D , Suko  J , Kukuljan  S , Schneider  J , Piccirillo  JF .  Effect of budesonide added to large-volume, low-pressure saline sinus irrigation for chronic rhinosinusitis: a randomized clinical trial.   JAMA Otolaryngol Head Neck Surg. 2018;144(7):605-612. doi:10.1001/jamaoto.2018.0667PubMedGoogle ScholarCrossref
9.
Cohen  J .  Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Routledge; 1988.
10.
Xie  DX , Dedmon  MM , O’Connell  BP , Yawn  RJ , Haynes  DS .  Evaluation of social media presence of otolaryngology residency programs in the United States.   JAMA Otolaryngol Head Neck Surg. 2018;144(9):802-806. doi:10.1001/jamaoto.2018.1447PubMedGoogle ScholarCrossref
11.
Vandekar  S , Tao  R , Blume  J .  A robust effect size index.   Psychometrika. 2020;85(1):232-246. doi:10.1007/s11336-020-09698-2PubMedGoogle ScholarCrossref
12.
Schmid  M , Giger  R , Nisa  L , Mueller  SA , Schubert  M , Schubert  AD .  Association of multiprofessional preoperative assessment and information for patients with head and neck cancer with postoperative outcomes.   JAMA Otolaryngol Head Neck Surg. 2022;148(3):259-267. doi:10.1001/jamaoto.2021.4048PubMedGoogle ScholarCrossref
13.
Sindhar  S , Kallogjeri  D , Wildes  TS , Avidan  MS , Piccirillo  JF .  Association of preoperative functional performance with outcomes after surgical treatment of head and neck cancer: a clinical severity staging system.   JAMA Otolaryngol Head Neck Surg. 2019;145(12):1128-1136. doi:10.1001/jamaoto.2019.1035PubMedGoogle ScholarCrossref
14.
Harrell  FE  Jr , Lee  KL , Mark  DB .  Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors.   Stat Med. 1996;15(4):361-387. doi:10.1002/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4PubMedGoogle Scholar
15.
Jiramongkolchai  P , Jones  MS , Peterson  A ,  et al.  Association of olfactory training with neural connectivity in adults with postviral olfactory dysfunction.   JAMA Otolaryngol Head Neck Surg. 2021;147(6):502-509. doi:10.1001/jamaoto.2021.0086PubMedGoogle Scholar
16.
Doty  RL , Yousem  DM , Pham  LT , Kreshak  AA , Geckle  R , Lee  WW .  Olfactory dysfunction in patients with head trauma.   Arch Neurol. 1997;54(9):1131-1140. doi:10.1001/archneur.1997.00550210061014PubMedGoogle Scholar
17.
Mahadev  AKD , Piccirillo  JF .  Validation of minimal clinically important difference for University of Pennsylvania Smell Identification Test (UPSIT).   Laryngoscope. 2023 (submitted for publication).Google Scholar
18.
Kletzien  H , Macdonald  CL , Orne  J ,  et al.  Comparison between patient-perceived voice changes and quantitative voice measures in the first postoperative year after thyroidectomy: a secondary analysis of a randomized clinical trial.   JAMA Otolaryngol Head Neck Surg. 2018;144(11):995-1003. doi:10.1001/jamaoto.2018.0309PubMedGoogle Scholar
19.
Chua  KP , Harbaugh  CM , Brummett  CM ,  et al.  Association of perioperative opioid prescriptions with risk of complications after tonsillectomy in children.   JAMA Otolaryngol Head Neck Surg. 2019;145(10):911-918. doi:10.1001/jamaoto.2019.2107PubMedGoogle Scholar
AMA CME Accreditation Information

Credit Designation Statement: The American Medical Association designates this Journal-based CME activity activity for a maximum of 1.00  AMA PRA Category 1 Credit(s)™. Physicians should claim only the credit commensurate with the extent of their participation in the activity.

Successful completion of this CME activity, which includes participation in the evaluation component, enables the participant to earn up to:

  • 1.00 Medical Knowledge MOC points in the American Board of Internal Medicine's (ABIM) Maintenance of Certification (MOC) program;;
  • 1.00 Self-Assessment points in the American Board of Otolaryngology – Head and Neck Surgery’s (ABOHNS) Continuing Certification program;
  • 1.00 MOC points in the American Board of Pediatrics’ (ABP) Maintenance of Certification (MOC) program;
  • 1.00 Lifelong Learning points in the American Board of Pathology’s (ABPath) Continuing Certification program; and
  • 1.00 CME points in the American Board of Surgery’s (ABS) Continuing Certification program

It is the CME activity provider's responsibility to submit participant completion information to ACCME for the purpose of granting MOC credit.

Close
Want full access to the AMA Ed Hub?
After you sign up for AMA Membership, make sure you sign in or create a Physician account with the AMA in order to access all learning activities on the AMA Ed Hub
Buy this activity
Close
Want full access to the AMA Ed Hub?
After you sign up for AMA Membership, make sure you sign in or create a Physician account with the AMA in order to access all learning activities on the AMA Ed Hub
Buy this activity
Close
With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Education Center Collection Sign In Modal Right
Close

Name Your Search

Save Search
With a personal account, you can:
  • Access free activities and track your credits
  • Personalize content alerts
  • Customize your interests
  • Fully personalize your learning experience
Close
Close

Lookup An Activity

or

My Saved Searches

You currently have no searches saved.

Close

My Saved Courses

You currently have no courses saved.

Close