What is the threshold for a clinically relevant effect? The case of major depressive disorders

Depress Anxiety. 2014 May;31(5):374-8. doi: 10.1002/da.22249. Epub 2014 Feb 22.

Abstract

Background: Randomized trials can show whether a treatment effect is statistically significant and can describe the size of the effect. There are, however, no validated methods available for establishing the clinical relevance of these outcomes. Recently, it was proposed that a standardized mean difference (SMD) of 0.50 be used as cutoff for clinical relevance in the treatment of depression.

Methods: We explore what the effect size means and why the size of an effect has little bearing on its clinical relevance. We will also examine how the "minimally important difference," as seen from the patient perspective, may be helpful in deciding where the cutoff for clinical relevance should be placed for a given condition.

Results: Effect sizes in itself cannot give an indication of the clinical relevance of an intervention because the outcome itself determines the clinical relevance and not only the size of the effects. The "minimal important difference" (MID) could be used as a starting point for pinpointing the cutoff for clinical relevance. A first, rough attempt to implement this approach for depression resulted in a tentative clinical relevance cutoff of SMD = 0.24. Using this cutoff, psychotherapy, pharmacotherapy, and combined treatment have effect sizes above this cutoff.

Discussion: Statistical outcomes cannot be equated with clinical relevance. The "MID" may be used for pinpointing the cutoff for clinical relevance, but more work in this area is needed.

Keywords: clinical relevance; depression; effect size; minimal important difference.

MeSH terms

  • Antidepressive Agents / therapeutic use*
  • Combined Modality Therapy
  • Depressive Disorder, Major / diagnosis
  • Depressive Disorder, Major / psychology
  • Depressive Disorder, Major / therapy*
  • Humans
  • Outcome and Process Assessment, Health Care / statistics & numerical data*
  • Psychometrics
  • Psychotherapy*

Substances

  • Antidepressive Agents