Article Text
Abstract
Background Young people are at risk of falling through the care gap after leaving child and adolescent mental health services (CAMHS) despite an ongoing need for mental health support. Currently, little is known about the predictors of transitioning to adult mental health services (AMHS), and associated healthcare and societal costs as young people cross the transition boundary.
Objective To conduct a secondary data analysis exploring predictors of transitioning or falling through the gap and associated costs.
Methods Data were used from a longitudinal study, which followed young people from seven European countries for 2 years after reaching their CAMHS boundary. Predictors of transitioning (including sociodemographic and clinical variables) and longitudinal resource use were compared for 488 young people who transitioned to AMHS versus those who fell through the gap.
Findings Young people were more likely to transition to AMHS if they were severely ill. Those from Italy, the Netherlands and the UK were more likely to fall through the gap than transition to AMHS. Healthcare costs fell for all young people over the study, with a sharper decrease for those who fell through the gap.
Conclusions Total healthcare costs fell for all participants, indicating that the intensity of mental health support reduces for all young people as they cross the CAMHS boundary, regardless of clinical need.
Clinical implications It is important that alternative forms of mental health support are available for young people who do not meet the AMHS care threshold but still have mental health needs after leaving CAMHS.
- child & adolescent psychiatry
Data availability statement
The datasets generated and analysed during the study are not publicly available, however MILESTONE data may be made available on request by contacting the corresponding author of the main MILESTONE study publication (https://doi.org/10.1017/S0033291721003901).
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
WHAT IS ALREADY KNOWN ON THIS TOPIC
Previous research has indicated that around a quarter of young people transition to adult mental health services (AMHS) after reaching the upper age limit of child and adolescent mental health services (CAMHS).
Young people with diagnoses of severe and enduring mental illness are more likely to transition, as are those who have previously attempted suicide or who are more severely ill when they reach the transition boundary.
WHAT THIS STUDY ADDS
To our knowledge, this is the first study exploring resource use and healthcare costs for young people after leaving CAMHS.
This study also indicated that only the most severely ill of young people with a diagnosis of anxiety or mood disorder, neurodevelopmental disorder or emerging personality disorder transition to AMHS.
HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY
Not all young people require ongoing mental health support after leaving CAMHS. However, there is a subsample of young people who do require ongoing support but do not meet the criteria for AMHS. It is important that other sources of support are available to meet the mental health needs of these young people.
Introduction
When young people (YP) reach the upper age boundary of child and adolescent mental health services (CAMHS), care should be transferred to an adult mental health service (AMHS) if that young person still requires ongoing support. This transfer of care should occur as part of the therapeutic process and is known as transition. If carried out correctly,1 it should result in good continuity of care, taking place at a time and pace appropriate for the individual’s needs. While not all YP are likely to need ongoing care, only around a quarter of YP transition to AMHS2 and some are said to fall through the gap between services, as they do not transition despite an ongoing need.3
YP with certain diagnoses are at particular risk of falling through the gap. For example, YP with neurodevelopmental disorders, such as attention-deficit hyperactivity disorder (ADHD) or autism spectrum disorder, are at particular risk of discontinuity of care, as there is a lack of available specialist adult services.4 5 Other research has indicated that YP with an anxiety or depressive disorder are less likely to transition.3 6 A cohort study conducted as part of the MILESTONE Project, which aimed to understand and improve mental health service transitions for YP in eight European countries, found those who had a more severe illness, suicidal thoughts or used psychotropic medication were more likely to transition.7
Previous research has established that mental illness in YP results in higher costs for the education system, criminal justice system and wider society, in addition to increased healthcare costs.8 9 Preliminary work investigating specialist services for transition-aged youth has found improvements in mental health outcomes for YP, with associated cost savings.9 10 So far, however, there has been no detailed investigation comparing the costs of transitioning to AMHS compared with those who fall through the gap between services.
Objective
This research used a subsample of the MILESTONE Study population,7 11 which combined a trial of an intervention of managed transition, a health economics analysis and a longitudinal study. The first objective of this study was to expand on existing findings to explore the predictors of YP falling through the gap versus transitioning to AMHS with a diagnosis of anxiety or mood disorder, neurodevelopmental disorder or emerging personality disorder. These groups are most likely to fall through the gap compared with diagnoses such as psychosis or schizophrenia.3 6 12 Most previous research has focused only on diagnostic, not sociodemographic or clinical predictors of transitioning. YP with emerging personality disorder have been included despite contradictory findings regarding transition outcomes.3 12 The second objective was to examine the healthcare and societal costs associated with transitioning and falling through the gap.
Methods
This study used data collected in seven out of the eight countries involved in the MILESTONE Project11: Belgium, Croatia, France, Germany, Ireland, Italy, the Netherlands and the UK. Due to administrative procedures, the dataset from Croatia was not available for this study.
Cost analyses were conducted using a healthcare and personal social services perspective as well as a wider societal perspective including the criminal justice system and other costs, meaning both healthcare and wider societal costs were taken into consideration in the analysis.
Participants
All YP recruited to the MILESTONE Study who had a diagnosis of anxiety or mood disorder, neurodevelopmental disorder or emerging personality disorder were included. YP may have other comorbid diagnoses, as the sample was not limited to those with only the diagnoses listed above.
Participants were classified as falling through the transition gap if they were discharged from CAMHS with no other referral despite having an ongoing clinical need, or if they were referred to AMHS but discharged by the next data collection time point, while still indicating a clinical need. This could occur at any time in the study, as YP could have stayed at CAMHS beyond the transition boundary. Clinical need was measured by a score of 2 or above on Health of the Nation Outcome Scale for Children and Adolescents (HoNOSCA) questions relating to psychiatric symptoms.13 Participants were classified as transitioning to AMHS if they were referred and started care at an AMHS. This study did not include YP who were discharged from CAMHS with no ongoing clinical need.
Study procedure and measures
YP were recruited at around 6 months prior to their CAMHS transition boundary and followed up for up to 24 months: T1 (baseline), T2 (+9 months), T3 (+15 months) and T4 (+24 months). Demographic data were collected at each time point through semistructured interviews. Diagnostic data were collected from the YP’s clinician or available clinical records at each time point. Clinicians completed the Clinical Global Impression-Severity (CGI-S) Scale14 as a measure of illness severity. The clinician-rated HoNOSCA (rated by trained research assistants) was used to assess clinical need (a higher score indicates higher levels of need)15 and the ASEBA Instruments (Achenbach System of Empirically Based Assessment)16 17 were used to assess emotional and behavioural problems. An adapted Independent Behaviour During Consultation Scale (IBDCS) was used to measure adolescents’ self-efficacy and independent behaviour,18 with a lower score indicating fewer independent behaviours. A MILESTONE-specific Client Service Receipt Inventory was developed to collect resource use information. Finally, the EQ5D-5L19 was used for the health economic analysis. Health profiles from this measure were combined with preference-weights20 to calculate utility scores. These utility scores were used to assess health-related quality of life for all MILESTONE participants at each data collection point. Further information about the measures used can be found in online supplemental file 1.
Supplemental material
Statistical analysis
Predictors of transitioning
A logistical regression model was used to explore the predictors of YP falling through the gap. Independent variables included age, gender, nationality, ethnicity, diagnosis, length of time at CAMHS, number of diagnoses, previous suicide attempt, severity of illness (CGI and HoNOSCA scores) and independent behaviour score (from the baseline IBDCS). ORs of independent variables and associated 95% CIs were calculated to assess the impact of the independent variable on probability of transitioning. Post-analysis tests were conducted to check the model for specification and collinearity errors.
Health economic analyses
Calculating cost
Resource use data were combined with unit costs to estimate the costs associated with YP who fell through the gap compared with those who made the transition to adult services. We pragmatically adopted a one-country pooled perspective given the lack of availability of high-quality unit cost sources in all participating countries, whereby unit costs were derived from UK costing resources such as the National Health Service reference costs21 and the Personal Social Services Research Unit.22 Costs are presented in Belgium euros (converted using purchasing power parity) for the price year 2015. Given the time frame of the study, costs were not discounted. Details of units costs are presented in online supplemental file 2.
Supplemental material
Resource use
Descriptive statistics were calculated for all cost components and the level of resource use was compared between those who transitioned and who fell through the gap, using t-tests for continuous variables and Χ2 tests for categorical variables.
Analysing costs
Inpatient, hospital outpatient and community care costs were combined to calculate total healthcare costs for each participant. These were then used to conduct an analysis of costs between those who transitioned and those who fell through the gap. Due to the high percentage of missing data, multiple imputation was used as the base-case for the analysis of total cost. Variables were included in the imputation model if they were to be included in the final multilevel model or were variables that predicted missingness in the cost variables (details in online supplemental file 3). The datasets generated by the multiple imputation were combined using Rubin’s rule23 to allow inferential statistics.
Supplemental material
Model development
A series of regression models were conducted to examine differences in the cost of healthcare service use between those who fell through the gap and those who transitioned. An initial unadjusted regression model was conducted to compare EQ5D scores between those who transitioned and who fell through the gap. This was followed by a partially adjusted multilevel model controlling for country and cluster and baseline EQ5D scores.
The final models were fully adjusted, controlling for baseline scores and covariates. The covariates included in each model were: baseline EQ5D utility, ASEBA scores (either youth or adult version), HoNOSCA scores, CGI score, transition outcome, baseline age, gender, ethnicity, primary diagnostic group, length of time at CAMHS, IBDCS score and previous suicide attempt. The two levels in these models were country and cluster (as the original data were collected as part of a cluster-randomised controlled trial). Post-analysis tests were conducted to check for collinearity errors.
Findings
Screening MILESTONE longitudinal cohort data according to the inclusion criteria applied in this study resulted in a sample of 488 participants (of the 1004 recruited). Common reasons for exclusion for the present study included not having a diagnosis at baseline or not having an eligible diagnosis, or not having an ongoing clinical need after leaving CAMHS. Of the included participants, 336 were judged to have fallen through the gap, while 152 transitioned to AMHS. Details of the sample are shown in table 1. Transition outcome by country is also shown in table 1, with the highest percentage of YP transitioning in Ireland (48%) and the lowest percentage of YP transitioning in Italy (12%).
Predictors of transitioning
All variables had less than 10% of missing data at baseline; therefore, it was decided that complete case analysis was sufficient for analysis, resulting in data from 403 participants included in the model (table 2).
Being severely ill was associated with a significantly increased probability of transitioning to AMHS (OR=4.32, 95% CI=1.19 to 15.65), as was having a higher HoNOSCA score (OR=1.06, 95% CI=1.02 to 1.10) and higher IBDCS score (OR=1.05, 95% CI=1.01 to 1.09). In contrast, living in Italy (OR=0.15, 95% CI=0.06 to 0.35), the Netherlands (OR=0.32, 95% CI=0.16 to 0.64) or the UK (OR=0.48, 95% CI=0.25 to 0.91) was significantly associated with reduced odds of transitioning to AMHS compared with Belgium (the reference country in the model).
As the variance inflation factor for each predictor variable included in the model was below 10, we concluded that the model does not contain any collinearity errors. The model was also found to not have any specification errors. The model was deemed to be an adequate fit to the data as results from the Pearson’s χ2 and Hosmer-Lemeshow goodness-of-fit tests were not significant (Prob>χ2=0.3024 and Prob>χ2=0.7150, respectively).
Costs
The percentage of missing data increased over the course of the study. At T4, 19.8% of HoNOSCA data were missing (an increase from 2.1% at T1), as well as 28.3% of ASEBA data (an increase from 6.6%); therefore, multiple imputation was used as a sensitivity analysis. Transition outcome and baseline HoNOSCA score were not significantly associated with missing data.
Those who transitioned were more likely than those who fell through the gap to be receiving inpatient care at all time points (see table 3). Inpatient contact also decreased significantly for those who transitioned after T1, which indicates that around half of those who were receiving inpatient care when they were at CAMHS were transitioned to adult outpatient care after leaving children’s inpatient services.
Levels of contact with any type of community services were high for both groups over the study period, and did not reduce over time, except for a decrease for those who fell through the gap between baseline and T2 (when the majority would have been discharged from CAMHS).
At the first two time points, those who transitioned had significantly more overnight Accident and Emergency (A&E) admissions than those who fell through the gap. YP who transitioned to AMHS had on average more outpatient A&E visits than those who fell through the gap at all time points, with this difference reaching statistical significance at time points one, two and four (see table 3).
Significantly more of those in the transition group reported taking time off work or study due to their health at the first three time points. There were no significant differences between the number of general practitioner (GP) visits or contacts with the criminal justice system for those who transitioned and those who fell through the gap.
Costs over time
Costs over time are presented in figure 1. Except for mean GP costs for those who transitioned, all costs decreased over the course of the study. Costs were generally higher for those who transitioned compared with those who fell through the gap.
Predictors of cost
Total inpatient cost
Predictors of higher total inpatient costs were transitioning to AMHS (p<0.01) and previously attempting suicide (p<0.01). Predictors of lower total inpatient costs were having a higher baseline EQ5D utility score (indicating a higher quality of life) (p=0.01), having a lower age at the transition boundary (p=0.01), not being white European (p=0.03), having a diagnosis of an emotional disorder (p=0.01) and being at CAMHS for a longer length of time before transitioning (p<0.01).
Total hospital outpatient cost
Predictors of higher outpatient costs were total baseline HoNOSCA score (p<0.01), transitioning to AMHS (p=0.03), not being white European (p<0.01), and having a diagnosis of a personality or trauma disorder (p<0.01), or an eating disorder (p=0.01). The predictors of lower outpatient costs were baseline EQ5D utility score (p<0.01) and having an ‘other’ diagnosis (p=0.04).
Total community cost
Predictors of higher community costs were transitioning to AMHS (p<0.01) and previously attempting suicide (p<0.01). Predictors of lower total community costs were baseline EQ5D utility score (p<0.01), being male (p=0.01) and having an ‘other’ diagnosis (p<0.01).
Total healthcare costs
Predictors of higher total costs were transitioning to AMHS (p<0.01) and previously attempting suicide (p<0.01). Predictors of lower total costs were baseline EQ5D utility score (p<0.01), having an emotional disorder (p=0.01) or ‘other’ diagnosis (p=0.01), and having a longer length of time at CAMHS (p<0.01) (see full findings in table 4 below).
Discussion
YP with a diagnosis of depression or anxiety disorder, neurodevelopmental disorders or emerging personality disorder are more likely to transition to AMHS if they are among the most severely ill of patients. This concurs with other studies exploring predictors of transition (eg, 3 12). This is in accordance with the findings of the full sample of this cohort study,7 suggesting a severe illness is a main predictor of transition, regardless of diagnosis.
One novel finding of this research is the country variation in those who transitioned or fell through the gap. This research found that living in Italy, the Netherlands and the UK was associated with a lower likelihood of transitioning to AMHS. One possible explanation for this country variation is the high heterogeneity between the characteristics of CAMHS in different European countries24 or the variations in type of CAMHS involved in MILESTONE (eg, inpatient vs community services, or CAMHS specialising in different disorders), as well as potential differences in AMHS eligibility.
Overall, mean total inpatient, outpatient and community costs decreased over the 24 months the YP were involved in MILESTONE. This may be due to several factors. There was a general decrease in costs for all YP after T1, which was the time when most would have reached their CAMHS upper age limit. This suggests that the intensity of support received by all YP decreased after leaving CAMHS, even if they transitioned. This finding is supported by other studies, for example, a recent systematic review of experiences of YP with ADHD leaving CAMHS found that AMHS often only gave medication, with no psychological therapy,25 while other research has demonstrated a reduction in the frequency of appointments after transitioning.26 Some decrease in healthcare costs could also be due to disengagement from services, or YP’s mental health improving over time, as HoNOSCA scores decreased over the course of the study.
Predictors of higher healthcare costs across all settings were transitioning to AMHS and previously attempting suicide. A predictor of lower healthcare costs across all settings was a higher EQ5D utility score, indicating better quality of life. These findings concur with the results of the longitudinal regression, which found that those who transitioned were the most severely ill. As transitioning involves using healthcare services, it is logical that this should result in increased costs, compared with those who fell through the gap. Conversely, the finding that YP who fell through the gap were less likely to have higher healthcare costs indicates that they are less likely to access any kind of support after leaving CAMHS, despite still being unwell. Having an emotional disorder was also a predictor of lower costs, similar to previous studies which found YP with anxiety and depression can fail to meet the eligibility criteria for AMHS (eg, 3). As this study focused on YP with these diagnoses, those who transitioned were therefore likely to be more severely ill, which could explain why there were much higher costs for the transition group. It is important that the mental health needs of YP are met even if they do not meet the AMHS eligibility criteria, as research indicates that young adults who are unable to access mental healthcare can drop out of education or work due to a deterioration in their mental health.26 This population is then at risk of being socially excluded and economically disadvantaged in the long term,27 with poorer psychological outcomes.28 There is an additional economic case for investment in early intervention and prevention of mental illness in youth, given the high costs of mental illness across an individual’s life span, with associated costs to wider society.27
Strengths and limitations
To our knowledge, this is the first study to compare healthcare costs between those who transitioned and those who fell through the gap between CAMHS and AMHS. The analysis was conducted on a large international sample, so it provides a picture of resource use during the transition period across seven European countries.
While this study contained a large sample compared with previous studies, there are likely to be some limitations in terms of representativeness of the sample. First, as clinicians had to screen eligible participants for suitability to take part, the sample may not include the most severely ill. Those more severely ill were also more likely to drop out of the study, which may have led to this group becoming further under-represented. Participants without a diagnosis were excluded, which could lead to bias, as those without a psychiatric diagnosis are more likely to fall through the gap.29 There may also have been some bias introduced by different recruitment practices in each country, as MILESTONE was not originally designed to test for cross-country comparisons in transition. The use of the HoNOSCA cut-off score to determine clinical needs has been used in other research studies, but is yet to be validated. Finally, this sample lacked diversity in YP from minoritised ethnic backgrounds.
Missing data meant that complete case analysis was used to analyse predictors of transitioning. There was a relatively high percentage of missing data in the multilevel models, which was accounted for using multiple imputation even though data may not have been missing at random. Additionally, we used a one-country pooled costing approach due to a lack of high-quality unit costs in all participating countries, whereas an optimal approach would be to use a split country costing approach including all participating countries. We also did not discount costs at the later data collection time points as data were collected over a relatively short time period; therefore, we decided this would have had minimal impact on our results.
Clinical implications
As only the most severely ill YP transition to AMHS, it is important that there are alternative healthcare or voluntary sector services available for those who do not meet the AMHS threshold but still require ongoing mental health support. This could be through collaborative care models based in primary care, or other community-based mental health services. Similarly, as costs decreased over time for both groups of YP, this indicates a reduction in mental health support when they crossed the CAMHS transition boundary, regardless whether they transitioned. This raises ethical issues in the current model of care regarding the right to access timely mental healthcare for YP. It is imperative that the mental health needs of YP are met after leaving CAMHS, something which may require an increase in funding to meet the demand for care. This is particularly important if we consider that the critical age of the onset of mental disorder is the period between 15 and 25 years of age30: most efforts of mental health services should be targeted to this age group.
Data availability statement
The datasets generated and analysed during the study are not publicly available, however MILESTONE data may be made available on request by contacting the corresponding author of the main MILESTONE study publication (https://doi.org/10.1017/S0033291721003901).
Ethics statements
Patient consent for publication
Ethics approval
This study involves human participants and is a secondary analysis of an existing study dataset. Ethical approval was received for the MILESTONE Study from West Midlands-South Birmingham Research Ethics Committee (ref. 15/WM/0052). Participants gave informed consent to participate in the study before taking part.
Acknowledgments
The authors would like to thank the participants who gave up their time to take part in this research.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Contributors RA conducted the analysis, with support from AC. SS, HT and AC were supervisors to RA. SPS was the chief investigator of the MILESTONE Project who conceived the project and obtained funding, together with AM, GD, GdG, JM, FM, TF, DP-O, ST and UMES. HT was the MILESTONE Study coordinator. RA prepared the first draft and subsequent versions of this manuscript. All authors critically reviewed the manuscript and gave approval for the publication. RA is the guarantor.
Funding RA was supported by the Warwick Medical School PhD Scholarship. The MILESTONE Project was funded by European Union’s Seventh Framework Programme for research, technological development and demonstration. SPS was supported by the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care West Midlands (NIHR CLAHRC WM), now recommissioned as NIHR Applied Research Collaboration West Midlands.
Disclaimer The views expressed in this publication are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.