Article Text
PDF
Abstract
Objectives Postnatal maternal mental health problems, including depression and anxiety, entail a significant burden globally, and finding cost-effective preventive solutions is a public policy priority. This paper presents a cost-effectiveness analysis of the intervention, What Were We Thinking (WWWT), for the prevention of postnatal maternal mental health problems.
Design The economic evaluation, including cost-effectiveness and cost-utility analyses, was conducted alongside a cluster-randomised trial.
Setting 48 Maternal and Child Health Centres in Victoria, Australia.
Participants Participants were English-speaking first-time mothers attending participating Maternal and Child Health Centres. Full data were collected for 175 participants in the control arm and 184 in the intervention arm.
Intervention WWWT is a psychoeducational intervention targeted at the partner relationship, management of infant behaviour and parental fatigue.
Outcome measures The evaluation considered public sector plus participant out-of-pocket costs, while outcomes were expressed in the 30-day prevalence of depression, anxiety and adjustment disorders, and quality-adjusted life years (QALYs). Incremental costs and outcomes were estimated using regression analyses to account for relevant sociodemographic, prognostic and clinical characteristics.
Results The intervention was estimated to cost $A118.16 per participant. The analysis showed no statistically significant difference between the intervention and control groups in costs or outcomes. The incremental cost-effectiveness ratios were $A36 451 per QALY gained and $A152 per percentage-point reduction in 30-day prevalence of depression, anxiety and adjustment disorders. The estimate lies under the unofficial cost-effectiveness threshold of $A55 000 per QALY; however, there was considerable uncertainty surrounding the results, with a 55% probability that WWWT would be considered cost-effective at that threshold.
Conclusions The results suggest that, although WWWT shows promise as a preventive intervention for postnatal maternal mental health problems, further research is required to reduce the uncertainty over its cost-effectiveness as there were no statistically significant differences in costs or outcomes.
Trial registration number ACTRN12613000506796; results.
- Postnatal depression
- Prevention
- Economic evaluation
- Cost-effectiveness
- MENTAL HEALTH
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
The prospectively designed economic evaluation was conducted alongside a cluster-randomised controlled trial of the intervention's clinical effectiveness.
The sample size, based on the clinical effect rather than cost-effectiveness analysis, and the cluster-randomised nature of the trial may have limited the ability to detect statistically significant differences between the control and intervention groups.
Data collected in the trial included use of health, social and early childhood services and participant out-of-pocket costs, allowing the results to be examined from a range of perspectives.
Results presented include probabilistic sensitivity analysis and scenario analyses to allow the reader to assess the impact of key uncertainties.
Background
Prevention of postnatal mental health problems is a challenge for healthcare systems internationally. Depression, anxiety and adjustment disorders are common among women who have recently given birth1 ,2 which is a population subgroup of substantial size. These disorders have a significant impact on the well-being of women at a pivotal time in the life of the mother, baby and wider family.3 ,4 There is an associated burden on the public sector; for example, women with postnatal depression (PND) have higher use of health and other services than their non-depressed counterparts, not limited to greater use of mental health services.5–7
Research on the cost-effectiveness of interventions to prevent the development of postnatal distress, depression and anxiety has shown mixed results. A programme of structured midwife-led care was found to improve postnatal mental health without increasing costs;8 counselling and support for women at high risk of PND9 and peer support10 were found to reduce symptoms or duration of depression but at a higher cost; and postnatal support worker home visits11 were found to increase costs with no associated improvement in mental health. Preventive approaches that address the woman's relationship with her spouse or partner have shown some promise in terms of clinical effectiveness;12 however, there has been little research into the cost-effectiveness of such interventions.
What Were We Thinking (WWWT) is a psychoeducational intervention that targets the parental partner relationship, management of infant behaviour and parental fatigue. A community-based before and after controlled study found that WWWT reduced postnatal mental health problems among women with no history of psychiatric disorders.13 The Sleep, Parenting and Relationships in a Community Setting (SPARCS) trial was subsequently conducted to examine the clinical and cost-effectiveness of WWWT for the prevention of depression, anxiety and adjustment disorders in women at 6 months postpartum.14 The intervention was delivered soon after birth to first-time parents (FTPs) in the setting of Maternal and Child Health Centres (MCHCs) in Victoria, Australia. MCHCs are a publicly funded universal service for families of children up to school age, with the goal to ‘promote healthy outcomes for children and their families’ (ref. 15, p. 6). High participation rates are a stated policy objective in pursuance of this goal; more than 90% of families with recent births in Victoria attend MCHCs.16 One element of the Maternal and Child Health (MCH) service is FTP group sessions, which focus on parent–child interactions, parenting confidence, emotional well-being and support for FTPs.17
Public sector decision-makers have made a commitment to using evidence to inform modifications to the MCH service model.18 A complexity of developing appropriate evidence is that in Victoria, early childhood service costs (including MCHCs) fall under the Department of Education and Training (formerly the Department of Education and Early Childhood Development). This means that funding of MCHCs is shared between the Department of Education and Training and Local Governments, rather than sitting within health, despite the clear health focus of the MCH service.
Economic evaluation provides decision-makers with evidence on how best to allocate limited resources by comparing the alternatives in terms of costs and outcomes. In cost-effectiveness analyses (CEA), outcomes are expressed in natural or clinical units, such as symptom improvement or life years saved. In cost-utility analyses (CUA), outcomes are expressed in terms of quality-adjusted life years (QALYs), which take into account differences in life span and health-related quality of life (HRQoL). QALYs are generally preferred in health economic evaluations as they facilitate allocative decisions between interventions with different outcomes,19 ,20 and there are data to guide what might be considered cost-effective in terms of QALYs. However, studies in prevention of postnatal mental health problems often use condition-specific clinical end points, such as cost per month of PND averted.9 It is not clear what societies would be willing to pay for prevention in terms of these clinical end points. One US study found individuals were willing to pay ∼9% of their monthly household income for treatment of depression,21 and a German study found that people were willing to pay personally for prevention of depression;22 however, neither informs us of societal-level willingness-to-pay (WTP) for prevention of depression. Although not an official threshold, US$50 000 per QALY (approximately $A55 000 in 2014) is often used as a guide, which could vary with factors such as budget constraints or special consideration of certain populations or diseases.23 Other thresholds have been proposed, and vary considerably;24 one study found that Australian WTP for one QALY gain was approximately $A75 000,25 while in the UK, a threshold of £20 000–30 000 (approximately $A41 000–61 000) per QALY gained is used,26 although Claxton et al27 suggest it should be lower, approximately $A31 000 (figures adjusted to 2014 terms).
This paper describes the results of an economic evaluation of WWWT conducted alongside the SPARCS trial. The protocols for the clinical study14 and economic evaluation28 have been published previously, as have the trial results.29 This paper presents the results of a CEA and a CUA, and discusses the implications of these results for decision-makers seeking cost-effective interventions for the prevention of postnatal mental health problems.
Methods
The economic evaluation took a public sector perspective (incorporating healthcare, early childhood and social service costs), plus the participant's out-of-pocket (OOP) costs. The time horizon of 6 months mirrored the trial follow-up period. No discounting was necessary due to the duration of the follow-up period. Ethical approval was provided by the Southern Health (now Monash Health) Human Research Ethics Committee (11388B) and the Education and Policy Research Committee, Victorian Government Department of Education and Early Childhood Development (now Department of Education and Training) (2012 001472), and the study was registered with the Monash University Human Research Ethics Committee (CF12/1022-20122000474). Data were collected from participants via computer-assisted telephone interview at baseline (6 weeks postpartum) and follow-up (26 weeks postpartum).
Sample and setting
The trial was conducted in Victoria, Australia, with MCHCs as the unit of cluster randomisation. To check for similarity between participants within clusters, which could adversely affect the trial's ability to detect a difference between trial arms, the intracluster correlation coefficient (ICC)30 is reported for cost and outcome variables. Participants were English-speaking first-time mothers who had recently given birth and attended participating MCHCs. Baseline participant characteristics were compared between trial arms using two-sample t-tests and Pearson's χ2 tests.
Intervention
The training programme for nurses at intervention MCHCs comprised online and face-to-face components, with nurses who worked at more than one centre excluded to avoid cross-contamination between the intervention and control groups. Participants at intervention centres received WWWT-informed care during MCH visits, and both parents were invited to attend an extra 6-hour FTP group session on a Saturday, during which the WWWT intervention was delivered, and received printed materials to take home. Participants at control MCHCs were provided usual MCH care, and were offered no extra FTP group sessions.
Resource use and cost
Participants were sent a card at baseline on which to record the use of health and other services during the follow-up period for themselves or their baby (specifying the service type and cost including OOP cost), and these data were collected at follow-up. This card and the service use questions asked at follow-up were developed specifically for the trial. Resource unit costs were identified from the Medicare Benefits Schedule (MBS),31 National Efficient Price (NEP) determination weights for hospital episodes,32 the standard hourly rate of MCH service provision,18 participants’ OOP costs and market rates (for further detail, see online supplementary material). All unit costs were in 2013–2014 Australian dollars ($A).
Supplemental material
The estimated cost of the intervention per participant was based on the costs of developing the intervention, training MCH nurses in the intervention and delivery of the WWWT session as an additional FTP group session. It was assumed that WWWT-informed MCHC care would entail the same cost per visit as standard care, with any difference in the number of visits or phone calls captured in participants’ service use history. The cost of delivering the intervention to participants was based on the hourly rate of MCH services. In the base case, it was assumed that MCH nurses would need retraining after 3 years, and that six families would attend each FTP group session on average.
Outcomes
For CEA, the outcome was 30-day prevalence of depression, anxiety and adjustment disorders according to the criteria of the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition (DSM-IV).33 For CUA, the outcome was QALYs, with HRQoL measured using the three-level version of the EQ-5D (EQ-5D-3L), and calculated using Australian weights derived using the time trade off approach.34 QALYs were calculated as a linear change in HRQoL over time between baseline and follow-up.
The EQ-5D is a multiattribute utility instrument35 that assesses HRQoL over five domains of health: mobility, self-care, usual activities, pain/discomfort and anxiety/depression. A score of one reflects full health, and zero, death. It is the most frequently used HRQoL measure when estimating QALYs,36 and has been used in the postnatal context.37–40 Petrou et al41 found, among women at 6 months postpartum, an average EQ-5D score of 0.861 (95% CI 0.844 to 0.877), and a statistically significant correlation with PND risk.
Analysis
Costs and outcomes were adjusted using regression modelling to account for relevant sociodemographic, prognostic and clinical characteristics, including those differing between groups, with the effect of the intervention captured by the inclusion of the trial arm as a variable. All regression models included baseline measures of the participant's psychological well-being and psychiatric history and a measure of the baby's crying behaviour, to account for differences in baseline risks for postnatal mental health problems, plus the baby's age at baseline to account for timing of data points. In addition, the cost model included factors that might influence utilisation of health and other services: level of education, health care card status (a health care card provides access to concessions on pharmaceuticals and medical services for low-income earners and those receiving government benefits) and relative socioeconomic disadvantage of the participant's area of residence.42 The outcome models included baseline EQ-5D-3L score to account for baseline HRQoL, plus other factors which might influence quality of life: perceived quality of the intimate partner relationship and level of support, and a measure of adverse life events (for further details regarding measures used in the study, see ref. 29). Analyses were performed in STATA V.13 using a generalised linear regression model (GLM) for cost, to allow for the non-normal distribution of costs without requiring transformation of the cost variable,43 a linear regression model for QALYs and a logit model for the binary clinical outcome (presence or absence of depression, anxiety and adjustment disorders). The specifications of the GLM model for costs were informed by a modified Parks test, resulting in a log link and gamma family,43 while the distribution of QALYs fitted with the assumption of normality in the linear regression model. Since these regression models included different explanatory variables than those included in the clinical evaluation,29 the results may differ slightly. Cluster-robust SEs were used to account for randomisation at the level of the MCHC, rather than the individual.
The main analysis was conducted on participants for whom complete data were collected, and repeated with imputation of missing data. Characteristics of those with missing data were compared with the complete cases using two-sample t-tests and Pearson's χ2 tests. Missing values for cost, outcomes and two characteristics (adverse life events and levels of support) used in regression analyses were imputed using the ‘mi impute chained’ command in STATA with V.30 imputations. Predictive mean matching was used for continuous variables, with logistic regression for binary and ordered logistic regression for ordinal variables, using an imputation model that included characteristics associated with missingness of data as well as the variables in the analytic model.
The incremental cost-effectiveness ratio (ICER) compares the control and intervention groups by dividing the difference in cost by the difference in outcome (each calculated using average marginal effects from the relevant regression model). Uncertainty surrounding the ICER was estimated using non-parametric bootstrapping44 (resampling with replacement from the original data to produce replicates of the sample), resampling clusters rather than individuals. The distribution of the resulting 2000 estimates of the ICER on the cost-effectiveness plane45 depicts the joint uncertainty surrounding costs and outcomes. Estimates in the lower right quadrant of a cost-effectiveness plane suggest that the intervention is more effective and less costly, while estimates in the upper right quadrant suggest it is more effective but costlier. Estimates in this quadrant require further analysis to determine if the decision-maker would be willing to allocate the extra expenditure for the extra benefit. The cost-effectiveness acceptability curve46 is used for that purpose, to display the probability that the intervention is cost-effective at a given societal WTP threshold (ie, the proportion of the bootstrapped estimates that fall below the threshold) over a range of thresholds.
Scenario analyses
Cost per QALY was re-estimated under alternative scenarios to explore the results’ sensitivity to particular assumptions or parameters. (1) Using only variables collected at baseline to adjust cost and outcomes; that is, excluding support and adverse life event variables from the regression models, which were collected at follow-up. (2) Assuming that MCH nurses would require retraining in the intervention after 1 year (instead of 3 years as in the base case). (3) Assuming that the average number of families per session would be 5 or 7 (rather than 6 as in the base case). (4) Limiting the cost analysis to the health sector, the early childhood sector or combined public sector without participant OOP costs. (5) To test the sensitivity of the results to variation in costs and outcomes, for a worst-case scenario, incremental costs were assumed to be at the upper end of the 95% CI and incremental outcomes at the lower end for each individual, while for a best-case scenario, the reverse assumptions were applied. (6) To test the sensitivity of the results to the specifications of the models, linear regression was used for all three models.
EQ-5D-3L scores across clinical states
We also explored the usefulness of the EQ-5D-3L for discriminating between clinical states in postnatal mental health, using the Mann-Whitney U test to investigate whether EQ-5D-3L scores differed significantly between participants with and without major depressive disorder, and those with and without symptoms of anxiety or depression. The Mann-Whitney U test47 was used because the EQ-5D-3L scores were (as expected) non-normally distributed, with a skew to the upper limit of 1, and so would not meet the assumptions for a two-sample t-test.
Results
Baseline
Cluster randomisation resulted in the allocation of 196 participants across 24 MCHCs to the control arm and 204 participants across 24 MCHCs to the intervention arm (although one MCHC in the control arm did not recruit any participants). Overall, 21 participants (10.7%) from the control arm and 20 (9.8%) from the intervention arm did not complete the full follow-up interview, leaving 175 in the control arm and 184 in the intervention arm for complete case analysis. Baseline interviews took place between May 2013 and April 2014, and follow-up interviews between September 2013 and August 2014.
Participants’ baseline characteristics, outlined in table 1, were similar between groups except that the intervention group had higher depression (p=0.045) and anxiety (p=0.004) scores and more participants with a history of eating or dieting disorders (p=0.039), while the control group reported a higher number of hours that the baby cried or fussed per day (p=0.048). These variables were included in the regression models for costs and outcomes, along with other relevant characteristics.
Baseline participant characteristics
The pattern of missing data was monotone, since close to 100% of data were non-missing at the initial interview, and most data missing at follow-up involved the entire interview. Data were not missing completely at random, as those with missing data were more likely to be born overseas, speak a language other than English, hold a health care card had lower levels of education and gave lower self-reported health ratings, but were no different in psychiatric history. These characteristics were included in the model for multiple imputation of missing data in scenario analysis.
The mean baseline EQ-5D-3L utility score was 0.859, with no statistically significant difference between the groups. However, in answering the anxiety/depression EQ-5D-3L domain question, more of the intervention group (20%) reported moderate anxiety or depression than the control group (13%) (p=0.054).
Outcomes
At follow-up, the unadjusted 30-day prevalence of DSM-IV diagnoses of depression, anxiety and adjustment disorders was 8.57% in the control group, and 8.70% in the intervention group (p=0.967, ICC <0.001).
EQ-5D-3L scores at follow-up were also similar between the control (0.890) and intervention groups (0.889) (p=0.980), with 23% of the control group and 20% of the intervention group reporting moderate anxiety/depression, and 2% of the intervention group reporting extreme anxiety/depression (none in the control group) (p=0.107).
Individual QALYs were calculated by dividing the mean of the two EQ-5D-3L scores for each person by their duration of follow-up, which varied from 78 to 288 days depending on the baby's age at recruitment (1.1–15.6 weeks) but was similar between groups (p=0.779). The mean QALY accumulated for the control group was 0.371 and for the intervention group was 0.372 (p=0.883, ICC 0.034).
After regression modelling to account for relevant sociodemographic, prognostic and clinical characteristics, the differences between groups were still not statistically significant; using complete case analysis, the intervention group had a 1.77 percentage-point lower prevalence of depression, anxiety and adjustment disorders (p=0.497) and 0.007 higher QALYs accrued (p=0.417) than the control group. From the analysis using multiple imputation of missing data, the intervention group had 0.33 percentage-point lower prevalence (p=0.643) and 0.006 higher QALYs (p=0.544).
Costs
The estimated intervention cost per participant was $A118.16 in the base case. This included MCH nurse time to deliver the intervention (based on an average of 6 families attending each WWWT 6-hour session) and to complete the 3-hour self-directed training and the day and a half of face-to-face training in the intervention. It also included development costs to account for previous research conducted in developing WWWT. Average per-participant intervention costs were calculated as if the intervention were to be delivered state-wide, rather than using the numbers in attendance during the trial, as the intervention was delivered as routine at intervention MCH centres. The intervention MCH centres delivered WWWT-informed care to all women at the centres, as it was randomised at the centre level, and more women attended WWWT sessions than the number who enrolled in the trial, so the approach had to vary from the usual per-participant trial cost estimation. For the trial, 33 MCH nurses were trained in the WWWT approach, and a total of 44 seminars were delivered by these nurses to an average of 4 families per session. Almost half (46%) of women in the intervention arm of the trial attended a seminar (further details of the implementation of the intervention in the trial are available in Fisher et al.29)
Table 2 outlines the service use accrued during the period of follow-up. There were no statistically significant differences in service use between the intervention and control groups.
Service use during the follow-up period
As shown in table 3, costs of health and other services were $A158.37 higher per participant (p=0.580, ICC 0.002) in the intervention than control group, mostly arising from statistically insignificant higher health service costs in the intervention group. Inclusive of intervention costs, the difference was $A276.53, and although this difference was not statistically significant, the intervention cost component was an addition to usual care costs.
Unadjusted costs by sector ($A, 2014)
After adjustment using regression modelling and inclusive of costs relating to the intervention, with complete case analysis, the intervention group had $A268.69 additional costs (p=0.335) per participant; with imputation of missing data, the estimated additional cost was $A249.75 (p=0.311).
Cost-effectiveness
While neither costs nor outcomes demonstrated statistically significant differences between groups, a point estimate of the ICER can still be calculated based on the trial results, and can be informative as the best available estimate of cost-effectiveness,48 albeit with a high degree of uncertainty surrounding the result. Using complete case analysis, the estimated cost per percentage-point reduction in 30-day prevalence of depression, anxiety and adjustment disorders was $A152 (95% CI −16 453 to 16 756). The estimated cost per QALY was $A36 451 (95% CI −1554 006 to 1 626 908). As shown in figure 1, the bootstrapped estimates of incremental costs and QALYs were in all four quadrants, reflecting the uncertainty both costs and effectiveness. The majority (69%) fell in the northeast quadrant, suggesting that the intervention might be costlier and more effective. The bootstrapped estimates for the clinical effectiveness outcome showed a similar pattern (available as online supplementary figure S1).
Cost-effectiveness plane—cost per quality-adjusted life year.
At a threshold of $A55 000 per QALY, there is a 55% probability that the intervention is cost-effective. (Cost-effectiveness acceptability curve is available as online supplementary figure S2.) At a threshold of $A100 000 per QALY, the probability only rises by a small increment (to 67%) due to the uncertainty surrounding the effectiveness of the intervention.
Using the analysis that imputed missing values (intention-to-treat analysis), the estimated cost per percentage-point reduction in 30-day prevalence of depression, anxiety and adjustment disorders was $A747 and the estimated cost per QALY was $A44 830. These higher ICERs were driven by smaller differences in outcomes in the imputed data set. Using this approach, at the $55 000 per QALY threshold, there was a 53% probability that the intervention is cost-effective.
Scenario analyses
The estimated ICERs under each scenario shown in table 4 demonstrate the potential impact of different methodological approaches or perspectives. Since most of the difference in non-intervention costs arose from the use of health rather than other services, limiting the perspective to the health sector gave a higher ICER than the base case. Limiting it to costs attributable to the early childhood sector (which is responsible for funding MCH services in Victoria) shows a much more favourable ICER. Participant OOP costs contributed to the cost difference, so that a public sector perspective (which excludes these) gave a lower ICER. The use of a GLM model for costs and logit model for the clinical outcome, chosen because of their superior theoretical basis, produced a higher ICER than when linear regression models were used.
Scenario analyses: cost-effectiveness ($A, 2014)
EQ-5D-3L scores across clinical states
There was a gradient of EQ-5D-3L scores over increasing severity of depression and anxiety symptoms, as shown in figure 2. The mean EQ-5D-3L scores were found to differ significantly between those with (0.682) and without (0.878) major depressive disorder (p<0.001), and those with (0.806) and without (0.917) symptoms of depression or anxiety (p<0.001).
The mean EQ-5D-3L scores by severity of PHQ depression and anxiety scores. *PHQ, Patient Health Questionnaire.
Discussion
This study found that WWWT may be associated with higher costs and a small improvement in HRQoL and reduced prevalence of PND, anxiety and adjustment disorders when compared with usual MCH care, although these differences were not statistically significant. We focus on the findings regarding cost per QALY gained, since there is no generally accepted level of WTP for one unit of improvement in the clinical outcome, and there is more acceptance of cost per QALY evidence by decision-makers.
The point estimate of the ICER, $A36 451 per QALY gained, was lower than the unofficial threshold of $A55 000,23 as were all but one of the higher ICERs estimated under differing assumptions in the scenario analyses outlined in table 4. There was considerable uncertainty surrounding this result, with only a 55% probability that the intervention was cost-effective at a threshold of $A55 000 per QALY. The large differences in ICER dependent on which public sector costs were included are of particular importance since MCH services in Victoria are funded with early childhood services, while the intervention might be considered to fit better within a health sector perspective.
Other CEA of preventive interventions in postnatal mental health have evaluated targeted rather than universal preventive interventions and/or have used differing clinical end points as the measure of effectiveness, leading to difficulties in comparing results. For example, the PoNDER trial,49 which used QALYs as an outcome measure but targeted women at risk of PND, found no statistically significant difference in costs or QALYs and a probability of cost-effectiveness of around 80% at a threshold of £20 000–30 000 per QALY gained. A Canadian study,10 which investigated a programme of peer support for high-risk women in terms of cost per case of PND averted (rather than cost per QALY), found the point estimate of the ICER to be $CAD10 009 per case averted. In a UK study9 focusing on counselling and support for women at risk of PND, no statistically significant differences were found in costs and outcomes, with a probability of cost-effectiveness of 71% at a threshold of £1000 per month of PND averted.
While this study did not demonstrate savings in unadjusted health service utilisation associated with the intervention, the intervention group had statistically significantly worse baseline depression and anxiety scores but not (as might have been expected) statistically significantly higher health service costs. This finding in relation to the use of residential early parenting centres may be of particular interest to the early childhood sector, since these are high-cost services and have similar risk factors to those addressed by the intervention.50
The data were not missing completely at random, suggesting that intention-to-treat analysis with imputation of missing values may be appropriate. However, it is not possible to tell from the observed data whether the pattern of missingness also depends on the outcome variable, and under some patterns of missingness (involving correlation with covariates), complete case analysis may be unbiased. Therefore, complete case and intention-to-treat analyses are presented.51
The correlation we found between EQ-5D-3L score and postnatal mental health supports previous findings that the EQ-5D-3L is able to discriminate between clinically significant mental health states.52 ,53 We found statistically significant differences in EQ-5D-3L scores based not only on diagnosis of major depressive disorder, but also based on symptoms of depression or anxiety (a lower clinical threshold).
Limitations and possibilities for further research
Sample size calculations were based on the clinical effect rather than cost-effectiveness analysis,54 ,55 which may have contributed to uncertainty surrounding the results. The cluster-randomised nature of the trial and small but non-negligible ICC for QALYs may also have reduced the ability to detect an effect of the intervention on QALYs in this trial.30
No extrapolation beyond the 6-month time horizon of the trial was conducted, since there were no statistically significant differences in this period. However, significant differences between the intervention and control groups may have emerged with a longer follow-up period.
This evaluation focused on costs of public sector services and OOP costs for mothers and infants. Since postnatal mental health problems in couples tend to co-occur,56 and since the intervention explicitly included participants’ partners and addressed the partner relationship, future research into WWWT could include partners’ costs and outcomes, including partners’ productivity. In the postnatal context, mothers’ workforce participation may be low even in the absence of mental health problems,57 which may limit the relevance of productivity in terms of mothers’ employment.
The cost analysis depended on participants’ recall of service use. To minimise recall error, participants were asked to record services used during the follow-up period and were prompted by interviewers to refer to this record and to report use of a wide range of services.
In this study, WWWT was evaluated as additional to standard FTP group sessions. However, there is a range of standard sessions available, from which MCHCs choose. If WWWT were incorporated into this range, the cost would be absorbed into usual FTP group costs but other content would be displaced. Future research could estimate the cost-effectiveness of WWWT in head-to-head comparison with other FTP group sessions rather than as an additional session.
Research into the cost-effectiveness of WWWT using alternative delivery mechanisms (such as online), and WTP (societal and/or decision-makers’) for prevention of postnatal mental health problems could also be valuable to decision-makers.
Conclusions
This economic evaluation conducted alongside a cluster-randomised trial found no statistically significant difference in either costs or effectiveness, with a point estimate of cost-effectiveness that suggests WWWT might be a cost-effective intervention for the prevention of postnatal mental health problems in first-time mothers. Given the dearth of cost-effective preventive interventions in this field and the clinical, social and economic incentives to prevent postnatal mental health problems, further research is warranted to reduce the uncertainty surrounding the results.
References
Footnotes
Contributors JR, PL, TT, KW, HR and JF contributed to the design of the economic evaluation, interpretation of results and approval of the final paper; JR and PL undertook the data analyses and prepared the manuscript; JF and HR developed the WWWT intervention.
Funding This study was funded by competitively awarded grants from the National Health and Medical Research Council (APP1026550), the Australian Government Department of Social Services (formerly Families, Housing, Community Services and Indigenous Affairs) and the Victorian Department of Education and Early Childhood Development.
Competing interests None declared.
Ethics approval Southern Health (now Monash Health) Human Research Ethics Committee, also the Education and Policy Research Committee, Victorian Government Department of Education and Early Childhood Development (now Department of Education and Training) and the study was registered with the Monash University Human Research Ethics Committee.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.