Article Text
Abstract
Objectives To determine whether introduction or withdrawal of a maternal financial incentive was associated with changes in timing of first attendance for antenatal care (‘booking’), or incidence of small for gestational age.
Design A natural experimental evaluation using interrupted time series analysis.
Setting A hospital-based maternity unit in the north of England.
Participants 34 589 women (and their live-born babies) who delivered at the study hospital and completed the 25th week of pregnancy in the 75 months before (January 2003 to March 2009), 21 months during (April 2009 to December 2010) and 36 months after (January 2011 to December 2013) the incentive was available.
Intervention The Health in Pregnancy Grant was a financial incentive of £190 ($235; €211) payable to pregnant women in the UK from the 25th week of pregnancy, contingent on them receiving routine antenatal care.
Primary and secondary outcome measures The primary outcome was mean gestational age at booking. Secondary outcomes were proportion of women booking by 10, 18 and 25 weeks’ gestation; and proportion of babies that were small for gestational age.
Results By 21 months after introduction of the grant (ie, immediately prior to withdrawal), compared with what was predicted given prior trends, there was an reduction in mean gestational age at booking of 4.8 days (95% CI 2.3 to 8.2). The comparable figure for 24 months after withdrawal was an increase of 14.0 days (95% CI 2.8 to 16.8). No changes in incidence of small for gestational age babies were seen.
Conclusions The introduction of a universal financial incentive for timely attendance at antenatal care was associated with a reduction in mean gestational age at first attendance, but not the proportion of babies that were small for gestational age. Future research should explore the effects of incentives offered at different times in pregnancy and of differing values; and how stakeholders view such incentives.
- health policy
- public health
- obstetrics
- preventive medicine
- community child health
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
We used interrupted time series methods to evaluate this natural experiment; one of the strongest quasiexperimental research designs available.
By including substantial data before and after interventions, we took account of underlying secular trends.
However, interrupted time series designs are observational and we cannot categorically ascribe the changes documented to the intervention.
One of our secondary outcomes was proportion of babies born small for gestational age—a substantial improvement on previous studies that use a simple low birth weight cut-off.
Differences between women included and excluded from the analyses may limit external validity, as may our use of data from only one hospital.
Introduction
Financial incentives are increasingly used to encourage health-promoting behaviours. However, few large, pragmatic evaluations in high-income countries have been conducted.1 2
The Health in Pregnancy Grant (HiPG) was introduced in April 2009 as a one-off payment of £190 ($235; €211) payable to all pregnant women, normally resident in the UK, after the 25th week of pregnancy, but before delivery. Women submitted a claim form, signed by their doctor or midwife confirming their expected delivery date and that they had received usual antenatal care.3 A key aim of the HiPG was to act as an ‘incentive to seek the recommended health advice at the appropriate time’.3 Following a general election in 2010, the HiPG was withdrawn with women only able to claim if they reached the end of the 25th week of pregnancy before 1 January 2011.
England compares poorly with other European countries on perinatal outcomes.4 One possible reason is poor attendance at antenatal care, which is associated with increased risk of small for gestational age (SGA),5 6 and a range of adverse outcomes.7–9 National guidance recommends that the first antenatal (or ‘booking’) visit should ideally take place by 10 weeks’ gestation and, at the latest, by 18 weeks.10 Women living in more deprived circumstances tend to book later in pregnancy.11
Health-promoting financial incentives may be more effective in promoting one-off behaviours than complex behaviour change.12–15 Antenatal care is a series of one-off behaviours and may be particularly responsive to incentives. However, a recent systematic review found only five trials of maternal incentives for antenatal care—three conducted in the USA and one each in Mexico and Honduras.16 No effect on timing of antenatal care was found (although only one study investigated this).17 No studies included birth weight or SGA as outcomes. A further observational study from the USA found no effect of an incentive on incidence of low birth weight.18 One recent evaluation of the HiPG in Scotland reported no effect on birth weight, but a positive effect on the proportion of women booking by 25 weeks (other aspects of timing of attendance were not studied).19
UK public health policymakers and members of the public think that it may be appropriate to target financial incentives at people living in more deprived circumstances—perhaps because those living in more deprived circumstances are more in need of financial support.20 21 There is some systematic review evidence that people living in more deprived circumstances may be more responsive to fiscal interventions in general. Other personal characteristics, such as age and previous experience of the behaviour incentivised, may also influence responsiveness. However, differential responses to health-promoting financial incentives between population groups have not been systematically studied.1
The introduction and withdrawal of the HiPG provided a unique opportunity for a large-scale, pragmatic, natural experimental evaluation of a health-promoting financial incentive.22 Our research questions were: was the introduction or withdrawal of the HiPG associated with a change in the timing of booking, or incidence of SGA? Did any effect of the HiPG vary according to maternal age, parity or socio-economic position?
Methods
We used an interrupted time series (ITS) design.
Data and inclusion criteria
We used routine data from a maternity unit in a tertiary hospital in northern England, extracted in May 2015. The study hospital is a general teaching hospital with over 1000 beds in a town with a population of ~175 000 people. Both the town and the surrounding areas are more deprived than the English average.
Participants were women (and their live-born babies) who delivered at the study hospital and were known to have completed the 25th week of pregnancy in the 75 months before (January 2003 to March 2009) introduction of the HiPG, 21 months during (April 2009 to December 2010) availability of the HiPG and 36 months after (January 2011 to December 2013) withdrawal of the HiPG. The time periods included were pragmatically arrived at based on when data were available from, and when the HiPG was introduced and withdrawn. Our final data set of 132 monthly data points (and a mean of 262 cases per data point—see the Results section) substantially exceeds the minimum requirements for ITS (of at least eight data points per intervention phase and 100 individual observations per data point).23 Aggregating to the weekly, rather than monthly, level would not have achieved these requirements—with a mean of 60 cases in each of 572 weekly data points. As calculation of when women reached the 25th week of pregnancy depended on knowing the date of their last menstrual period (LMP), women for whom this date was missing were excluded.
Women who had a termination or experienced a stillbirth were excluded, as were women with missing data on any variable of interest. Women who delivered more than one live baby in any one pregnancy, or had more than one pregnancy that resulted in a live birth during the study period, were included with each baby counted as a separate ‘case’. As we did not have access to any identifiable data on women, we were not able to determine on how many occasions this occurred or to take it into account in modelling.
Outcome measures
Our outcome measures focus on the stated aim of the HiPG—to encourage women to ‘seek the recommended health advice at the appropriate time’.3 The primary outcome was mean gestational age at booking, calculated from dates of booking (recorded by antenatal care staff) and LMP (self-reported). As national guidance recommends booking ideally before 10 weeks, and definitely before 18 weeks, and the HiPG was available to women from the 25th week, the proportion of women booking by 10, 18 and 25 weeks’ gestation were secondary outcomes.10
As timely attendance for antenatal care is thought to improve perinatal outcomes, we included a final secondary outcome: proportion of babies that were SGA. It should be noted that there is likely to be a long and complicated chain of causation, if any, between receiving the HiPG and changes in gestational weight for age. We defined SGA as birth weight z-score below the 10th percentile for sex-specific gestational age.24 This was calculated using infant sex, birth weight and dates of LMP and delivery (all except LMP recorded by antenatal care and delivery staff).
Other variables of interest
We studied whether any effects of the HiPG on the outcomes varied according to maternal age at delivery (in years, calculated from maternal date of birth and date of delivery and divided into three groups: <25, 25–34, or 35+ years), parity (self-reported and considered as 0 or 1+ in analyses) and socioeconomic position. The main age group (ages 25–34 years) was coded using mid-decade to mid-decade as the convention recommended to increase comparability between studies. We did not further subdivide the other age groups as only eight women in the included sample were aged less than 15 years and only 27 were aged more than 44 years. Socioeconomic position was measured using the Index of Multiple Deprivation (IMD) 2007 rank assigned to maternal address at delivery.25 IMD is an area-based measure of deprivation and ranks were divided into thirds for analysis based on the distribution across England.
Data preparation
Data cleaning aimed to exclude data that were implausible. Date of LMP was recorded as month and year only in around 20% of cases. To include these cases, day of month was set to the 1st. Gestational age at first antenatal care of less than 28 days (4 weeks) or more than 308 days (44 weeks), gestational age at delivery of less than 24 weeks or more than 44 weeks, or birth weight z-scores of less than −3 or more than 3 were recoded as missing as these are likely to represent recording or transcription errors.24
Data analyses
We first compared women in the data set who did and did not meet the inclusion criteria using χ2 and t-tests.
For the main analysis, an uncontrolled, multiple time points, ITS design was used. The unit of analysis was the month in which women entered the 25th week of pregnancy. ITS models estimate the change in ‘level’ and ‘trend’ of the outcome of interest associated with the intervention. The change in level is the difference in intercepts between regression lines estimated from observations before and after the intervention. The change in trend is the difference in slopes. In the case of two ‘interventions’ (eg, introduction and withdrawal of the HiPG), two changes in level and trend are estimated.
Generalised least squares models were used allowing for autoregressive and moving average correlation structures as appropriate. These allow any effect of periodicity to be taken into account. First, associations between introduction and withdrawal of the HiPG and the outcomes of interest were assessed in the whole cohort, using separate models for each outcome. Final models were used to calculate estimated absolute and relative effects on each outcome of the introduction of the HiPG at 21 months after implementation (immediately prior to withdrawal), and 24 months after withdrawal, with 95% CIs.26 Interaction terms were then used to determine whether the effects of the introduction or withdrawal of the HiPG varied by maternal age group, parity or IMD tertile.
Data preparation was conducted in Stata/SE V.14; data analysis in R V.3.3.1 and RStudio V.0.99.903. We used 95% CIs and a P value of <0.05 to indicate statistical significance throughout.
Results
Sample description
Of 39 571 women who delivered at the study hospital and were known to have reached the 25th week of gestation between 1 January 2003 and 31 December 2013, full data were available for 34 589 (87.4%). Characteristics of those who did and did not meet the inclusion criteria and hence were included or excluded from the analysis are described in table 1. Most exclusions were due to missing information on birth weight. Typically, women included in the analyses were aged 25–34 years, of parity 1 or more, lived in the most deprived third of areas in England and booked by 10 weeks’ gestation. Women excluded from the analyses tended to be younger, lived in more deprived areas and booked later in their pregnancies than women included. Similar differences between women included and excluded from the analyses were seen in each of the three study periods.
Characteristics of those included and excluded from the analytical cohort
Sample-wide changes in outcomes associated with introduction and withdrawal of the HiPG
Final models for each outcome are summarised in table 2 and plotted in figures 1–5. Introduction of the HiPG was associated with an immediate increase in mean gestational age at booking, and a decrease in the proportion booking by 18 and 25 weeks. That is, the immediate effect was for these outcomes to get clinically ‘worse’. However, introduction of the HiPG was also associated with an improvement in the trend in mean gestational age at booking and proportion booking by 10, 18 and 25 weeks. That is, the longer term effect was a change in trend of these outcomes towards greater clinical improvement over time.
Summary of interrupted time series model of the introduction and withdrawal of the Health in Pregnancy Grant on mean gestational age at booking (days).
Summary of interrupted time series model of the introduction and withdrawal of the Health in Pregnancy Grant on proportion booking before 10 weeks’ gestation.
Summary of interrupted time series model of the introduction and withdrawal of the Health in Pregnancy Grant on proportion booking before 18 weeks’ gestation.
Summary of interrupted time series model of the introduction and withdrawal of the Health in Pregnancy Grant on proportion booking before 25 weeks’ gestation.
Summary of interrupted time series model of the introduction and withdrawal of the Health in Pregnancy Grant on proportion of babies small for gestational age.
Summary of interrupted time series models of the associations between the introduction and withdrawal of the Health in Pregnancy Grant and outcomes of interest, coefficients (95% CI)
Withdrawal of the HiPG was not associated with any level changes in outcomes. However, it was associated with a change in trend in mean gestational age at booking and proportion booking by 18 and 25 weeks towards less clinical improvement over time. The introduction or withdrawal of the HiPG was not associated with any changes in the level or trend in the proportion of babies who were SGA.
Table 3 shows the absolute and relative impact of the introduction and withdrawal of the HiPG on each outcome at 21 months after introduction and 24 months after withdrawal. By 21 months after introduction of the HiPG, compared with the counterfactual of what was predicted given trends prior to the introduction of the HiPG, there was a reduction in mean gestational age at booking of 4.8 days (95% CI 2.3 to 8.2), an increase in the proportion of women booking by 18 weeks of 2.2% (95% CI 1.2 to 3.9) and an increase in the proportion of women booking by 25 weeks of 1.9% (95% CI 0.6 to 3.5). Compared with the counterfactual of what was predicted to occur given trends when the HiPG was available, by 24 months after withdrawal, there was an increase in mean gestational age at booking of 14.0 days (95% CI 2.8 to 16.8), a decrease in the proportion of women booking by 18 weeks of 7.6% (95% CI 2.2 to 7.9) and a decrease in the proportion of women booking by 25 weeks of 8.3% (95% CI 3.1 to 8.6).
Predicted effects (95% CI) of introduction and withdrawal of the Health in Pregnancy Grant at 21 months after introduction and 24 months after withdrawal
Differential changes in outcomes associated with introduction and withdrawal of the HiPG across population subgroups
Models including interaction terms for maternal age, parity and IMD tertile are summarised in tables 4–6. There were no interactions with parity. The associations between introduction and withdrawal of the HiPG and trend in mean gestational age at booking varied by age group (figure 6), with greater changes in trend in older women.
Summary of interrupted time series model, interaction between maternal age group and the introduction and withdrawal of the Health in Pregnancy Grant on mean gestational age at booking (days).
Summary of interactions between parity and the introduction and withdrawal of the Health in Pregnancy Grant, model coefficients (95% CI)
Summary of interactions between maternal age and the introduction and withdrawal of the Health in Pregnancy Grant, model coefficients (95% CI)
Summary of interactions between Index of Multiple Deprivation group and the introduction and withdrawal of the Health in Pregnancy Grant, model coefficients (95% CI)
The association between introduction of the HiPG and mean gestational age at booking and proportion booking by 18 and 25 weeks varied by IMD group (figures 7–9). The introduction of the HiPG was associated with a progressively larger level change (towards older gestational age at booking, and lower proportion booking by 18 or 25 weeks) as deprivation decreased.
Summary of interrupted time series model, interactions between Index of Multiple Deprivation group and the introduction and withdrawal of the Health in Pregnancy Grant on mean gestational age at booking (days).
Summary of interrupted time series model, interactions between Index of Multiple Deprivation group and the introduction and withdrawal of the Health in Pregnancy Grant on proportion booking before 18 weeks’ gestation.
Summary of interrupted time series model, interactions between Index of Multiple Deprivation group and the introduction and withdrawal of the Health in Pregnancy Grant on proportion booking before 25 weeks’ gestation.
Discussion
Statement of principal findings
This is the first evaluation of the HiPG in England, the first evaluation of a financial incentive for attendance at antenatal care on incidence of SGA, and one of the largest pragmatic evaluations of a health-promoting financial incentive in a high-income country. Introduction of the HiPG was associated with immediate deteriorations in timing of booking, but longer term improvements over time. By 21 months after introduction of the HiPG (immediately prior to its withdrawal), mean gestational age at booking had decreased by 4.8 days compared with what would have been expected had it not been introduced. Withdrawal of the HiPG was not associated with any immediate changes in timing of booking, but it was associated with longer term deteriorations in timing of booking over time. By 24 months after withdrawal, mean gestational age at booking had increased by 14.0 days compared with what would have been expected had it not been withdrawn. We found no association between introduction or withdrawal of the HiPG and incidence of SGA. Trends in outcomes associated with the HiPG did not vary by parity. The positive association between introduction of the HiPG and gestational age at booking was greater in older women. The negative association between introduction of the HiPG and timing of booking was more pronounced in less deprived groups.
Strengths and weaknesses of methods
The ITS approach is one of the strongest quasiexperimental research designs.23 27 By including substantial data before and after interventions, we took account of underlying secular trends. By studying outcomes at the population level, rather than individual level, confounding by individual-level variables was avoided. Our large data set with 132 monthly data points substantially exceeds the minimum requirements for ITS.27 By including autoregressive and moving-average functions, any biases introduced by the serial nature of the data (including seasonality and other periodicities) were accounted for. However, ITS designs are observational and we cannot categorically ascribe the changes documented to the HiPG. While we are not aware of any co-interventions likely to have influenced the outcomes concurrent with the HiPG, it is difficult to absolutely exclude these.
A major strength of our study is the use of SGA. Unlike a simple cut-off for low birth weight, SGA allows sex and gestational age differences in birth weight to be taken into account.
The data we used are likely to contain recording, reporting and transcription errors. Some of these may have introduced bias. ‘Feasibility’ limits were used for some variables and may have led to misclassification.
Cases included in the analytical cohort differed from those excluded. However, as differences between women included and excluded from the analyses were similar in all three study periods, this is unlikely to introduce bias and so we did not impute missing data. Differences between women included and excluded from the analyses may limit external validity, as may our use of data from only one hospital.
Interpretation of findings
Our finding that the introduction of the HiPG was associated with an immediate deterioration in timing of booking may reflect an implementation phase, where the process for obtaining the HiPG was not yet fully understood. For instance, women may have thought that they were only entitled to the HiPG if they delayed attending until after the 25th week of pregnancy. In fact this was not the case—although women could not claim the grant until after the 25th week of pregnancy, whether they had first attended before this had no impact on their entitlement. While we could have conducted further analyses excluding an implementation period (eg, 4 months after introduction of the HiPG), this would have been post hoc justified.
The longer term associations of the introduction of the HiPG on markers of timing at booking are in line with the intention of the intervention—that women should attend for antenatal care earlier in their pregnancies. One previous study found no effect on timing of first attendance of providing a voucher for a taxi journey to the antenatal clinic,17while a further evaluation of the HiPG found it was associated with a positive effect on the proportion of women booking by 25 weeks that disappeared after withdrawal.19 The substantial difference in incentive value of the HiPG, compared with previous incentives, may explain these differences.
The finding that withdrawal of the HiPG was associated with deterioration of the benefits of its introduction on timing of booking is also not unexpected. On the whole, different women would have been pregnant when the HiPG was and was not available, meaning sustained effects would be highly unlikely.
Changes in timing of attendance for antenatal care associated with the introduction and withdrawal of the HiPG did not translate into differences in the proportion of SGA babies. This may be because the effect size (of 4.8 days at 21 months) was too small to impact on SGA. Two previous studies that examined the effect of incentives for antenatal care on incidence of low birth weight (rather than SGA) also reported no effect.18 19
Although the HiPG was only available from the 25th week of pregnancy, we found that its introduction was associated with changes in the proportion of women booking by both 10 and 18 weeks. This indicates that the impact of health-promoting financial incentives may not be as specific as previously thought.28 The HiPG may have been associated with a larger effect on timing of booking if it had been contingent on booking earlier in pregnancy.
We did not find any evidence that the associations of the introduction or withdrawal of the HiPG with the outcomes studied varied by parity. This suggests that prior experience of antenatal care did not diminish the impact of the HiPG. However, the association of the introduction of the HiPG with improvements in gestational age at booking over time was greater in older women. This suggests that age may be a determinant of responsiveness to financial incentives in this context, with older women being more responsive to the intervention. Our data are consistent with the suggestion that those with fewer resources are particularly responsive to incentives.29 While introduction of the HiPG was associated with an immediate negative change in timing of first antenatal care, this was least pronounced in women living in the most deprived areas.
Implications of findings for policy, practice and research
It is possible that larger incentives, contingent on attendance earlier than 25 weeks, may have greater impacts on timing of antenatal care and clinical outcomes than seen here. Future research could explore how effects on antenatal care attendance vary with incentive value and timing.
As we used routine data in a retrospective analysis conducted more than 2 years after withdrawal of the HiPG, we were unable to explore how women and other stakeholders responded to the HiPG. In particular, we do not know what women spent the HiPG on, how doctors and midwives discussed it with women, or how appropriate stakeholders thought it was. These factors may have influenced effectiveness and variations in effectiveness between subgroups.30
Conclusions
Although the introduction of the HiPG was associated with an immediate clinical deterioration in timing of attendance for first antenatal care, it was also associated with a longer term trend towards improvement in timing. By 21 months after implementation, there was a decrease in almost 5 days in mean gestational age at booking compared with what would have been expected without implementation. Withdrawal of the HiPG was associated with deteriorations in timing of booking. By 24 months after withdrawal there was an increase in 14 days in mean gestational age at booking compared with what would have been expected without withdrawal. Neither the introduction nor withdrawal of the HiPG was associated with a change in proportion of babies who were SGA. There was no evidence that associations between introduction or withdrawal of the HiPG and outcomes varied by maternal parity. Introduction of the HiPG was associated with greater long-term benefits on timing at booking in older women, suggesting older women were most responsive to the intervention. The initial deterioration in timing of attendance for first antenatal care was least pronounced in those living in the most deprived circumstances, suggesting those living in the most deprived circumstances were most responsive to the intervention. Future research should explore the effects of incentives offered at different times in pregnancy and of differing values; and how stakeholders view such incentives.
References
Footnotes
Contributors JA conducted the literature searches, obtained the data, conducted the data analysis and led the writing. ZvdW, SR and JR contributed to study design, development of the analysis plan, interpretation of the data and critically reviewed previous versions of the final manuscript. JA acts as the guarantor.
Funding This work is produced under the terms of a Career Development Fellowship research training fellowship issued by the National Institute of Health Research (grant number CDF-2011-04-001) to JA. JA is supported by the Centre for Diet and Activity Research (CEDAR), a UKCRC Public Health Research Centre of Excellence. Funding from the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the National Institute for Health Research, and the Wellcome Trust, under the auspices of the UK Clinical Research Collaboration, is gratefully acknowledged (grant number MR/K023187/1).
Disclaimer The views expressed are those of the authors and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health.
Competing interests None declared.
Patient consent Not required.
Ethics approval Ethics approval was granted by the East of England Norfolk NHS Research Ethics Committee (12/EE/0386). The routine hospital data used in this study were anonymised before transfer to the research team and the ethics committee determined that explicit patient consent was not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data available.