Objective To use propensity score methods to create similar groups of women delivering in public and private hospitals and determine any differences in mode of delivery and neonatal outcomes between the matched groups.
Design Population-based, retrospective cohort study.
Setting Public and private hospitals in Western Australia.
Participants Included were 93 802 public and 66 479 private singleton, term deliveries during 1998–2008, from which 32 757 public patients were matched with 32 757 private patients on the propensity score of maternal characteristics.
Main outcome measures Neonatal outcomes were compared in the propensity score-matched cohorts using conditional logistic regression, adjusted for antenatal risk factors and mode of delivery. Outcomes included Apgar score <7 at 5 min, neonatal resuscitation (endotracheal intubation or external cardiac massage) and admission to a neonatal special care unit.
Results No significant differences in maternal characteristics were found between the propensity score-matched groups. Private patients were more likely than their matched public counterparts to undergo prelabour caesarean section (25.2% vs 18%, p<0.0001). Public patients had lower rates of neonatal unit admission (AOR 0.67, 95% CI 0.62 to 0.73) and neonatal resuscitation (AOR 0.73, 95% CI 0.56 to 0.95), but higher rates of low Apgar scores at 5 min (AOR 1.31, 95% CI 1.06 to 1.63) despite adjustment for antenatal factors. Additional adjustment for mode of delivery reduced the resuscitation risk (AOR 0.86, 95% CI 0.63 to 1.18) but did not significantly alter the other estimates.
Conclusions Propensity score methods can be used to generate comparable groups of public and private patients. Despite the rates of low Apgar scores being higher in public patients, the rates of special care admission were lower. Whether these findings stem from differences in paediatric services or clinical factors is yet to be determined.
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/3.0/ and http://creativecommons.org/licenses/by-nc/3.0/legalcode
Statistics from Altmetric.com
Obstetric interventions are higher for women giving birth in private hospitals compared to public hospitals despite their social and health advantages.
Differences in characteristics between public and private patients make it challenging to determine whether the higher rate of obstetric interventions in the private sector increases adverse neonatal outcomes.
The study aim was to use propensity score methods to create similar groups of women delivering in public and private hospitals and determine any neonatal outcomes and mode of delivery differences between the matched groups.
Maternal characteristics were similar between the public and private groups after propensity score matching, yet private patients were still more likely to undergo prelabour caesarean sections.
After matching and adjusting for antenatal risk factors, the rates of low Apgar scores were slightly higher in public patients, but the rates of admission to a neonatal unit were lower.
These differences could not be accounted for by the higher rate of caesarean deliveries in private hospitals.
Strengths and limitations of this study
Propensity score matching methods have been found to account well for measured confounding.
Using this method enabled us to account for differences in maternal characteristics between public and private patients where information was available.
Nevertheless, as some information was unavailable, some residual confounding may have impacted our results.
Studies from Australia and the USA have indicated that privately insured mothers have better maternal and infant health outcomes than women who deliver as public patients in public hospitals.1 ,2 However, mothers giving birth as private patients are less socioeconomically deprived and generally healthier than women who are public patients.3–5 It would therefore be anticipated that they would have better pregnancy outcomes. Yet, obstetric intervention rates have risen more rapidly in the private than the public sector during the last couple of decades.6 Now, women who hold private insurance and who do not receive midwife-led care in Australia, the USA and other parts of the world have higher rates of obstetric interventions, such as prelabour caesarean section, induction of labour and operative vaginal delivery, than other women.1 ,7 ,8 Such high rates of obstetric interventions may be associated with increased morbidity for both the mother and the baby.9–11
The maternal characteristics of private patients and the model of their obstetric care may have opposing influences on neonatal outcomes, but to date exploring the relative effects of these has been challenging. This may be because a direct comparison of private and public patients is difficult due to the large differences between the groups. In randomised controlled trials, the random allocation of patients into comparison groups guarantees an equal distribution of confounding factors between the groups. In observational studies such as this one, randomisation of subjects into groups is not feasible and because the number of confounding variables is high between public and private patients, traditional methods of matching or covariate adjustment may become problematic. The propensity score method is a way of circumventing these problems12 ,13 and has recently begun to be used within obstetrics to reduce or eliminate fundamental differences between comparison groups.14 ,15
In this study, we used propensity score methods in an attempt to create similar groups of public and private patients for comparison of neonatal outcomes and mode of delivery. First, the propensity of being a private patient based on the available maternal characteristics was estimated. Then the estimated propensity scores were used to individually match public with private patients. Finally, we assessed the differences in adverse neonatal outcomes between the matched groups using conditional logistic regression. We first hypothesised that rates of obstetric interventions are different between private and public patients even after matching on maternal characteristics; and second, that increased interventions may have a negative effect on neonatal outcomes.
The Data Linkage Branch at the Western Australian (WA) Department of Health provided whole-population, linked administrative health data from the WA Midwives Notification System (MNS), the WA Hospital Morbidity Data Collection (HMDC) and the WA Birth Defects Registry for the period 1 January 1998 to 31 December 2008 for this study. The midwives’ data included pregnancy and delivery details for all infants live or stillborn in WA during 1998–2008 at least at 20 weeks’ gestation or with a birth weight of at least 400 g. For the study population included in this study, we restricted the data to singleton, term births (weeks 37–41), resulting in live-born infants without birth defects and delivered in either private or public hospitals (excluding tertiary hospitals).
MNS included information on the Index of Relative Socioeconomic (SE) Disadvantage (IRSD) and Accessibility/Remoteness Index of Australia (ARIA+). The IRSD and ARIA values were based on the 2001 and 2006 Censuses and were assigned to each birth admission based on maternal area of residence at the time of birth. HMDC provided information on funding source and hospital type at the time of delivery, with private patients being defined as those who were funded by private health insurance or who were self-funded. We only included mothers delivering as public patients in public hospitals and mothers delivering as private patients in private hospitals in this study.
The use of deidentified, administrative health data for this study without patient consent was approved by the Human Research Ethics Committee of the WA Department of Health. This study was performed in accordance with the Declaration of Helsinki.
The propensity scores were generated by a logistic regression model and represented the probability of delivering as a private patient in a private hospital given the maternal characteristics, squared terms and interactions included as covariates in the propensity model.13 The following maternal characteristics were significant in the forward selection model (p<0.05) and were included in the propensity model in addition to 32 interaction terms and one square term for age: maternal age (continuous), parity (ordinal; 14 levels), marital status (categorical; married/single), ethnicity (categorical; eight levels), smoking during pregnancy (categorical; yes/no), SE disadvantage (categorical; five levels), residential remoteness (categorical; five levels), pre-existing genital herpes, diabetes mellitus and asthma (categorical; yes/no), previous caesarean (categorical; yes/no) and fertility treatment (categorical; yes/no).
We conducted 1:1 matching without replacement to match each private patient in a private hospital with each public patient in a public hospital within 0.25 SD of the logit of the propensity score of the identified private patient.12 The balance of the covariates before and after matching was assessed using a standardised difference since, unlike significance testing, it is not confounded by sample size.12 A standardised difference greater than 10% was used to indicate a meaningful difference between public and private patients.14 We used conditional logistic regression of the matched sets to estimated ORs and 95% CIs for the risk of adverse infant outcomes for public patients in public hospitals compared with private patients in private hospitals. Infant outcomes included Apgar scores <7 at 5 min, neonatal resuscitation (endotracheal intubation or external cardiac massage) and neonatal admission to a special care nursery. These outcome measures were selected since they are easy to measure and do not only reflect the neonatal condition, but also the practice differences between hospitals.16 The models were adjusted for antenatal risk factors including threatened miscarriage, placenta praevia and prelabour rupture of membranes as well as the mode of delivery. All analyses were performed using the statistical software SAS V.9.3 (SAS Institute Inc, Cary, North Carolina, USA).
Propensity score matching
Of the total 160 281 deliveries included in this study, 93 802 (58.5%) were by public patients in public hospitals and 66 479 (41.5%) were by private patients in private hospitals. Table 1 presents the baseline maternal characteristics of the two groups before matching. All characteristics were statistically significantly different (p<0.0001) and all except parity, genital herpes, diabetes mellitus and asthma were meaningfully different based on the standardised difference (±10%).
Figure 1 displays the distribution of the propensity scores for the public and private deliveries. We were able to match 32 757 public deliveries with private deliveries and from figure 2 it is evident that after matching, the propensity scores for the public and private births revealed a high degree of overlap and similarity in shape. Furthermore, all baseline characteristics were well balanced after matching (table 2). Although maternal age and pre-existing asthma were statistically significantly different between the two matched groups, the differences were small with a highest standardised difference of only 2.6 (table 2). The differences (mean age 0.1 year, and proportion of women with asthma 0.5% higher in the private group) are unlikely to be of clinical significance.
Following matching by propensity score and ensuring comparability in the baseline characteristics of the groups, we assessed whether there were any differences in antenatal complications between the groups (table 3). No significant differences were observed between matched public and private patients with regard to threatened preterm labour, urinary tract infection, pre-eclampsia, placental abruption or gestational diabetes. However, private patients were more likely to experience threatened miscarriage (6.7% vs 4.6% ; p<0.001) and placenta praevia (0.7% vs 0.3%; p<0.0001), but were less likely to experience prelabour rupture of membranes (1.7% vs 3.9% p<0.0001).
We then assessed the differences in labour and delivery management between the matched public and private groups (table 3). Private patients were delivered at earlier gestations than public patients, with 64.3% of private patients delivering before 40 weeks’ gestation compared to 47.2% of public patients (p<0.0001), and infants had a slightly lower mean birth weight (3443.9 g vs 3498.8 g, p<0.0001). Private patients were also more likely to have induction of labour or prelabour caesarean section than public patients, with only 38.3% of private patients labouring spontaneously, compared to 55.2% of public patients. Private patients were more likely to have epidural anaesthesia during labour, and mode of delivery was also different, with private patients having higher rates of assisted vaginal delivery (18.2% vs 12.3%; p<0.0001) and prelabour caesarean section (25.5% vs 18%).
When assessing the risk of neonatal complications for mothers delivering as public patients compared with those delivering as private patients, we first adjusted only for the antenatal complications that were significantly different between the matched groups. These antenatal complications were included in a multivariate analysis (table 4) and despite the adjustment, the results indicated that delivering as a public patient was associated with increased risk of low Apgar scores (AOR 1.31, 95% CI 1.06 to 1.63), but reduced risk of neonatal resuscitation (AOR 0.73, 95% CI 0.56 to 0.95) and admission to a neonatal unit (AOR 0.67, 95% CI 0.62 to 0.73). The absolute differences were however minimal for low Apgar scores and neonatal resuscitation as only 0.6% of infants born in public hospitals had low Apgar scores compared to 0.5% in private hospitals and only 0.3% were resuscitated in public hospitals versus 0.4% in private hospitals.
Next, we explored whether delivery management accounted for the observed associations. Table 4 shows that adjusting for mode of delivery reduced the risk of infant resuscitation (OR 0.86, 95% CI 0.63 to 1.18) to the point where it was no longer statistically significant, but the additional adjustment did not significantly alter the other estimates.
Our findings suggest that propensity score methods can be successfully used to create comparable groups of mothers delivering in public and private hospitals. However, despite including in our analysis only those public and private patients who had similar maternal characteristics and antenatal factors and thus comparing ‘like-with-like’, obstetric interventions continued to be performed at a much higher rate in the private sector. Also, delivering as a public patient was associated with an increased risk of low Apgar scores at 5 min, but reduced risk of admission to a neonatal unit.
One of the strengths of this study is the whole of the population design. This study draws on the wealth of statutory birth and hospital inpatient information routinely collected by the WA Department of Health. The main limitations of this study relate to the possibility of unmeasured confounding. Propensity score matching methods have been found to account well for measured confounding12 and using propensity score matching enabled us to eliminate differences between public and private patients for the maternal characteristics where information was available. Nevertheless, as we did not have information on body mass index (BMI) before pregnancy, gestational weight gain or maternal diet to name a few, some residual confounding may have distorted our results. However, as, for example, SE disadvantage has been shown to be associated with mothers’ weight gain during pregnancy,17 we believe that residual confounding was minimised through the covariates we were able to include in our propensity score model.
Birth outcomes between public and private patients have previously been studied in Australia.2 Robson et al included Australian deliveries, restricted to singleton, term births, and after adjusting for maternal age, ethnicity, smoking status, diabetes, hypertension, residential remoteness and mode of delivery, the authors found higher rates of all adverse outcomes for public births compared with private births.2 Coory et al18 replicated some of the results from Robson et al using Queensland data, both using the same variables for adjustment as well as after adjusting for additional maternal characteristics and antenatal risk factors. When we performed exactly the same analysis as Robson et al using the same study cohort, we found that public patients in public hospitals had an increased risk of low Apgar score at 5 min (OR 1.90, 95% CI 1.76 to 2.06) and neonatal resuscitation (OR 2.66, 95% CI 2.46 to 2.86), compared to private patients in private hospitals. Our results were almost identical to those of Robson et al (low Apgar scores: OR=1.75; neonatal resuscitation: OR 2.37).2 This indicates that even though the propensity score analysis in the current study may not have eliminated all differences between public and private patients, it seems to have significantly minimised those differences.
Our results supported previous findings showing that privately insured women are more likely to have obstetric interventions than other women, even after taking into account maternal characteristics and pregnancy risk factors.7 It is very likely that there are many reasons for this difference in intervention rates between the private and public sectors, including fear of litigation,19 maternal request,20 physician convenience,21 ,22 previous caesarean section23 and increase in the numbers of women with private health insurance in Australia.24 However, elective caesarean deliveries have been found to increase the risk of respiratory morbidity in infants born at full-term, compared with vaginal deliveries or emergency caesarean deliveries.10 Our results reflected this since public patients were observed to have decreased risk of neonatal resuscitation compared with private patients, which was largely accounted for by the higher rate of prelabour caesarean deliveries in the private sector. Nevertheless, some of the association could be explained by differences in availability of medical staff at private and public hospitals. Neonatal intubation is commonly used by skilled senior paediatricians to assist in the clearance of airways with meconium and paediatricians are more likely to be on hand to perform this task during care of the newborn in private hospitals instead of, for example, resident medical officers or other junior staff at public hospitals.
Apgar scores at 5 min have been reported to be better in healthy infants born by elective caesarean deliveries than in other infants25 and this appeared to be reflected in our results since public patients had a higher risk of a low Apgar score than private patients. The fact, however, that accounting for the mode of delivery in the analysis did not change the results renders this argument unlikely. Our results are thus more likely to reflect residual differences in maternal and pregnancy characteristics between the matched groups or perhaps practice differences between public and private hospitals. These differences are however likely to be minimal and clinically irrelevant as the absolute difference in risk was very small with only a 0.1% difference between public and private hospitals. Furthermore, Apgar score assignment is subject to variation; for example, under difficult conditions when the situation in the delivery room may become tense, the assignment of Apgar scores may be incomplete or delayed.26
Differences in delivery management also did not seem to account for the fact that infants of public patients were less likely to be admitted to neonatal special care nursery than infants of private patients in our study. Previous research suggests that clinical evaluation remains inexact when discriminating between infants needing special care and those who do not.27 Large variation has been found to exist between special care nurseries in the initial management of infants with respiratory distress and in the thresholds to transfer to a neonatal intensive care unit.16 Since infants become separate fee paying patients from the mother once they are admitted to a special care unit in Australian hospitals, an admission can create additional funds for the hospital if the mother is a private patient.28 However, if the mother is a public patient, the costs for admission of a baby to the unit are borne by the hospital. As such, there may be an incentive for private hospitals to encourage paediatricians to admit borderline infants for observation, and thus some may be offered admission to a special care nursery unnecessarily.29 Furthermore, fee paying mothers have greater expectations for their own hospital care and the care of their infant7 as they are generally well educated, confident and with high self-esteem and have been found to be at higher risk of obstetric interventions.30 However, the possibility of unnecessary admissions to special care nurseries, as alluded to above, may prove to be a double-edged sword as newborn hospitalisation can compromise breastfeeding and early maternal attachment.31 ,32 In fact, previous research has suggested that infants with mild complications may benefit from remaining with the mother in the postpartum ward as this may improve breastfeeding rates.33
In conclusion, our findings suggest that despite the rates of low Apgar scores being higher in public patients, the rates of special care nursery admission are lower in this group of patients. These findings could not be accounted for by the observed higher rate of caesarean deliveries in private hospitals. It remains to be determined whether these findings are a result of practice differences between public and private hospitals or if clinical differences play a role.
We thank the Data Linkage Branch of the WA Department of Health and the WA Birth Defects Registry for provision of the data.
Contributors KE initiated the research, designed the study, analysed and interpreted the data, and wrote the article. She will act as guarantor for the paper. SS gave clinical advice and contributed to the writing of the paper. FAH, GH and ATL gave advice on the statistical methods used for analysis, discussed ideas and contributed to the paper. DBP, NdeK, HL and FJS supervised the work, gave advice and contributed to the paper. All authors had full access to all of the data in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis.
Funding The research was funded by the Australia's National Health and Medical Research Council (grants 634 533 and573 122). The funder had no involvement in the analysis or the writing of the manuscript.
Competing interests None.
Ethics approval The use of deidentified, administrative health data for this study without patient consent was approved by the Human Research Ethics Committee of the WA Department of Health. This study was performed in accordance with the Declaration of Helsinki.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.