Objective To examine the associations between perceived quality of care and patient satisfaction among HIV and non-HIV patients in Zambia.
Setting Patient exit survey conducted at 104 primary, secondary and tertiary health clinics across 16 Zambian districts.
Participants 2789 exiting patients.
Primary independent variables Five dimensions of perceived quality of care (health personnel practice and conduct, adequacy of resources and services, healthcare delivery, accessibility of care, and cost of care).
Secondary independent variables Respondent, visit-related, and facility characteristics.
Primary outcome measure Patient satisfaction measured on a 1–10 scale.
Methods Indices of perceived quality of care were modelled using principal component analysis. Statistical associations between perceived quality of care and patient satisfaction were examined using random-effect ordered logistic regression models, adjusting for demographic, socioeconomic, visit and facility characteristics.
Results Average satisfaction was 6.9 on a 10-point scale for non-HIV services and 7.3 for HIV services. Favourable perceptions of health personnel conduct were associated with higher odds of overall satisfaction for non-HIV (OR=3.53, 95% CI 2.34 to 5.33) and HIV (OR=11.00, 95% CI 3.97 to 30.51) visits. Better perceptions of resources and services were also associated with higher odds of satisfaction for both non-HIV (OR=1.66, 95% CI 1.08 to 2.55) and HIV (OR=4.68, 95% CI 1.81 to 12.10) visits. Two additional dimensions of perceived quality of care—healthcare delivery and accessibility of care—were positively associated with higher satisfaction for non-HIV patients. The odds of overall satisfaction were lower in rural facilities for non-HIV patients (OR 0.69; 95% CI 0.48 to 0.99) and HIV patients (OR=0.26, 95% CI 0.16 to 0.41). For non-HIV patients, the odds of satisfaction were greater in hospitals compared with health centres/posts (OR 1.78; 95% CI 1.27 to 2.48) and lower at publicly-managed facilities (OR=0.41, 95% CI=0.27 to 0.64).
Conclusions Perceived quality of care is an important driver of patient satisfaction with health service delivery in Zambia.
- Patient satisfaction
- Perceived quality of care
- Exit interview
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
To the best of our knowledge, this study is the first to examine the association between perceived quality of care and patient satisfaction through exit interviews across Zambia.
Adequacy of medical resources and provider conduct and practices were significant predictors of overall patient satisfaction.
Facility characteristics such as management type, location and level of facility were important determinants of patient satisfaction.
Methodological concerns associated with over-representation of users and lack of causality are acknowledged.
For nearly 25 years, the World Health Organization (WHO) has identified meeting individuals’ universally legitimate expectations as a key health system objective.1 Patient satisfaction and ratings have been given increasing importance for measuring the quality of health services and are routinely used in developed countries for continuous quality improvement and value-based incentive payments.2 ,3 In addition to the intrinsic importance of meeting reasonable expectations, patient satisfaction and perceptions are associated with healthcare utilisation and choice of provider.4–6 Studies have also linked satisfaction to treatment adherence for HIV patients, which has important implications for individual patient outcomes and preventing resistance to antiretroviral drugs (ARVs).7 ,8
This study focuses on patient satisfaction and perceptions in Zambia, a sub-Saharan African country with 16.2 million citizens.9 Approximately 80% of Zambian health facilities are publicly managed, and the government has worked to decentralise decision-making to the district level since 1991.10 While service utilisation has improved in recent years, it continues to be a major concern; in the 2013–2014 Demographic and Health Survey (DHS), 64% of deliveries were performed by a skilled provider and 66% of children received medical attention for diarrhoea.11
HIV is a priority issue in Zambia, where adult prevalence was estimated at 13.3% in the 2013–2014 DHS.11 In 2012, Zambia dispensed ARVs to over 500 000 patients at 564 facilities, most of which were stand-alone vertical facilities associated with a general clinic.12 ,13 Currently, the National Aids Strategic Framework emphasises moving towards a model that integrates HIV prevention, diagnosis and treatment with other primary health services.14 While integration is still underway, a scaled-up pilot at 12 primary care clinics in Lusaka found that integration offered management and organisational advantages, but not human resource or infrastructure gains.15–17
Despite evidence that satisfaction can drive the utilisation of antiretroviral therapy (ART) and other priority services, Zambia lacks a systematic means of monitoring and responding to patient opinions. Zambian patient perceptions have only been measured in a handful of small studies in limited populations. A study of maternity care in Lusaka found that while 89% of women rated care as ‘good’ or ‘very good’, 21% were shouted at, scolded or otherwise treated badly during delivery.18 In another survey, the majority of patients were not satisfied with the quality of care for sexually transmitted diseases at an urban health centre.19 A third study was conducted across three districts and found average district-level adult satisfaction scores ranging from 70% to 76%.20 Adults gave lower satisfaction ratings in periurban areas in this study, suggesting that satisfaction varies by facility type and location.20 No prior national studies have described the extent of this variation or examined factors that explain it.
Research in other developing settings have identified a variety of factors that may drive satisfaction, including provider attitudes and respectfulness, technical provider ability, wait time, drug availability, facility appearance, and patient expectations.21–25 The findings have varied depending on the country and setting, leaving a gap in knowledge as to what drives satisfaction in the Zambian context.
In this study, we report findings from exit surveys of patients receiving HIV and non-HIV services at a diverse sample of facilities across Zambia. We describe levels and variations in patients’ overall satisfaction, as well as their perceptions of specific interpersonal and technical aspects of care. Additionally, we examine how individual characteristics, facility-level factors, and perceptions of specific aspects of care relate to overall satisfaction, to highlight areas for potential interventions to improve patient satisfaction in Zambia.
Sample and data collection
The exit interviews were conducted between December 2011 and May 2012 across 16 Zambian districts as part of the Access, Bottlenecks, Costs, and Equity (ABCE) project. The details of this project are documented elsewhere and available online.26
A two-step stratified random sampling process was used to select health facilities. First, Zambia's districts (72 at the time, currently 103) were stratified on the basis of average household wealth, population density and skilled birth attendance (SBA) coverage. One district was randomly selected from each wealth–population–SBA category, in addition to the capital, Lusaka. In each selected district, we selected all hospitals, two urban health centres, three rural health centres, and a quota of associated health posts. The exit interviews were conducted at a subset of the facilities selected for the overall ABCE project. Our study reports on interviews conducted at 104 facilities. Compared with all facilities in Zambia, we oversampled hospitals and urban health centres and undersampled rural health centres and health posts to allow for platform-specific analyses (see online supplementary appendix table 1). Our sample is representative of the Zambian population and health delivery system, except that we oversampled hospitals to allow for separate analyses of hospital data. The sample of patients who sought care was also skewed towards females, which is expected due to several factors including women seeking maternal health services and a higher HIV prevalence among women (15.1%) than men (11.3%).11
At each facility participating in the exit survey, 30 patients were systematically sampled as they exited. Sampling intervals varied from every patient to every four patients, depending on the patient volume reported by the facility manager. The sample size of 30 patients at each facility was estimated using the Kish method with the following assumptions: patient satisfaction rate of 10%, precision of 5%, α of 1%, design effect of two, and non-response rate of 20%. The estimated sample from the Kish method was further adjusted to allow for robust subgroup analyses (eg, HIV vs non-HIV; hospital vs health clinic; rural vs urban). Interviews were conducted over at least two days at each facility. Patients were required to be 15 years or older and in an appropriate physical and mental state to be eligible to complete the survey. If a patient was too young or otherwise ineligible, an eligible attendant was asked to answer on their behalf when possible. Verbal consent was obtained from all respondents, and surveys were conducted in a location where the facility staff and other patients were not present.
Trained research assistants recorded exit interview responses electronically using the DatStat data collection software. On a daily basis, data were uploaded to a database accessible from Seattle, where they were continually verified for quality during the collection process. The median interview time was nine minutes.
Facility survey instrument
At each health facility, research assistants interviewed facility administrators to collect information about facility resources, staffing, management and practices. Facility level and management were verified against a facility roster provided by the Ministry of Health (MOH).
Exit survey instrument
The exit instrument drew questions from established patient exit and household surveys, which in-country partners tested and modified to fit the Zambian context. Demographic questions were based on the Zambian DHS.27 Questions about visit circumstances and costs were adapted from the World Health Survey.28
We measured patients’ overall satisfaction with the facility with the following question from the Consumer Assessment of Healthcare Providers and Systems Adult Visit questionnaire: Using any number from 1 to 10, where 1 is the worst facility possible and 10 is the best facility possible, what number would you use to rate this facility?29 ,30
The survey also captured how patients perceived the quality of specific aspects of the facility and its providers, based on a validated questionnaire developed by Baltussen et al31 that has been used in other developing settings.32 ,33 Patients were asked to rate 25 aspects of the facility on a five-point Likert scale: very bad, bad, moderate, good or very good. The majority of questions were answered by over 95% of patients, but we excluded five questions to which over 10% of patients responded ‘not applicable’, ‘don't know’, or ‘decline to respond’. These five questions concerned: adequacy of doctors for women, ease of making payment arrangements, time doctors allow for patients, availability of good doctors, and provider's follow-up with patients.
Condensing perceived quality responses
We then used principal component analysis (PCA) with orthogonal rotation to examine the structure of the remaining 20 perceived quality questions (see online supplementary appendix table 2). The analysis identified five components with eigenvalues ranging from 0.94 to 7.8, which explained 62% of the variance. The factors aligned with theoretical domains and can be interpreted as: (1) health personnel practices and conduct, (2) adequacy of resources and services, (3) healthcare delivery, (4) accessibility of care, and (5) cost of care. The specific questions under each domain are listed in online supplementary appendix table 2. The factor with an eigenvalue under 1 (accessibility of care) was retained because the variables it contained were theoretically grouped and not otherwise represented. Cronbach's α coefficients for each grouping ranged from 0.70 to 0.90, which met the generally accepted threshold of 0.70 and was comparable to or better than studies conducting similar exercises.34
To condense the information for each domain, we created a new variable that was the per cent of questions within the domain which the respondent rated ‘good’ or ‘very good’. We opted to examine the responses in this categorical manner rather than as continuous averages because (1) Likert scales from very bad to very good are not truly continuous and (2) research shows that patients typically rate facilities favourably, and therefore the important distinction is achieving the very highest ratings.35–37 If a patient did not answer a given question, we took the per cent among the questions that were answered.
Ordered logistic regression analysis
We used random-effects ordered logistic regression models to examine how overall satisfaction (rated from 1 to 10) was related to objective patient, facility and visit factors, as well as patient perceptions of specific aspects of care (measured with the 5-point Likert scale).
The unit of analysis was the patient, and the outcome for all models was the patient's overall rating of the facility out of 10 (described above in measuring satisfaction). An ordered model was selected because the outcome scale was ordered but not truly continuous. Additionally, since the outcome variable was skewed towards higher ratings, we grouped all responses below six into a single category for the purpose of the regression models (see online supplementary appendix figure 1).
The first model examined how facility, patient and visit characteristics were associated with overall satisfaction. Independent variables were selected a priori based on relationships previously identified in the literature. Facility variables included facility type (hospital or health centre/post), location (urban or rural), and management (public or non-governmental organisation [NGO]/private). Demographic variables included age, self-rated overall health, ethnicity, sex, education level, and a binary indicator of whether the respondent was the patient or an attendant. Variables surrounding visit circumstances included travel time, wait time, and type of provider seen. We did not include whether or not the patient paid a user fee as this was largely determined by facility management—public and NGO facilities typically offer free services while private facilities often charge fees.
The second model looked at how patients’ perceptions of particular domains of care related to their overall perception, to identify which aspects are most influential. The predictor variables in this case were the five summary perceived quality variables (described above in condensing perceived quality responses): health personnel practices and conduct, adequacy of resources and services, healthcare delivery, accessibility of care, and cost of care.
Our final combined model included all of the facility, patient, visit, and perceived quality predictors from the first and second models. This allowed us to examine whether any facility, patient or visit characteristics were associated with overall satisfaction independent of how the patient rated specific aspects of care.
All models included facility random effects to account for unmeasured facility characteristics, and we estimated robust standard errors (SEs) to account for intragroup correlation within facilities. Patients missing one or more covariates were excluded from all regression analyses.
Our sample contained a substantial number of patients receiving HIV-related services; we analysed these patients separately from those receiving other services because HIV care may involve specialised staff, equipment and drugs, and because HIV often receives unique policy attention based on the large burden it poses in Zambia.
We additionally conducted sensitivity analyses to test for effect modification by facility management, facility location, facility level and respondent identity (patient or attendant). To do this, we conducted the same analyses described above, stratified by the characteristic of interest, rather than by the HIV visit or not.
Data management and analysis were conducted in Stata V.13.1.
The response rate among eligible patients was 97% and a total of 2789 exit interviews were conducted. After excluding 61 patients who lacked an associated facility survey, 31 who had not received services that day and 76 who did not provide an overall satisfaction score, our sample included 2528 patients from 104 facilities. Of these, 413 had received HIV-related services that day and 2115 had received other services. An additional 203 patients were missing information for one or more variables in the regression and were excluded from all regression analyses.
Seventy-one per cent of survey respondents were the patients themselves, while 29% were attendants. Of the attendant respondents, 94% were accompanying a patient under the age of 15 years.
The sample of 104 facilities included 14 urban hospitals, 7 rural hospitals, 51 rural health centres/posts, and 32 urban health centres/posts.
The majority of exit interviews were conducted in health centres or posts (80%) and in facilities managed by the government (81%) (table 1). Overall, around half of the visits occurred in urban areas, though HIV visits more often occurred at urban facilities (59%), compared with other types of care (45%).
The majority of respondents were female (68%) and had a post-primary education (53%). Patients most often rated their overall health as ‘good’ (32%), while 9% rated it ‘excellent’ and 11% ‘poor’. The most common ethnicities were Tonga (22%) and Chewa Nyanja (22%). Only 1% of patients receiving HIV services were aged under 5 years, while 23% of those receiving other types of care were in the under-5 age group.
A typical patient spent longer waiting at the facility (median of 50 min) than travelling to it (median of 30 min). Patients receiving HIV services waited and travelled longer than other patients: 38% of patients receiving HIV services waited over two hours compared with 23% of other patients. Only 4% of HIV-related visits involved any medical fees at the facility, compared with 13% of other visits. Among patients receiving non-HIV services, those visiting government-managed facilities paid fees less frequently (10%) than those at private (30%) and NGO facilities (23%).
Figure 1 shows the distribution of patients’ overall satisfaction scores at each facility. The average score on a 10-point scale was significantly higher for patients receiving HIV services (7.3) than others (6.9) (one-sided p<0.01). In total, 21% of patients receiving HIV services and 28% of other patients gave a satisfaction score of 5 or lower. The average satisfaction score at a given facility ranged from 3.2 to 10 for patients receiving non-HIV services, and from 3.7 to 9.7 for those receiving HIV services. Descriptively, satisfaction was higher at facilities that were urban (7.4) or privately/NGO managed (7.5) than those that were rural (6.6) or publicly managed (6.8).
Table 2 summarises patients’ perceptions of the 20 specific aspects of care, grouped into five domains. The best perceived aspect was cost of care (96% very good or excellent). All of the questions comprising the health personnel domain were rated very good or excellent by at least three-quarters of patients, with the exception of involvement in decision-making (64%). The lowest-rated domains were adequacy of resources and services, and accessibility of care. Less than half of all patients rated medical equipment adequacy (44%), facility spaciousness (46%), and wait time (46%) as very good or excellent. Medical equipment adequacy, drug availability, drug quality, treatment effectiveness, and cost of care were rated as very good or excellent significantly more often for HIV visits compared with other types of visits. The opposite was true of wait time and facility cleanliness.
In the first models including demographic, facility and visit characteristics, rural location was associated with lower odds of overall satisfaction for patients receiving HIV services (odds ratio (OR)=0.25, 95% confidence interval (CI) 0.14 to 0.46) and non-HIV services (OR=0.16, 95% CI 0.11 to 0.22) (table 3). Patients receiving non-HIV care also had lower odds of high satisfaction at public facilities (OR=0.43, 95% CI 0.32 to 0.58), and higher odds at hospitals (OR=1.91, 95% CI 1.37 to 2.65). The only demographic factor significantly associated with overall satisfaction in these models was Tonga ethnicity for patients receiving HIV services (OR=0.50, 95% CI 0.28 to 0.88).
There was evidence of effect modification by facility type in the sensitivity analysis (see online supplementary appendix table 3b–d). Among patients visiting hospitals, odds of satisfaction were significantly higher when the facility was publicly managed (OR=2.42, 95% CI 1.09 to 5.37); in contrast, at non-hospitals, odds of satisfaction were significantly lower when the facility was publicly managed (OR=0.24, 95% CI 0.13 to 0.42). Among patients at urban facilities, odds of satisfaction were higher if it was a hospital (OR=16.84, 95% CI 10.70 to 26.51), while at rural facilities, odds of satisfaction were lower if it was a hospital (OR=0.18, 95% CI 0.10 to 0.34).
In table 4, we explore how perceptions of specific aspects of care relate to overall satisfaction. Perceptions of health personnel practices and conduct had the strongest association with overall satisfaction for non-HIV (OR=3.05, 95% CI 1.95 to 4.77) and HIV (OR=9.49, 95% CI 2.51 to 35.93) patients. This was the only significantly associated domain for HIV patients, while for non-HIV patients adequacy of resources and services (OR=2.17, 95% CI 1.30 to 3.62) and accessibility of care (OR=2.52, 95% CI 1.69 to 3.79) were also significant predictors.
In the final combined model, all of the facility, patient, visit, and perceived quality factors that were significantly associated with overall satisfaction in the first two models remained significant predictors (table 5). In addition, better self-rated health was significantly associated with higher odds of overall satisfaction for non-HIV (OR=1.29, 95% CI 1.01 to 1.66) and HIV (OR=2.68, 95% CI 1.35 to 5.30) patients. Perceived quality of healthcare delivery was an additional significant predictor for non-HIV patients (OR=1.75, 95% CI 1.13 to 2.70) and adequacy of resources and services was associated with better odds for HIV patients (OR=4.68, 95% CI 1.81 to 12.10).
Providing patients with satisfactory care is an intrinsic health system goal as well as a means of driving demand for services. On average, the Zambian patients we interviewed reported overall satisfaction scores of 6.9 of 10, with substantial variation in patient opinion depending on the specific aspect of care in question and the type of facility visited.
Patients had poor perceptions of many physical characteristics, reflecting reports of weak infrastructure across Zambia and sub-Saharan Africa.38 ,39 Patients were also critical of long wait times, most likely driven by human resource shortages and inefficiencies in the provision of care.40 ,41 These perceptions were significantly associated with overall satisfaction in our regression analysis, suggesting that supply-side interventions to improve staffing and resource availability can also meaningfully impact patient attitudes that drive demand.42 ,43
Our findings also highlight that while most patients had good perceptions of personnel, a negative interaction can have a very meaningful influence on overall satisfaction. Ratings of provider behaviour were an especially strong predictor of satisfaction for HIV patients, reinforcing qualitative research on the importance of respectfulness and confidentiality for this group.44
We also found that patients were less satisfied at rural, public, and lower level facilities. Previous studies have identified objective physical and human resource shortages especially affecting rural, public, low-level facilities, and we hypothesised that patients had lower satisfaction due to their perceptions of these shortages.26 ,27 ,45 However, when we controlled for these perceptions in our final model, facility management, type, and location remained significant predictors of overall satisfaction. Unless we failed to control for perceptions of a particularly important aspect of care, this could indicate that patients have inherent biases or expectations at rural, public and lower level facilities that extend beyond their actual experiences and observations. Improving satisfaction could require both objective facility improvements and efforts to alter underlying public biases. Disentangling the subjective factors underlying patient expectations and satisfaction is an important area for ongoing research.46
Finally, although Zambia has begun integrating the provision of HIV care with other services, HIV patients gave statistically significantly higher ratings than non-HIV patients for overall satisfaction and several technical aspects of care. Policymakers must consider the magnitude of these differences alongside their statistical significance. For instance, while the five percentage point difference in perceived drug quality was statistically significant, it may be less important than addressing the gap in drug availability (a 12 percentage point gap). Given the efficacy of ARVs, it is perhaps unsurprising that HIV patients had favourable perceptions of drug quality and treatment effectiveness.47 Higher ratings for equipment and drug availability could reflect concerns that HIV receives disproportionate resources and aid compared with, or even at the expense of, other services.48–50 However, the fact that HIV patients waited and travelled longer implies the opposite for human resources and facility density.51 Policymakers should carefully monitor how rapidly scaling up HIV services has impacted the experiences and satisfaction of HIV and non-HIV patients, and consider how HIV supply chain successes could be extended to other resources.15 ,52
Our findings must be interpreted in the light of the following limitations. First, exit interviews, by nature, only include patients who sought care. Therefore, our findings only reflect the opinions of patients who interacted with the health system, not those of the general population. For instance, our sample of patients may have higher satisfaction than the overall population, because individuals who are satisfied with the health services available are more likely to seek care than those who had a bad experience.5 Second, our systematic sample may not truly represent the patient population, as we did not randomly sample patients from a roster. Also, the sample was not specifically designed to target HIV patients, limiting the size and representativeness of this subsample. Third, while exit interviews offer the advantage of reduced recall bias, conducting interviews at the facility may make patients hesitant to express their true opinions. Fourth, our findings should not be interpreted as a causal association between perceived quality of care and patient satisfaction. A more nuanced econometric model such as structural econometric modelling or path analysis may be better suited to establish the structures of causality. It is likely that some observed and unobserved facility and patient characteristics may affect different dimensions of perceived quality of care and overall satisfaction. Furthermore, these characteristics may affect overall satisfaction indirectly through the quality of care ratings. Our analyses do not address these concerns, and therefore results should be interpreted with caution. Finally, patient perceptions and satisfaction may have changed since the survey was conducted in 2012. Ideally, Zambia should implement an ongoing system to monitor levels and trends in patient satisfaction, as many developed countries have.3 To the best of our knowledge, our survey is currently the most recent national satisfaction survey of its scale, and the results raise substantial equity concerns that should be closely evaluated today and addressed. It provides the timeliest information available on Zambian patient satisfaction and can serve as a baseline measurement for tracking and evaluation purposes.
Patient satisfaction is an important goal for both intrinsic patient rights and health outcomes. From a rights perspective, systematic variation in satisfaction depending on facility location, management and level raises concerns about the equity of care in Zambia. Additionally, previous literature has demonstrated that low satisfaction is an important driver of two key challenges facing the Zambian health system: healthcare-seeking behaviour and adherence to treatment, particularly for HIV. Our findings provide a road map to policymakers as to which aspects of care should be prioritised to have the greatest impact on overall satisfaction, including training and incentivising staff to treat all patients with dignity and improving resource availability. The results implore policymakers to prioritise satisfaction interventions at rural, public, and lower level facilities, keeping in mind that perceptions of these facilities may be driven by both tangible factors and internalised beliefs or biases.
The authors would like to acknowledge the patients and facility administrators who willingly gave their time to participate in the study; the Ministry of Health of Zambia for their essential support and feedback; the research assistants who conducted the interviews in the field; and Kelsey Bannon of IHME for providing project management.
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
- Data supplement 1 - Online supplement
Contributors ED contributed to the creation of the survey instrument, conducted the analysis, and drafted the manuscript. FM oversaw the in-country data collection and interpreted the findings. EG contributed to the creation of the survey instrument and provided guidance for data collection and analysis. SHM and RB contributed to the data collection and analysis. SK conceived of the study and its design, contributed to the creation of the survey instrument, helped draft the manuscript, and provided overall guidance. All the authors read and approved the final manuscript.
Funding This project was funded by the Disease Control Priorities Network grant to the Institute for Health Metrics and Evaluation from the Bill & Melinda Gates Foundation.
Competing interests None declared.
Patient consent Obtained.
Ethics approval IRB approval was obtained from the University of Washington Human Subjects Division and the University of Zambia Biomedical Research Ethics Committee. Human Subjects Application number is 42944.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.