Article Text

Download PDFPDF

Assessment of public oral healthcare services in Curitiba, Brazil: a cross-sectional study using the Primary Care Assessment Tool (PCATool)
  1. Antonio Carlos Nascimento1,
  2. Simone Tetü Moysés2,
  3. Renata Iani Werneck2,
  4. Marilisa Carneiro Leão Gabardo1,
  5. Samuel Jorge Moysés2
  1. 1 School of Health Sciences, Universidade Positivo, Curitiba, Brazil
  2. 2 School of Life Sciences, Pontifícia Universidade Católica do Paraná, Curitiba, Brazil
  1. Correspondence to Dr Marilisa Carneiro Leão Gabardo; marilisagabardo{at}gmail.com

Abstract

Objectives To compare two different models of public oral health in primary care services, a so-called family health strategy (FHS), as opposed to non-FHS services designated as ‘conventional’ healthcare (CHC), regarding the presence and extent of the attributes of ‘good’ primary healthcare (PHC). The null hypothesis of this study is that the attributes do not differ between the FHS and CHC.

Design Cross-sectional.

Setting Public PHC services in Curitiba, the state capital of Paraná.

Participants PHC users of the public oral health network (n=900) and dentists active in this municipal network (n=203).

Primary and secondary outcome measures The Primary Care Assessment Tool (PCATool)-Dentists and PCATool-Users were used to analyse the primary outcomes (‘essential’ attributes) and secondary outcomes (‘derived’ attributes) in the PHC.

Results Overall, the primary care services in oral health were well evaluated, both by users and by dentists, with mean scores ascribed to PHC attributes mostly above the cut-off point (6.6). The exception for users were affiliation (6.36; 95% CI 6.11 to 6.60) and accessibility (5.83; 95% CI 5.78 to 5.89); and for dentists the accessibility (5.80; 95% CI 5.63 to 5.96). When comparing FHS and CHC, there was a superiority of the FHS model, which reached a general mean score of 7.53 (95% CI 7.48 to 7.58) among users and 7.56 (95% CI 7.45 to 7.67) among dentists; on the other hand, the CHC general mean score was of 6.61 (95% CI 6.49 to 6.73) and 6.68 (95% CI 6.56 to 6.80) respectively for users and dentists.

Conclusions The results reveal a reasonable level of attainment of PHC attributes in the services investigated. Nevertheless, public health managers should make efforts to reduce the difficulties faced by users in accessing dental care. The more positive results achieved by FHS services indicate that the provision of oral healthcare under this strategy should be expanded.

  • primary health care
  • oral health
  • public health

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • The study uses a cross-culturally validated instrument, and we deal with the Primary Care Assessment Tool in a setting of primary care services that includes oral health; therefore, we did an innovative study applying it to dentists, as done in other studies.

  • We were able to collect data from a large sample of patients with a high response rate, as well as a representative sample of dentists who work in the investigated network.

  • The study compared the perspectives of patients and primary care practitioners in oral health.

  • Since it is a cross-sectional study, the limitations may be related to the establishment of causal relationships.

  • The tool is based on subjective self-perception reports about primary care services, rather than clinical observation, so the results should be interpreted taking this into account.

Introduction 

Improving people’s income and living conditions, with the consequent positive impacts on health,1 and implementing the principles of the Alma-Ata Declaration on primary healthcare (PHC)2 are objectives that many governments seek to put into practice.

However, PHC is widely misunderstood as a less important level of the health services network. Its role is viewed as providing services of low complexity with lower cost and second-rate quality. It is usual for PHC to be organised around the provision of care for poor people and individuals with supposedly minor problems. In fact, PHC should be understood as the point at which good care is first provided, where the user gains access to the entry door for the health network and health teams solves many of the most common and important health problems.3

Investment in PHC is justifiable as the findings of various studies show that there is a correlation between increased investment in PHC and improved health indicators,4–6 user satisfaction7 and financial costs that can be better borne by local government.3 In general, similar reasoning and expectations can also be applied to investment in PHC for oral health. This is particularly true in countries such as Brazil, where public oral health is an integral part of PHC in the National Health System. Brazil is highly complex as regards the health of its population since it crosses the epidemiological transition still with an important load of transmissible diseases, which are typical of underdeveloped societies, and a growing prevalence of chronic diseases as it happens in rich countries.8

An issue that needs to be addressed by PHC is inequality of access to oral health, as being able to see a dentist remains a major problem in many countries.9–12 In Brazil, despite advances that have been made following the introduction of the ‘Sistema Único de Saúde (SUS)’ (Brazilian National Health System) in 1988,13 the inequalities will persist if the current model of dental practice continues. This model is predominantly based on the individual treatment of diseases with little emphasis on health promotion and disease prevention. Therefore, investigating the quality of oral health services in PHC is an important theoretical, methodological and practical endeavour.

Such is the case of Curitiba, capital of Paraná in southern Brazil, which has about 2 million inhabitants and is known throughout the country and abroad for its innovations in urban planning. Approximately 70% of the population of Curitiba uses the SUS when they need oral care.14 In the city, oral health teams operate under two different models of PHC. One, called the Family Health Strategy (FHS), was developed to improve family and patient-centred PHC by means of multiprofessional teams. Each team is responsible for monitoring around 1000 families located in a well-defined geographical area, taking into account their degree of vulnerability. The other, with teams not associated with the FHS, is known in Brazil as ‘conventional’ healthcare (CHC), which provide routine clinical care that is circumscribed to the biomedical paradigm and is focused on procedures for the treatment of already existing health problems.

Investigations are justifiable that make use of suitable instruments for measuring accessibility to healthcare, among other principles of PHC,15 16 as their findings facilitate evaluation of the existing situation, to provide support for decision-making by municipal public sector managers. It is also important to assess the typical viewpoints of practitioners and users of health services as they elaborate distinct rationales about reality. Transparent and dialogic relationships between practitioners and users have a direct effect on increasing satisfaction with quality as well as on loyalty to services by meeting experiences that enhance public governance and mutual accountability.

An important instrument for evaluating structural and process characteristics of PHC is the Primary Care Assessment Tool (PCATool),17 which was validated for PHC services in Brazil.18–21 It allows evaluation of the presence and extent of essential and derived PHC attributes, that is, whether the actions undertaken by a health service are consistent with evidence-based and good practices recommendations for PHC. PCATool has adequate psychometric characteristics and a multidimensional structure that is valid for the identification, monitoring and evaluation of PHC attributes.22 There is a notable gap in the use of this instrument in the international literature for evaluation of oral health services in primary care, in addition to a shortage of initiatives that offer integration of public oral health and primary care services.23 24 There are even heated discussions about whether ‘the perfect smile is a medical need worthy of public subsidy’, that is, whether there should be integration of dentistry into public health services.25

Based on previous assumptions, the main aim of this cross-sectional study is to compare the presence and extent of PHC attributes in public oral health services in Curitiba, Brazil, using the PCATool. The null hypothesis is that the attributes do not differ between the FHS and CHC services.

Method

Study design and sample

This cross-sectional study was designed to investigate the multidimensional context of the provision of primary public oral health services in Curitiba. The city currently has 109 PHC units providing medical, nursing, mental health and dental services. More than 600 dentists work in these PHC units as part of multiprofessional teams providing healthcare for the population. The city also has three specialised referral centres for oral health.26 To clarify the different job arrangements of dentists, those who work in CHC units are hired on a part-time basis (4 hours/day work contract) and those working in FHS units are full-time (8 hours/day). FHS teams also have greater institutional support, including continuous training and higher financial incentives, which seems to motivate them to develop greater links and commitment to the users for whom they are responsible.

The sample was drawn from 109 (100%) primary health units with oral health teams, operating at the time of completion of the fieldwork. Sixty units (58.8%), consisting of 30 units of the FHS stratum and 30 of the CHC stratum, were chosen using stratified random sampling. The sampling procedure was performed by the principal investigator using a name list of all units in the municipal health network, and subgroups corresponding to the two categories of interest (FHS and CHC) were numbered and randomly selected based on the Excel RAND function. Of all dentists in the municipal network, 431 provided PHC at the time of field research. The remaining 169 dentists were mainly working at the secondary level (specialised units), in managerial positions or they were on leave for health treatment or for other reasons. The response rate was 72.5% in the FHS (n=79 dentists) and 80.5% in the CHC (n=124 dentists), giving a total of 203 dentists.

The user sample was selected from the municipal PHC information system, which contains sociodemographic data and dental/medical records of the families that use the services. Fifteen users were randomly selected from each of the 60 health units (30 FHS and 30 CHC) taking part in the study, giving a total sample of n=900. The inclusion criteria specified that users should be over 18 years of age, have been using the oral health services studied for at least 2 years and should not have any mental disorders. The response rate was 100% once the data collection included home-based interviews and revisiting the homes of participants who were not present at the first visit, at times that were convenient for them.

Data collection

The data collection instruments used were PCATool-Dentists and PCATool-Users, both of which were adapted for oral health, using the original versions validated for Portuguese.18–21 Primary and secondary outcome measures are ‘essential’ and ‘derived’ PHC attributes, applied as follows: (a) for users, the essential attributes with their respective number of questions were affiliation (3 questions), first contact/access (3), accessibility (11), continuity of care (14), integration of care (9), information system (3) and comprehensiveness (28). The derived attributes were family orientation (9), cultural competence (8) and community orientation (5). Just to give an example, for the attribute affiliation, the questions are: ‘Is there a dentist or oral health service where you usually go when you need advice about your oral health?”, ‘Is there a dentist or oral health service that knows you best as a person?' and ‘Is there a dentist or oral health service that is most responsible for your oral healthcare?'. (b) For dentists, the essential attributes were accessibility (9), continuity of care (12), information system (4) and comprehensiveness (28); and the derived were family orientation (9), community orientation (7) and cultural competence (5). Finally, to summarise in a simple and straightforward way, the essential score and the general score are also calculated for both users and dentists.

When dealing with the instruments, response options were on a 5-point Likert scale: ‘definitely yes’ (4 points); ‘probably yes’ (3 points); ‘probably no’ (2 points); ‘definitely no’ (1 point) and ‘I don’t know/I don’t want to answer’ (0 point).

Statistical analysis

The data were recorded using an Excel spreadsheet and then analysed with Statistica V.7.0 software (Dell, Round Rock, Texas, USA). The scores in the database showed the extent to which the units investigated complied with the principles of PHC. The score was defined based on mathematical calculations and algorithms described in the PCATool Manual.26 A minimum reference score of 6.6 points was used as the cut-off, corresponding to the minimum performance for an oral health service to satisfy the attributes of PHC.19 27 The mean scores for attributes of PHC by users and dentists of FHS and CHC units were evaluated for their distribution pattern using the Lilliefors normality test. All attributes showed a pattern tending to normal distribution; therefore, all tests were parametric.

The single sample t-test was used to assess whether the PHC oral health services achieved the minimum attributes. To compare the attributes and scores for FHS and CHC units for both users and dentists, an independent sample t-test was used; we tested the null hypothesis that the means for the two categories of respondent and two types of health unit were equivalent. The attributes and scores for services operating as part of or outside the FHS were compared with respondents’ affiliation using two-factor analysis of variance (ANOVA).

Lastly, the FHS and CHC unit groups, both for users and dentists, were compared using the Fisher’s least significant difference (LSD) follow-up test. For this, the post hoc option was chosen under the assumption of a significant F, that is, the null hypothesis of equality of the FHS and CHC units was rejected. Fisher’s LSD post hoc (protected) test calculates the SD of all groups combined. Protection means that the calculations were undertaken only when the overall ANOVA resulted in a p value <0.05. This stage of data analysis focused on finding patterns and/or relationships between subsets of sampled populations that would otherwise remain undetected. The post hoc analysis limits the likelihood of significant effects being accidentally discovered among the subgroups of a population when such effects do not exist, thereby controlling type I error.

Attributes and scores for users and dentists were compared jointly for each type of health unit. Data provided by the respondents were compared separately in terms of the type of health unit they used and their final scores. A significance level of 0.05 was used for all the analyses.

Patient and public involvement

In the consent form, which meets the requirements of the Brazilian legislation on human research, participants were informed about the type of study, the main objective, what their involvement and the type of question to be answered, and that they could leave the study to any time and for any reason, without any consequences. The initial disclosure of the research results for the participants has already occurred since workshops were held with managers and dentists of the PHC units. The main results were also presented to the Local Health Councils, which include representatives of local dwellers associations and the organised civil society. Future dissemination will occur through presentations at scientific meetings and through the publication of the manuscript.

Results

Based on the cut-off point described in the methodological section, with the minimum reference score of 6.6 points, users’ perception of major PHC attributes for both FHS or CHC services was favourable (≥6.6), except for affiliation and accessibility. Affiliation had a borderline value (6.36) and accessibility was far below the minimum score, with a value of 5.8. In addition to the statistically significant values for these two attributes, the negative results of the t-test were also noteworthy. The attributes assessed by users are shown in table 1.

Table 1

Mean scores assigned to primary healthcare attributes of oral health services by users of these services in Curitiba, 2011 (n=900)

The scores ascribed by PHC dentists who worked in FHS and CHC models for comprehensiveness (6.67), expanded comprehensiveness (6.64) and the essential score (6.66) (which includes only the four essential PHC attributes) were borderline. As perceived by the dentists, only the accessibility (5.80) had a mean that was significantly below the expected reference score, again with a negative result for the t-test (table 2).

Table 2

Mean scores assigned to primary healthcare attributes of oral health services by dentists providing these services in Curitiba, 2011 (n=203)

Regardless of the type of model being analysed, most PHC attributes achieved good mean scores. However, a comparison of the perception of users and dentists associated with FHS (table 3) and that of users and dentists in CHC (table 4) showed that the former had a better perception of the PHC structure and work process.

Table 3

Assessment by users and dentists in family health strategy centres of the extent of primary healthcare attributes in oral health services, Curitiba, 2011 (n=450 U, n=79 D)

Table 4

Assessment by users and dentists in conventional healthcare of the extent of primary healthcare attributes in oral health services, Curitiba, 2011 (n=450 U, n=124 D)

It is interesting to note that the mean values respectively assigned by users and by dentists in FHS units to the attributes accessibility (5.98 and 5.94) and family orientation (7.96 and 8.07) were nearly equivalent. In contrast, the scores given to the attributes continuity of care (7.61 and 7.11), information system (8.68 and 7.93) and clinical comprehensiveness (7.56 and 6.75) by users were higher than those given by dentists. The mean value of overall score for PHC was 7.53 for users and 7.56 for dentists at FHS, whereas the essential score was statistically higher for users (7.32) than for dentists (7.06), as shown in table 3.

Analysis of users’ and dentists’ perception of oral health services in CHC revealed statistically significant differences for some of the attributes analysed. Respectively, users assigned higher mean values than did dentists to the essential attributes continuity of care (6.96 and 6.59), information system (7.39 and 7.02), comprehensiveness (6.75 and 6.31) and clinical comprehensiveness (7.35 and 6.68). In contrast, the attributes family orientation (6.49 and 6.80) and community orientation (6.68 and 7.19) had significantly lower mean values when assessed by users than when assessed by dentists, respectively. The attributes accessibility, expanded comprehensiveness and cultural competence were equivalent for users and dentists (table 4).

The assessments of essential score (6.54 and 6.41) and overall score (6.61 and 6.68) were nearly equivalent for users and dentists in CHC, respectively (table 4). When responses for users in units associated with the FHS and those with CHC were compared, better results for all attributes were observed for oral health services implemented in the FHS, as shown in figure 1.

Figure 1

Comparative assessment of primary healthcare attributes in family health strategy and conventional healthcare services for the users category of study participants, Curitiba, 2011.

Discussion

This study showed that summary measures such as essential and general scores indicate that the oral health services investigated are generally compatible with the attributes of good PHC. However, there is a need for changes to be made in the work process of PHC dental services. This is particularly evident in the scores for some essential PHC attributes, such as affiliation and accessibility, in which improvement must be emphasised.

It is paradoxical that the FHS was introduced in Curitiba to improve access to health services but it has proved ineffective in guaranteeing this right in the case of dental services. Inadequate access to a dentist conflicts with the Brazilian Constitution of the Federative Republic of Brazil, which states that health is a universal right,13 a controversial issue at a time of economic crisis in various countries but the goal of historic struggles in Brazilian society.

Affiliation denotes the quality of patient follow-up. This attribute assesses whether there a professional present who is responsible for serving patients or whether there is a health service available that is tailored for them when they are sick or need health advice. Similarly, there are several reasons for barriers of access to oral health services and utilisation rates, such as a sufficient supply of services and geographical, cultural and functional accessibility. Sociodemographic factors, scheduling services to meet adult workers’ needs, distance to the healthcare facility, perceived needs, as well as personal beliefs and an emphasis on oral health are influences to be considered in the discussion of accessibility.10 28

For the continuity of care, the dentists who participated in the study seem to not treat users based merely on their complaints during a consultation but consider them as a whole and seek to follow patients over time, a desirable condition for oral health. The coordination/integration of care and coordination/access to the information system indicate that the services control access to specialised services. There is an institutional regulation preventing users from seeking these services directly and requiring them to be seen in the PHC units first. We also found that PHC users and dentists have satisfactory access to patients’ dental/medical records, which is important for the maintenance of oral health and follow-up of any procedures carried out.

The comprehensiveness attribute was evaluated positively by dentists and users. A comprehensive list of services or guidelines that people may need at some point includes promotion, prevention, cure and rehabilitation. Some services may not be offered within the PHC units but patients are referred to specialists and hospitals instead. Comprehensiveness is central to the guidelines of the SUS and should be on the agendas of public health managers and dentists as they seek to build a more equitable society by providing integral services for all.19 29 The greater extent of this attribute in FHS shows that public health managers and oral health teams are progressively adopting the social determinants of health model, which is part of a set of public policies that seek to reduce health inequalities in many countries.7 30 31

The overall performance of the FHS and CHC in terms of derived PHC attributes (family orientation, cultural competence and community orientation) was assessed positively by users and dentists. This indicates support for oral health policies that endeavour to develop inclusive and contextualised health services at the local level. If these attributes are satisfied, there is greater potential for users to establish links with and have confidence in PHC teams. This finding contrasts with the results of Lewis et al,29 who found that people do not attach much importance to PHC services, preferring instead the services of specialists because of their perceived greater ability to solve patients’ problems.

The finding that FHS units were assessed better than CHC by users and dentists lends support to the municipal government’s decision to implement the FHS in 1994, with a view to providing a new basis for the work of dental teams and a positive new focus on the oral healthcare model.

The study has strengths and limitations. It uses an instrument validated internationally and with cross-cultural validation for Portuguese. In this research, we worked with PCATool in a scenario of primary care services that includes oral health. Therefore, we did an innovative study applying the PCATool in the context of oral health. Because it is a cross-sectional study, the limitations include the difficulty in establishing causal relationships. The tool is based on reports of subjective self-perception about primary care services rather than clinical observation; therefore, the outcomes do not allow a direct measurement of the possible benefits in clinical terms. In addition, research addressing the degree of patient satisfaction often reports good levels of satisfaction with the available health system, even when the observed quality is very low. This does not appear to be the case as the scores obtained from the patients were not disproportionately different from those given by the dentists. Additionally, both groups agreed to assign a low score to the accessibility attribute. It has to be emphasised the research findings that placed the FHS scores always higher than the CHC model, revealing consistency in the responses of the two groups of respondents.

By identifying the presence and extent of PHC attributes in oral health services, this study can be expected to help researchers, public health managers and dental teams to improve oral health services.

Conclusions

The results reveal a reasonable level of attainment of PHC attributes in the services investigated. Nevertheless, public health managers should make efforts to reduce the difficulties faced by users in accessing dental care. The more positive results achieved by FHS services indicate that the provision of oral healthcare under this strategy should be expanded.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.

Footnotes

  • Patient consent for publication Not required.

  • Contributors ACN conceived the study, conducted the acquisition of data and approved the final version to be published. STM helped design and interpret the study, revised the manuscript critically for important intellectual content and approved the final version to be published. RIW analysed and interpreted the data, drafted the work and approved the final version to be published. SJM conceived the study, revised the manuscript critically and approved the final version to be published. MCLG drafted the work, revised the manuscript critically and approved the final version to be published.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Ethics approval This study was approved by the Research Ethics Committee at the Pontifícia Universidade Católica do Paraná (prot. no. 3646/09).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement There are no additional unpublished data from the study.