Article Text

Download PDFPDF

Original research
Effect of a dementia education intervention on the confidence and attitudes of general practitioners in Australia: a pretest post-test study
  1. Ron Mason1,
  2. Kathleen Doherty1,
  3. Claire Eccleston1,
  4. Margaret Winbolt2,
  5. Marita Long1,
  6. Andrew Robinson1
  1. 1Wicking Dementia Research and Education Centre, University of Tasmania, Hobart, Tasmania, Australia
  2. 2Australian Centre for Evidence Based Aged Care, La Trobe University, Melbourne, Victoria, Australia
  1. Correspondence to Dr Ron Mason; ron.mason{at}utas.edu.au

Abstract

Objectives This study assessed the impact of a Dementia Education Workshop on the confidence and attitudes of general practitioner (GP) registrars (GPR) and GP supervisors (GPS) in relation to the early diagnosis and management of dementia.

Design Pretest post-test research design.

Setting Continuing medical education in Australia.

Participants 332 GPR and 114 GPS.

Interventions Registrars participated in a 3-hour face-to-face workshop while supervisors participated in a 2-hour-modified version designed to assist with the education and supervision of registrars.

Main outcome measures The General Practitioners Confidence and Attitude Scale for Dementia was used to assess overall confidence, attitude to care and engagement. A t-test for paired samples was used to identify differences from preworkshop (T1) to postworkshop (T2) for each GP group. A t-test for independent samples was undertaken to ascertain differences between each workshop group. A Cohen’s d was calculated to measure the effect size of any difference between T1 and T2 scores.

Results Significant increases in scores were recorded for Confidence in Clinical Abilities, Attitude to Care and Engagement between pretest and post-test periods. GPR exhibited the greatest increase in scores for Confidence in Clinical Abilities and Engagement.

Conclusions Targeted educational interventions can improve attitude, increase confidence and reduce negative attitudes towards engagement of participating GPs.

  • medical education
  • confidence and attitudes
  • dementia diagnosis
  • general practitioners
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • The sample of registrars and supervisors is representative of the broader general practitioner (GP) population in Australia.

  • While the GP registrars’ workshop was compulsory, this was not the case for GP supervisors; thus, self-selection bias is possible.

  • Confidence, attitudes and engagement were measured via General Practitioners Confidence and Attitude Scale for Dementia, a validated tool.

  • While each of the subscales included items relating to early diagnosis, the survey did not fully capture attitudes towards disclosure or perceived self-efficacy regarding communication.

Introduction

General practitioners (GPs) are central to the early diagnosis and management of dementia.1 Early diagnosis provides the opportunity for patients, carers and family to be informed about the condition, its prognosis, treatment options and support2 3 and allows the patient to plan for their future and be active participants in decision-making.4 5

Obstacles to timely diagnosis and intervention may include a lack of diagnostic tests/certainty6 and lack of confidence in diagnostic skills and management,7 while negative attitudes towards diagnosis, disclosure and treatment8–10 may also affect diagnosis rates. Further, stigma may delay recognition and diagnosis through concealment, minimisation or dismissal of early signs and symptoms.11 Patients often present with co-occurrent conditions, further complicating the clinical picture.3 12

It is estimated that one-third of GPs lack confidence in their diagnostic skills, while two-thirds lack confidence in the management of behaviours associated with dementia,7 or feel they have little or nothing to offer patients presenting with dementia,13 with a third of GPs failing to routinely disclose the diagnosis.7 14 15 Similarly, pessimism surrounding dementia prognosis, and inability to offer curative treatment16 may lead to an attitude of ‘therapeutic nihilism’ among GPs,7 11 which reflects a biomedical definition of treatment and an ethos centred around curing people,16 while simultaneously ignoring therapeutic interventions that may benefit people with dementia and their carers.17–19

Illiffe et al argue that low rates of dementia diagnosis are a result of knowledge and skills deficits and failure to transfer acquired knowledge into clinical practice.9 Relatedly, Boise et al state that attitude rather than knowledge is a key determinant of whether a GP undertakes a full assessment,2 and others argue that the diagnostic and management practices of GPs towards dementia may be significantly affected by underlying beliefs and attitudes.20 21 While social psychological theory suggests a relationship between perceptions of self-efficacy, effort and avoidance,22 GPs hesitancy to diagnose dementia may not be explicit. Rather it may manifest in a reluctance to formalise a diagnosis or preferentially treat co-occurring conditions for which treatment options are available,10 23 referring on because of limited treatment options,24 questioning the (traditional) role of the GP in treating dementia25 or having insufficient resources.15

Changing attitudes towards the early diagnosis of dementia has been identified as a significant task for medical educators, with the key to countering such attitudes being targeted educational campaigns.26 Moreover, evidence suggests that the focus of GP training around dementia should encompass more than knowledge acquisition and aim to improve confidence and attitude.27 While GP attitudes toward caring for people with dementia have been shown to be positive,28 fear of misdiagnosis6 and lack of confidence in diagnostic and dementia management skills have been reported to be of particular concern in multiple studies with a lack of effective education and training frequently cited as an underlying cause.7 21 29

Comprehensive dementia education for GPs should include epidemiological knowledge, communicating a diagnosis, symptom management and support services for patients and their carers.30 31 Tullo and Allan32 emphasise the importance of personhood, quality of life and communication with patients,32 while Phillipson et al33 argue that training interventions should place an emphasis on the slow progression of the condition, the treatments available and maintenance of quality of life.33

In Australia, GPs typically are trained in an apprenticeship model with a key aspect of training involving experienced GPs (supervisors) providing support to the GP registrar (GPR) within a general practice setting. Supervisors facilitate registrar learning through identifying learning needs, encouraging reflective learning and practice, guiding access to resources, providing advice on applying knowledge to specific patient cases and role modelling interactions with patients (22).

Tailored training workshops were developed specifically to augment this interaction and address dementia specific training needs. Directed at both supervisors and GPRs, we have previously shown them to be effective in improving dementia knowledge.34 Here, we examine the impact of these workshops on attitudes and confidence towards dementia with a view to improving management of dementia in general practice.

Method

Study aims and design

In Australia, GPRs are required to engage in a learning programme consisting of a number of learning units conducted by regional training providers in each state. ‘The Recognising, Diagnosing and Managing Dementia in General Practice’ workshop was developed by the Wicking Dementia Research and Education Centre as a response to the expressed absence of appropriate dementia related content in GPR training programme. Training was conducted at regional training offices in six Australian states (Tasmania, New South Wales, Victoria, Queensland, Australian Capital Territory and South Australia). The GPR workshop consists of a 3-hour face-to-face presentation delivered by medical educators focusing on (1) recognising and diagnosing dementia and (2) managing dementia in general practice. The supervisors’ workshop, also conducted face to face and for similar durations, is a modified version of that delivered to registrars in that it seeks to support supervisors to teach registrars the diagnosis and management content provided in the registrar programme (see Tierney et al34), with a more in-depth coverage of some aspects of dementia diagnosis and management in the registrars’ workshop than in the supervisors workshop.

A strong focus on providing a framework for decision-making for the recognition, diagnosis and management of dementia is complemented by tools and resources that are aimed at improving both diagnostic capacity and providing ongoing care and support for people with dementia and their family and/or carers. In an attempt to address GPs reluctance to diagnose dementia,12 there is a strong focus on highlighting lived experience in order to situate people with dementia and their carers as central to the process, and to consider diagnosis and management through a biopsychosocial lens.35 36 The intent is to facilitate GPs to engage with the process of diagnosis and associated management in a timely and supportive fashion.

Sampling and participants

Purposive sampling methods were employed to recruit participants from 18 dementia education workshops conducted in six Australian States between 2014 and 2018. Lists of GPs attending the GP registrar and supervisor workshops were provided by each regional training organisation and used as the sample frame for each region. The list comprised the GP’s name and a unique ID number to ensure that each presurvey and postsurvey matched with the individual.

The sample comprised two cohorts; those who undertook the GP registrars workshop (n=355) and those who undertook the supervisors workshop (n=121). Of these groups, 332 GPRs and 114 supervisors completed the survey, representing a response rate of 93% and 94%, respectively. The GPR workshop comprised recently graduated GPs (GPR) who were undertaking vocational training within a general practice setting, while the supervisor group comprised medical educators (n=9), supervisors (n=87) and GPs (n=18).

Process and measures

The workshop was evaluated using a pretest post-test framework which employed two measures. Changes in knowledge of dementia were assessed using the Dementia Knowledge Assessment Survey (see Tierney et al34). This paper reports the second arm of the evaluation which used the General Practitioners Confidence and Attitude scale for Dementia (GPACS-D) survey37 to evaluate the impact of the workshops on confidence and attitudes.

The GPACS-D comprises three subscales: Confidence in Clinical Abilities (six items), Attitude to Care (six items) and Engagement (three items); and is validated using confirmatory factor analysis.37 The GPACS-D is a reliable and valid measure of attitude and confidence change before and after targeted dementia education. A Likert scale is employed scoring from 1 (strongly agree) to 5 (strongly disagree). Total subscale scores are standardised with a minimum score of 1 and a maximum score of 5 so that comparisons can be made between subscales.38 The scoring system is described in detail in the study by Mason et al.37

A research assistant not associated with delivery of the workshop administered the surveys. Pretest surveys were provided to each participant as they signed in along with an information sheet about the research. Attendees were informed that survey completion was entirely voluntary and that completion implied consent. Participants completed the surveys immediately before (T1) and immediately after (T2) the workshop, with each presurvey and postsurvey matched via the unique ID for each attendee.

Ethics approval

The Tasmania Social Sciences Human Research Ethics Committee (University of Tasmania) reviewed and approved this study (reference number: H0012046).

Patient and public involvement

There was no patient or public involvement in this study.

Analysis

We were interested in the impact of the respective workshops on GPRs and GP supervisors. We hypothesised that the supervisor group would differ from the GPR group in attitude and confidence given their experience as practising GPs.

Descriptive statistics were generated for demographic characteristics. Means and CIs were calculated for subscale scores and the individual items that made up each of the subscales, for both registrar and supervisor groups. We conducted t-tests for independent samples to identify differences between groups, while t-tests for paired samples were used to identify any significant differences in scores for each group between T1 and T2. t-tests are robust to violations of assumptions of normality.39 40 We applied Levene’s test of equality of variance to establish homogeneity of variance. Adjusted ‘p’ values were reported where heterogeneity of variance was identified.

Cohen’s d was calculated to measure the effect size of any observed difference between T1 and T2 scores for each group with d=0.2 equivalent to a ‘small’ effect size, 0.5 a ‘medium’ effect size and 0.8 or above a ‘large’ effect size.41 All data analyses were conducted using SPSS (V.22).

Results

Four hundred and forty-six respondents were included in the analysis comprising 332 attendees at GPR workshops (the GPR group) and 114 attendees from the supervisor workshop (the supervisor group; table 1). Supervisors were significantly older than GPRs (t(414)=21.121; p<0.001), and more had undertaken prior dementia education (χ²=20.263; p<0.001), although this proportion was small for both groups. More supervisors had provided professional care to someone with dementia than GPRs (χ²=11.294; p=0.001), while similar proportions of both groups had a family member with dementia.

Table 1

Sample characteristics—mean age and frequencies for gender, dementia training, providing professional care and family member with dementia

We compared age and gender in our sample (GPACS-D) with other samples containing registrars and or supervisors to gauge the representativeness of our sample. These included: The General Practice Supervisors Australia Survey (2017)42 for Supervisor characteristics, and The Australian General Practice Training Program Survey (2018)43 and Registrars’ Clinical Encounters in Training (2018)44 for Registrars. An examination of these samples revealed that the GPACS-D sample is broadly representative of the GP population. A slightly larger proportion of females was found in the supervisor group in the GPACS-D sample, while minimal differences emerged for age in both registrars and supervisor groups.

The GPACS-D assessed the impact of each of the workshops on three constructs: Confidence in Clinical Abilities, Attitude to Care and Engagement.

Items in the Confidence in Clinical Abilities subscale reflect a GP’s perception of their capacity to diagnose, treat and manage dementia. Analysis of scores for each of the items comprising this subscale is shown in table 2.

Table 2

Confidence in clinical abilities

While both GPRs and supervisors were significantly more confident after the workshops, supervisors were significantly more confident in their clinical abilities than GPRs both before (t(438)=8.424; p<0.001)) and after their respective workshops (t(420)=5.328; p<0.001). GPRs exhibited a significantly greater improvement in score than supervisors (t(414)=3.797; p<0.001). The effect size of the change in Confidence in Clinical Abilities was strong for both groups and greatest for GPRs.

Before the workshop, only 13.8% of GPRs were ‘confident (either strongly agreed or agreed) in their ability to diagnose’ compared with 44.2% of supervisors, rising to 60.4% for GPRs postworkshop (62.6% post for supervisors). A similar change occurred in the confidence of GPRs in their ‘ability to provide appropriate medical care’, with an increase in agreement (those strongly agreeing or agreeing) from 18.7% to 59.8% after the workshop. Further, only 13.8% of GPRs agreed or strongly agreed that they were confident in ‘providing advice about managing dementia-related symptoms’ preworkshop, compared with 48.5% of supervisors (8.8% strongly agreed), increasing to 56.3% postworkshop for GPRs (9.5% strongly agreed) and 67% for supervisors (27.4% strongly agreed).

Attitude to Care

Items in the Attitude to Care subscale reflect aspects of the provision of care for patients and their families. Analysis of scores for each of the items comprising this subscale is shown in table 3.

Table 3

Attitude to Care

Overall mean scores for Attitude to Care (table 3) were equivalent for supervisors and GPRs prior to the workshops and increased significantly for both GPRs and supervisors following the workshop, with moderate effect sizes for the increases. GPRs scored significantly higher than supervisors postworkshop (t(420)=2.463; p=0.014).

Both groups reported significant increases in agreement that ‘early detection of dementia benefits the patient’, though the effect size for supervisors was weak. The greatest difference reported was for those strongly agreeing, with a 30.6% change for GPRs (47.3% preworkshop to 77.9% postworkshop), and only an 18% increase for supervisors (44.2%–62.6%). Similar results were obtained for the item ‘Patients with dementia should be informed early so they can plan for the future’, while both GPR and supervisor groups recorded increases in those agreeing or strongly agreeing that ‘it is important that relatives/family/carers of dementia seek external support’.

Engagement

Engagement measures a GP’s perceptions towards treating dementia, and includes fear of communicating a diagnosis, frustration in managing dementia and a preference for treating other conditions (table 4). Both supervisors and GPRs recorded a significantly higher score for Engagement postworkshop, while supervisors reported greater Engagement than GPRs at baseline (t(439)=5.877; p<0.001) and after the workshop (t(422)=5.091; p<0.001). A moderate effect size was observed for the score change shown for each group.

Table 4

Engagement

Both supervisors and GPRs showed an increase in the proportion disagreeing or strongly disagreeing with the statement that ‘dementia was frustrating to manage’ (19.5%–39.4% for GPRs; 31%–50.5%). However, a significant proportion of both groups were still undecided about this statement post workshop (GPRs 33.1%; 19.6% supervisors).

The proportion of GPRs agreeing or strongly agreeing to a ‘preference for treating other diseases’ decreased from 32% preworkshop to 18.6% postworkshop, compared with 18.6%–10.3% for supervisors. However, a large proportion of each group were neutral to the statement before and after the workshop, with a decreased proportion of supervisors (42.5% pre, 32.7% post) and a relatively unchanged proportion of GPRs (38.1% pre, 39% post) reporting neutral views on this item.

Discussion

This study examined the impact of tailored dementia education workshops on the attitudes and confidence of both GPR and GP supervisors towards dementia. Attending tailored workshops resulted in significant improvements in attitudes, confidence and engagement of both groups. While increased confidence and reduced negative attitudes towards the management of dementia have previously been reported to correlate with a self-reported history of prior dementia training,17 this study demonstrates a direct and immediate impact of a training intervention.

In some respects, the positive Attitude to Care at baseline was not surprising given that GPs are reported to have a positive attitude with respect to their role in providing care and early diagnosis for people with dementia.28 45 However, the further improvements in this subscale shown after the workshop highlight the effectiveness of the workshop’s focus on early warning signs and on the importance of diagnosis and management approaches, all of which are intended to influence participants to more effectively engage people with dementia and their families. These results suggest that workshop attendance is useful in preparing GPR for practice and may enhance practice in experienced GPs who act as their supervisors.

The confidence of the GPR group, while not as high as supervisors, significantly improved postworkshop, although from a notably low level. This improvement provides insight into the importance of targeting education beyond the traditional biomedical focus typical of much medical education,16 often with minimal focus on therapeutic interventions.17–19 Differences in pretest confidence between the cohorts are not surprising given GPRs are generally younger and less experienced.21 The greater magnitude of change for GPR in this study would suggest that elements restricted to the registrars’ workshop, and perhaps in particular elements that teach skills in diagnosis, provision of appropriate medical care and management of dementia-related symptoms, may particularly impact on confidence, again highlighting its applicability to GP specialty training.

However, it is interesting that only 44% of supervisors reported confidence to diagnose dementia preworkshop, rising to only around 60% postworkshop. Similar findings were evident in the items related to confidence providing advice and appropriate medical care. It was also notable that at both preworkshop and postworkshop periods registrars had more positive attitudes about the benefits of early diagnosis than supervisors. This finding may be influenced by the supervisors’ underlying beliefs and attitudes,20 21 which in turn may delay diagnosis in practice, particularly given attitudes rather than knowledge have been identified as a key determinant of whether a GP undertakes a full assessment.2 Addressing these gaps is essential if GP supervisors are to effectively support GP Registrars to develop their dementia diagnostic and management skills in the clinic in the context of the apprenticeship model of GP training used in Australia.46 47

A positive impact on engagement was also observed, with both groups recording significantly improved scores after each of the workshops. The higher scores for the GP supervisors group may in part reflect their level of exposure and experience to dementia. However, it is concerning that preworkshop only 31% of supervisors disagreed with the statement ‘dementia is frustrating to manage’, with 19.5% of GPRs disagreeing. While these scores improved post workshop, this does suggest a high level of frustration.38 Indeed, the literature suggests GPs’ perceptions of their capacity to diagnose, communicate a diagnosis and manage dementia may impact on the extent to which they engage with a person with suspected or actual dementia or how much effort they apply to it.38

Of note, GPRs commenced the workshop with a low likelihood of having experienced any prior dementia training, despite 87% having provided professional care to people with dementia. This lack of training has implications for the GPs’ knowledge of dementia, as we have previously demonstrated.1 Results reported recently suggest that particularly for GPRs, the workshop increases their base knowledge of dementia.1 It is possible that this is related to their increased confidence levels as demonstrated in this study. Educational and health literature indicates that knowledge is typically correlated with both attitudes and perceptions of self-efficacy.48 Taken together, the positive impacts of these workshops may translate to improved diagnosis rates and/or support to people with dementia.

It is clear that effective educational interventions involve more than knowledge and skills acquisition.27 In particular, designing educational initiatives requires a cognisance of clinical issues and the values, attitudes and experiences of those being trained. In this context, findings from this study can be used to identify specific components of attitude and confidence that may be able to be targeted in future workshops. This point is especially important given the importance placed on attitudes in relation to how a GP approaches dementia. GPs tend to be knowledgeable about dementia,9 26 but low rates of diagnosis persist,10 suggesting that more than simply knowledge is involved, and that a GP’s attitude towards the benefits of diagnosis, support and management is essential for effective clinical practice.

In consideration of this, educational interventions should aim to change the way GPs view dementia and their role in managing the condition. Such interventions should support GP’s adoption of therapeutic approaches to treatment and management rather than a purely medical one with a curative focus, with the overall aim of increasing engagement between the GP, the person with dementia and their families or carer.

While this study provides insights into confidence and attitudes as these relate to the diagnosis and management of dementia and the effectiveness of educational interventions on confidence and attitudes, there were some limitations. For supervisors, there was the likelihood of self-selection bias given that they volunteered for the workshop. For participating registrars, the workshop was a part of their compulsory training programme.

The study design was pre and post, measuring impact of the workshop. It is possible, as with any pre–post survey research, that response bias may have resulted from the perceived need for socially desirable responses on the part of the participant. However, there were no incentives for bias, survey responses were anonymous, and items were non-leading.

Our study was focused on the immediate impact of the workshops on the confidence and attitudes of participants. Future research should focus on providing evidence of the impact of the workshop on changes in behaviour as it relates to the diagnosis and management of dementia. Additionally, communication has been identified as a crucial part of the diagnostic procedure. While we did address some aspects of communication, survey items did not fully capture the construct37; therefore, more work is required in this area given its importance in relation to providing a diagnosis and the doctor–patient relationship.

Conclusion

Targeted educational interventions can improve attitude, increase confidence and reduce negative attitudes towards engagement of participating GPR and supervisors. Findings highlight a clear need for GPs to have access to targeted workshops especially given the growing numbers of people with dementia.

Acknowledgments

The authors would like to acknowledge the significant contribution made by Dr Amanda Lo in developing the GP workshops.

References

Footnotes

  • Contributors Study design: MW and AR. Data collection: RM. Data analysis and interpretation: RM, KD and CE. Drafting the article: RM. Critical revision of the article: all authors. Final approval: all authors.

  • Funding This project was funded by the Australian Government Department of Health through the Victorian and Tasmanian Dementia Training Study Centre (DTSC) until 2016 and then Dementia Training Australia (DTA) from 2016. The study design was developed by the Wicking Dementia Research and 29 Education Centre (WDREC) and submitted to the funder (DTSC and DTA) for approval. Data collection, analysis, interpretation and reporting were undertaken by the WDREC in partnership with Margaret Winbolt from La Trobe University, who was Director of the DTSC and is the Director of DTA. All authors had full access to all the data (including statistical reports and tables) in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis.

  • Competing interests None declared.

  • Patient consent for publication Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data availability statement No data are available. The data set is not available as ethics approval does not allow release.