Article Text
PDF
Abstract
Objective To test the impact of feedback on the proposed management of standardised patients presenting with behavioural change with a diagnosis of dementia in Australian primary care.
Materials and methods A video vignette study was performed with Australian general practitioners (GPs) in 2013. Participants viewed six pairs of matched videos depicting people presenting changed behaviour in the context of a dementia diagnosis in two phases. In both phases GPs indicated their diagnosis and management. After phase 1, GPs were offered feedback on management strategies for the patients depicted. Analyses focused on identification of change in management between the two phases of the study. Factors impacting on the intention to coordinate care for such patients were tested in a questionnaire based on the Theory of Planned Behaviour.
Results Forty-five GPs completed the study. There was significant improvement in the proposed management of three of the six scenarios after the intervention. Older GPs were more likely to refer appropriately (OR=1.11 (1.01 to 1.23), p=0.04.). Overall referral to support agencies was more likely after the intervention (OR=2.52 (1.53 to 4.14), p<0.001). Older GPs were less likely to intend to coordinate care for such patients (OR=0.89 (0.81 to 0.98) p=0.02). Participants who felt confident about their ability to coordinate care were more likely to do so (OR=3.79 (1.08 to 13.32) p=0.04).
Conclusions The intervention described in this study promoted multidisciplinary management of patients with behavioural problems with a diagnosis of dementia. Increasing practitioner confidence in their ability to coordinate care may increase the proportion of GPs who will respond to patients and carers in this context. Older GPs may benefit in particular.
- PRIMARY CARE
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
There is evidence that community support services have the potential to improve the quality of care provided for dementia, but are hampered by a lack of referrals from general practitioners (GPs).
Following feedback in relation to standardised patients, practitioners were more likely to suggest management options that were consistent with expert opinion.
A key strength of this study is the presentation of the same cases, in the same way to all GPs.
Limitations of this study include: (1) GPs had no opportunity to interact with the actor-patient—as such, they had no opportunity to negotiate the health problems that required immediate attention with the patient; and (2) they may have offered appropriate treatment or referral during subsequent consultations.
Background
This paper addresses a significant and growing problem affecting the well-being of the population. In Australia where the study was conducted there are more than 320 000 people living with dementia. This number is expected to increase to 400 000 in less than 10 years1 and is expected to be almost 900 000 by 2050, at a rate of approximately one person diagnosed every 6 min.2 The majority of people with dementia live in the community and for approximately 75% of these individuals, care is provided by family and friends.3 Numerous studies report that challenging behaviours are likely to occur during the progression of the disease and caring for a person with dementia is more stressful than caring for a person with a physical disability.4–6
Pearlin et al7 offered a model of caregiver stress that identifies four main areas that contribute to caregiver stress: the background context (such as level of support and impact of other life events); the primary stressors of the illness (such as the level of help required by the patient and behavioural and psychological problems in dementia); secondary role strains (such as family conflict and social life); and intrapsychic strains such as personality, competence and role captivity of the caregiver. Such stress impacts on the quality of life of the carer directly and ultimately also on the well-being of the person with dementia.8 Offering support with understanding and managing behavioural change that may be embarrassing, distressing, annoying or dangerous may alleviate stress in all four areas. It is also possible that the behaviour of the carer may also be a cause for concern.9
In many countries carers are able to seek support from a general medical practitioner. Regardless of the underlying cause of the problem there is significant scope to support the carer by providing information on an ongoing basis, with specific information about services and advice regarding the carer role. 10 However, carers report that too little information is provided about how to deal with behaviours that challenge and how to access support services.11 The healthcare experience of people with dementia and their caregivers is a complex and dynamic process, which could be improved for many people. Understanding these experiences provides insight to potential gaps in existing health services.12 Indeed experts have called for the research emphasis to shift towards the development and evaluation of interventions, particularly those providing support after diagnosis.13
Often the first healthcare professional consulted is the general practitioner (GP). For four key reasons it is challenging to research the interaction between GP and families when they present for advice about behavioural changes in the context of a dementia diagnosis. The timing and demand for such consultations is unpredictable. Participants may find it distracting to have video cameras or audio equipment recording the consult. Getting informed consent from distressed, embarrassed or angry people or where a person with dementia is involved would be challenging and possibly unethical. Finally the outcomes of such consultations would have many confounding variables as doctors, patients, carers and circumstances vary.14 Video vignettes, in which actors present the behaviours of interest, are one way to address these challenges and the aim of this study is to deploy such vignettes to explore the management of people presenting to GPs in the context of a dementia diagnosis.
Methods
Participants were recruited from a network of 150 GPs across Australia who had previously participated in similar video vignette projects. GPs were emailed invitations and these were supplemented with follow-up personal invitations to the invitees who did not initially respond. Participants were remunerated with $A50 for their contribution.
Materials
Twelve video vignettes were developed; six examples of changed behaviour associated with behavioural and psychological symptoms of dementia were each portrayed in a pair of vignettes. Each vignette depicted a patient and their carer with clear indications for specific management, including referral, prescription, reassurance and/or investigation. The vignettes were developed by an expert panel consisting of three GPs, in consultation with a team of behaviour consultants from the Dementia Behaviour Management Advisory Services which is one of the programmes provided through Alzheimer's Australia, Western Australia. The scenarios reflected clinical challenges regularly presented by patients with cognitive impairment to GPs in Australia.6 The expert panel also suggested the management for each case with details of prescription, referral for specialist management, and laboratory investigation (figure 1). The management was proposed and refined through consultation until a consensus was reached from the expert panel. The vignettes were then prepared as short video monologues by the actor-patients. See example in online supplementary video file. The video included an off-camera commentary by an actor-doctor describing relevant signs to be found on clinical examination. Participation in the study was via the internet. Each vignette was accompanied by a patient medical record including the patient's recent history, examination and investigation results. Participants were asked five questions after watching each video vignette:
What is your diagnosis?
Would you prescribe something? If so, what?
Would you refer the patient? If so, to whom?
Would you order tests? If so, which tests?
What would you advise the patient/carer?
Specific recommendations for management of cases (AAWA, Alzheimer's Australia WA; DBMAS, Dementia Behaviour Management Advisory Service).
Participants were provided written feedback in the form of a letter from a specialist clinic, a solicitor's letter or a newspaper report a week after watching the first set of videos. Each of these suggested that the patient in question had experienced harm in the ensuing weeks. For example, the patient who had difficulty driving had been involved in a road traffic accident, the patient with night time wandering had drowned, the patient with side effects of drug treatment was hospitalised, and so on. The letter also offered reference to resources of support to such patients.
The project was completed in three stages:
Phase 1: Participants were invited to view the first set of six videos (Scenarios A) and immediately describe their management of the patient depicted. They then completed a Theory of Planned Behaviour (TPB) questionnaire as described below.
Feedback: Within the subsequent 2 weeks, all participants received feedback on the management of the cases viewed.
Phase 2: All participating GPs were invited to view the second set of six videos (Scenarios B) and again immediately describe their management of the patient depicted.
TPB questionnaire15 ,16: the development of the questionnaire is described in online supplementary appendix 1.
Statistical analysis
Standard descriptive statistics were used to summarise the profile of the participating GPs using Stata V.12.1 statistical software (Texas, USA). The main outcome measure was the proportion of patients (scenarios) appropriately managed in each set of vignettes. Appropriate management was defined as agreement with an expert panel on the diagnosis, referral recommendation, drug management and advice given to the patient or carer. Agreement was assessed separately on the basis of each of these criteria. The main hypothesis was that there would be a difference in management between the two phases of the study, as a result of the feedback received following phase 1.
Thirty GPs would lead to 360 observations (6 vignettes for each GP, preintervention and postintervention). With internal correlations in the data set due to the repeated observations made by each GP, it is difficult to be precise about the minimum sample size required to demonstrate a change in management. However, this number is considerably larger than that required to demonstrate a difference of moderate size among independent observations with 80% power and α=0.05.17 Hence this number of GPs was expected to be adequate for the study. The primary hypothesis was assessed using McNemar's test (univariate test). A logistic regression model was used to assess whether any of the GP demographic variables were associated with appropriate management. The model took into account the correlations between assessments made by the same GP (as a cluster effect using Stata). Initially, a model was fitted to the data including the following variables: (1) demographics of GPs and primary practice, including age, gender, country of origin, years of GP experience, experience level (registrar or consultant), whether they were Fellows of the Royal Australian College of GPs (FRACGP), clinic remoteness, status in the practice (eg, principal/registrar), number of patients seen per week, hours of consultation per week, whether they consulted in English only, number of years since graduation, number of GPs working in the clinic, number of sessions worked per week); (2) study case; and (3) study phase. A backwards elimination strategy was used to identify the most parsimonious model (by dropping the least significant variable, one at a time, until all variables remaining in the model were statistically significantly associated with the outcome). The only exception was that the study case and study phase were retained in the final model regardless of their significance, so that other results could be interpreted after adjustment for these variables.
The results were presented as ORs for appropriate management decisions, along with their 95% CIs and p values. Following convention, a p value <0.05 was taken to indicate a statistically significant association in all tests.
Questions constituting the attitude norm items were assessed for internal consistency using Cronbach's α statistic. A similar logistic regression model was then used to explore variables associated with the GPs intention to coordinate care, using attitude, subjective norm and perceived behavioural control as the independent variables along with the demographic variables.
Results
Forty-five GPs consented to participate and all completed the study. Those who participated in the study were younger than the average GP in Australia, there were more female GPs, more registrars and more Australian graduates. There were more participants from Western Australia and more participants doing fewer hours and seeing fewer patients than the national average (table 1). Overall most participants correctly diagnosed cases in the study's two phases although the proportions correct were quite modest in some cases (table 2). However, in phase 2, fewer recognised the case of sexual abuse and precarious home circumstances than in phase 1. There were some statistically significant differences in the management of cases in phase 1 compared with phase 2 (table 3). Specifically, participants were more likely to refer to support agencies when indicated.
Participant demographic information (n=45)
Appropriate diagnosis of cases per phase of study
Appropriate management of cases by phase of study
Regression analysis modelling factors associated with management that is consistent with expert opinion are shown in table 4. Referral that was consistent with expert opinion was more likely if the participants graduated in Australia, and was also more likely in phase 2 of the study.
Factors associated with management that is consistent with expert opinion
Theory of planned behaviour
Internal consistencies (Cronbach's αs) were calculated for the questions constituting the intention (α=0.72), subjective norms (α=0.71), perceived behaviour control (α=0.63) and attitude norms (α=0.72) dimensions. These values all show good internal consistency.
Only two participants said that they would ‘maybe’ consider coordinating the care of patients with cognitive impairment. These respondents were grouped with those who responded that they would not consider this role (n=16) in the following analysis.
Table 5 shows the ORs and their 95% CIs for coordinating the care of patients with cognitive impairment. Attitudes and behavioural control were positively associated with GPs’ intention to consider coordinating the care of patients with cognitive impairment (p<0.05 in table 5). GPs’ perceived level of difficulty of devising a management plan for these patients or subjective norm were not associated with GPs’ management intention. Older GPs were less likely to consider coordinating the care of such patients.
The OR of difficulty of developing a management plan and TPB scores associated with GPs’ intention to consider coordinating the care of patients with cognitive impairment
Discussion
These data indicate that the management of patients with behavioural problems associated with cognitive impairment who present to GPs can be improved with feedback. The feedback had some medical information but in some cases was simply a note of what might have happened to the patient without any intervention or support that could have been arranged by a GP. Some GPs, notably those who were older, were reluctant to coordinate care for patients in these circumstances. Some felt that care coordination would be ineffective and unrewarding, and they lacked confidence in their abilities in these circumstances. Similar data have been reported in relation to GPs in the UK and Germany.18 ,19 These themes have also been reflected in research from the USA where, in one study, practitioners reported about insufficient time, difficulty in accessing and communicating with specialists, low reimbursement, poor connections with community social service agencies and lack of interdisciplinary teams.20
Interventions to link carers with community support agencies have been shown to have promising results.21 This study found that alerting GPs to potential adverse outcomes, including the medicolegal implications of a failure to act increased the odds of people being referred to supportive agencies in subsequent clinical scenarios. These results are promising in the light of previous evidence that local Alzheimer’s Association chapters have the potential to improve the quality of care provided for dementia, but are hampered by a lack of referrals from GPs.22
In this study the feedback intervention had the greatest effect on referral to supportive agencies. Changes in diagnostic accuracy were mixed. We note that diagnosis is a comparatively ‘hard’ construct that medical training equips doctors to handle. However referral to a myriad of (changing) agencies is less ‘medical’ and therefore more amenable to improvement through education and awareness. Such observations have been reported previously in the literature.23 ,24
Improvements in referral to supportive agencies, if they were reflected in actual clinical practice, would have the potential to reduce adverse incidents and promote better outcomes and satisfaction for patients. For example, in phase1 of this study, in the case of patients with an adverse drug reaction to medication, only 20% of participants referred to a community support agency to support the carer, while in phase 2 this proportion increased to 46.5%. Similar trends towards referral were observed in the other cases (except for those involving financial problems). Referral increases the potential for team work in primary care and makes it more likely that patients can be maintained in the community for longer. The value of medication review, behavioural modifications, and referral to outside services has been underlined in respect to the role of GPs in coordinating the care of people living with dementia.25
A recent literature review reported that two other factors are also likely to be important in the context of cognitive impairment namely, attitudes and beliefs.19 These issues were evaluated by the TPB questionnaire in this study. The responses indicated that a positive attitude to the management of behavioural problems in cognitive impairment and greater confidence in managing such cases made it more likely that participants would choose to coordinate the care of patients in these circumstances. The feedback offered may have increased confidence by identifying the sources of support that may have been overlooked in the management plans as drafted in phase 1of the study.
Strengths and limitations
In a study involving bona fide patients, GPs would be unlikely to consult six patients with carers of people with dementia within the study period. However, a key strength of this research was that all GPs were exposed to the same cases presented in the same way. The use of standardised patients also demonstrated the possibility of harm to patients if the study was observing ‘real’ patients which would have rendered it difficult to complete without intervening. For example, it would have been unethical in research to record poor practice in relation to the patient exhibiting night time wandering because of the significant risk of harm. Second, as the cases were all standardised actor-patients, the GPs were not required to recruit patients and obtain informed consent, therefore data were obtained for all cases. Such advantages have facilitated research with similar challenging scenarios in the past.26 Three limitations also warrant mention. First, there was no doctor–patient interaction. In practice, this may influence management decisions. Second some patients who were not referred to a support agency may have been referred later following investigation by a GP—for example, routine blood tests or infection screens to rule out an organic cause for the altered behaviour. However an exploration of this possibility was beyond the scope of this study. Finally, ideally each of the scenarios would have been randomised so that half the group got Scenario A and half got Scenario B before the intervention. Using the survey platform deployed in this study this idea was deemed impractical and so it is possible that nuances in the scenarios may have had an impact on the observed effect. However we note that not all scenarios in phase 2 were more likely to be correctly diagnosed and so the effect of this confounder is likely to be minimal.
Clinical implications
Feedback to participating GPs promoted management plans that were consistent with expert opinion. However, in some cases, there were still significant numbers of participants who failed to make the correct diagnosis or to suggest treatment plans that reflected expert opinion. In this study it was not clear whether this was because participants disagreed with the expert panel or failed to assimilate the feedback into their later responses in the study. While there was an improvement in referring cases to community support agencies in phase 2 of this study, it would be unsafe to assume this was entirely related to the feedback received after phase 1. Further evidence that such a brief internet-based educational programme may enhance care when supporting actual patients and their carers may be required before it can be unequivocally recommended.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Files in this Data Supplement:
- Data supplement 1 - Online supplement
- Data supplement 2 - Online video
Footnotes
Contributors MJ, PM, PN and GP conceived the project and oversaw the design of the study. XM and RP conducted statistical analyses and analysed the data. VP coordinated the study. MJ and VP oversaw the collection of data and implemented the study. All authors interpreted the data and results, prepared the report and the manuscript, and approved the final version.
Funding This study was funded by the Department of Social Services, Australia.
Competing interests None.
Ethics approval Curtin Human Research Ethics Committee (RD-27-13).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement Extra data can be accessed via the Dryad data repository at http://datadryad.org/ with the doi:10.5061/dryad.qv4bt.