Article Text

Download PDFPDF

Supporting the provision of pharmacy medication reviews to marginalised (medically underserved) groups: a before/after questionnaire study investigating the impact of a patient–professional co-produced digital educational intervention
  1. Asam Latif1,
  2. Justin Waring2,
  3. Li-chia Chen3,
  4. Kristian Pollock1,
  5. Josie Solomon4,
  6. Nargis Gulzar5,
  7. Sulma Gulzar6,
  8. Emma Anderson7,
  9. Shahida Choudhary1,
  10. Nasa Abbasi8,
  11. Heather J Wharrad1,
  12. Claire Anderson9
  1. 1 School of Health Sciences, University of Nottingham, Nottingham, UK
  2. 2 Health Services Management Centre, University of Birmingham, Birmingham, UK
  3. 3 Department of Biomolecular Science, University of Manchester Institute of Science and Technology, Manchester, UK
  4. 4 School of Pharmacy, University of Lincoln, Lincoln, UK
  5. 5 School of Pharmacy, De Montfort University, Leicester, UK
  6. 6 The Westgate Practice, South East Staffordshire and Seisdon Peninsular CCG, Staffordshire, UK
  7. 7 Centre for Pharmacy Postgraduate Education (CPPE), University of Manchester, Manchester, UK
  8. 8 Queen's Pharmacy Centre, Nottingham, UK
  9. 9 School of Pharmacy, University of Nottingham, Nottingham, UK
  1. Correspondence to Dr Asam Latif; Asam.Latif{at}nottingham.ac.uk

Abstract

Objectives People who are marginalised (medically underserved) experience significant health disparities and their voices are often ‘seldom heard’. Interventions to improve professional awareness and engagement with these groups are urgently needed. This study uses a co-production approach to develop an online digital educational intervention in order to improve pharmacy staffs’ intention to offer a community pharmacy medication review service to medically underserved groups.

Design Before/after (3 months) self-completion online questionnaire.

Setting Community pharmacies in the Nottinghamshire (England) geographical area.

Participants Community pharmacy staff.

Intervention Online digital educational intervention.

Primary and secondary outcome measures The primary outcome measure was ‘behaviour change intention’ using a validated 12-item survey measure. The secondary outcome measure was pharmacist self-reported recruitment of underserved groups to the medication review service.

Results All pharmacies in the Nottinghamshire area (n=237) were approached in June 2017 and responses were received from 149 staff (from 122 pharmacies). At 3 months (after completing the baseline questionnaire), 96 participants (from 80 pharmacies) completed a follow-up questionnaire, of which two-thirds (n=62) reported completing the e-learning. A before/after comparison analysis found an improving trend in all the five constructs of behaviour change intention (intention, social influence, beliefs about capabilities, moral norms and beliefs about consequences), with a significant increase in mean score of participants’ ‘beliefs about capabilities’ (0.44; 95% CI 0.11 to 0.76, p=0.009). In the short-term, no significant change was detected in the number of patients being offered and the patient completing a medication review.

Conclusions Although increases in the numbers of patients being offered a medication review was not detected, the intervention has the potential to significantly improve pharmacy professionals’ 'beliefs about capabilities' in the short-term. Wider organisational and policy barriers to engagement with marginasied groups may need to be addressed. Future research should focus on the interplay between digital learning and practice to better identify and understand effective practice change pathways.

  • Pharmacy Medicines Use Review (MUR)
  • Co-production
  • Digital educational intervention
  • medically underserved
  • Behaviour change intention

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • To our knowledge, this is the first study investigating the impact of a co-produced digital educational intervention for pharmacy professionals to improve the offer of a pharmacy medicine management to marginalised groups.

  • Out of the original sample, 33 pharmacies declined to take part in the study. It is not known whether there were perceived barriers to e-learning or institutional indifference to addressing inequities in health.

  • It is unknown whether participants completed the e-learning as intended or to what extent the digital learning accommodated different learning preferences.

  • It is also unclear whether professional ‘belief about capabilities’ were sustained beyond 3 months.

  • This study relied on self-reports of intention measures, as well as the number of patients engaged, so the actual recruitment and engagement with the underserved communities are not known.

Introduction

The right to physical and mental health is a universal human right.1 However, in practice, vulnerable people, particularly those belonging to marginalised or ‘medically underserved’ groups (eg, people with disabilities; people from black, Asian and minority ethnic backgrounds; the homebound; the homeless; and people with mental illness), can often face significant obstacles to receiving even basic healthcare.2 3 Consequently, they experience higher rates of disease and ill-health and find accessing and navigating health and screening services more challenging when compared with the general population.3–6

Research indicates that people from medically underserved groups encounter poorer patient-professional communication7 and sometimes racism or cultural bias.8 9 They also have been found to hold strong beliefs that they cannot be helped,10 face discrimination or disempowerment because of their circumstance,11 and are disenfranchised from mainstream primary healthcare.12 Inequitable access to routine or preventative care risks higher rates of emergency admissions13 and consequently increases pressure on emergency care services.14 Addressing inequitable access to health services is a key priority for the UK National Health Service (NHS).15

Strategies using co-production to address health inequalities have received growing professional and political attention in light of a changing patient–provider relationship that sees patients more as ‘partners’ rather than passive recipients of healthcare.16 The co-production concept could be well placed to improve services to medically underserved groups as it acknowledges the value of people’s ‘lived experience’ and recognises that people are well placed to advise on how best services could make a positive difference to their lives.17 Alongside tailoring to patient preferences, the process also acknowledges the input and expertise of front-line healthcare staff.18 Involving patients in service improvement has been suggested to help improve the quality of services delivered and helps redress inequities in service accessibility.19 20 In addition, there is growing literature demonstrating the positive outcome of co-produced e-learning materials designed to improve health professionals’ awareness and confidence to deliver care to vulnerable groups.21 22

We hypothesised that a co-produced digital educational intervention might improve pharmacy professionals’ awareness and engagement with medically underserved groups. This study therefore aimed to evaluate whether such an intervention could improve staff intention to engage with marginalised groups. Our study also sought to measure any impact this may have on the actual provision (numbers of MURs) offered to people who are medically underserved.

The English Medicine Use Review (MUR) service

The ‘MUR’ service, funded by the NHS,23 was commissioned in England and Wales in 2005 and is free to patients. The service seeks to establish a picture of the patient’s medicine use, supports knowledge and understanding of therapy and adherence to treatment. Through this, it aims to resolve medicine-related problems and to address medicine-related concerns to reduce avoidable waste.24 The service is organised as a one-to-one consultation and offered to patients annually. Pharmacists therefore have opportunities to hold detailed, private ‘sit down’ discussions with the patient. These differ from the more routine, limited and brief ‘shop floor’ counselling encounters that occur at the time when medicines are handed to patients.

The NHS provides a fee of £28 for each review performed, with the total number each pharmacy contractor can claim to be subject to a cap of 400 annually. Pharmacists must be accredited through additional training, demonstrating nationally set competencies, before they offer the service.25 Pharmacy support staff are often involved with identifying eligible patients for MURs during the routine labelling and assembling of the patients’ medicines and at times offer the service to patients. However, they are not required and often do not receive formal training about the service.26

Early MUR evaluative work identified significant variability in its delivery, raising questions over their value in improving medicine use.27 28 The annual cap of 400 is often cited as a ‘target’ resulting in pharmacists reports of feelings pressurised due to a commercial ‘quantity driven’ culture.29 30 Consequently, pharmacists appear to invite patients who are either more amenable to the service or who are taking simpler medicine regimes. Although this may lead to patients being recruited easily and their MUR performed conveniently, those with more complex needs may be overlooked.29 30 As a result, some groups, particularly those who may already be medically underserved, may not be offered or may not have access to MURs as often as others.28–30

In attempts to improve the perceived value of MURs, service reforms were made in 2011. These changes specified ‘at-risk’ patient groups from which pharmacists should seek to recruit, for example, patients receiving high-risk medicines (eg, anticoagulants and diuretics), those with respiratory disease or if they have recently been discharged from the hospital.31 Despite moves to encourage the offer and uptake from these at-risk groups, there are still no requirements to recruit people who are marginalised and from medically underserved groups. Over three million MURs conducted in 2017–2018 and over 90% of all pharmacies in England now offering the service.32 Given recent moves to decommission the service, there is a strong case to develop interventions to reinforce a value-based healthservice, to focus NHS resources to those who need them the most and to make services more equitable.33

Methods

Patient and public involvement (PPI)

Several patient support groups were consulted, which shaped the study’s research questions, methodology and design. These included Healthwatch Nottingham (part of Healthwatch England, which promotes local voices in order to influence the delivery and design of health services); The Wayfarer Trust (education institute that runs courses and public events for the Southeast Asian Muslim community); and The Himma Institute (a grassroots community charity providing services to vulnerable people).

An advisory panel for the study was formed, comprising two PPI representatives, who themselves identified with being from an underserved community. The panel met regularly to advise and challenge where necessary, on the study protocol, information to participants and on the digital educational intervention. There was also extensive involvement with patients from marginalised groups in the development of the digital educational intervention.

Digital educational intervention

Through their ease of accessibility, cost-effectiveness and learner flexibility and interactivity, digital learning interventions have been identified for delivering health professional training and improving health-related behaviours.34 35 Learning policies and professional educators have identified digital learning interventions as an effective delivery mechanism to ensure healthcare professional training is relevant and flexible enough to take into account different learning preferences.36–38

The digital learning intervention used in this study took the form of a series of three ‘Reusable Learning Objects’ (RLOs). RLOs are small, pedagogically designed, 'bite-sized' chunks of learning that focus on a specific topic.22 The contents included both visual illustration (eg, videos), interactivities and self-assessments. The intervention was hosted on an online platform accessible online (https://www.nottingham.ac.uk/helmopen/rlos/pharmacy/practice/under-served/). The resource consists of three ROLs that focused on (1) Discovering underserved communities, (2) Exploring medicine experiences and developing empathy, and (3) Effectively interacting and engaging patients.

The resource was developed through a process of co-production. This involved informative semistructured interviews with patients (from marginalised groups) and pharmacy staff, alongside mixed patient–professional workshops. Interviews and workshops first sought to reveal patient stories of belonging to a marginalised community. Then experiences of how they manage medicines were elicited, and finally, strategies that pharmacy staff could use to further engage with them were discussed. To improve face validity, the digital learning resource and study questionnaire were piloted on 10 pharmacy students from the University of Nottingham. Only very minor changes to the questionnaire were made to improve readability. Full details of the development of the digital learning have been reported elsewhere.33 39

Study design

This interventional study used a before/after comparison design and was conducted in Nottinghamshire, England, commencing in June 2017. Full details of the proposed protocol have been published elsewhere.33

Study participants were recruited from community pharmacies and to reduce bias, all pharmacies in the Nottinghamshire geographical area were included. Community pharmacy professionals (pharmacists and supporting staff) who were willing to complete online questionnaires and who were deemed to have ‘active’ involvement with the MUR service were invited. ‘Active involvement’ was defined as being involved with the process of identifying, inviting or undertaking MURs on a day-to-day basis.

After permission was sought from head offices or pharmacy owner/managers, an information sheet and invitation letter were sent via post to each pharmacy that provided the MUR service. At baseline, the online questionnaire was open for 4 weeks. Participants who completed the baseline questionnaire were given access to the digital learning intervention. Participants were offered a £25 gift voucher as an inconvenience allowance for them to complete the surveys; consent to take part was implied through their completion. To assess the impact of the intervention alone, no incentives were provided for participants to complete the digital learning.

To encourage participation, in addition to the postal invitation, pharmacies were contacted up to three times in this period by email or phone to invite them to complete the questionnaire. A follow-up questionnaire was then sent to participants 3 months after they were able to access the digital learning materials. To maximise the response rate, three reminders were sent via email or by telephone.

Data collection

The questionnaire survey was conducted using the Bristol Online Survey system (https://www.onlinesurveys.ac.uk/). Characteristics of participants, including demographics, that is, age, gender, educational achievement and details of any previous MUR training received; characteristics of their pharmacies, such as ownership type (ie, large multiples/supermarket), were initially collected. They were then granted access to the digital learning. Kirkpatrick’s Evaluation Model was used as a framework to guide data collection.40 This model is based on four levels. The first two assess learner satisfaction and change in knowledge or attitude with the training resource. The study aimed to go beyond these to detect higher order changes in levels 3 and 4. The third level describes the changes in behaviour brought about by the training, with the final level measuring the application of the participants’ learning to their practice.

The extent of participants’ behaviour change intention (Kirkpatrick’s level 3) was assessed by a Continuing Professional Development (CPD) Reaction Questionnaire. The CPD Reaction Questionnaire is a 12-item theory-based instrument (online supplementary appendix 1) grounded in the theory of planned behaviour and Triandis theory.41 It is a validated and reliable tool with robust metric properties which has been used to assess the impact of CPD activities on health professionals' behaviour intentions in clinical practice. The 12-item measure was used to compute five constructs relating to behaviour change intention, namely, (1) intention, (2) social influence, (3) beliefs about capabilities, (4) moral norm and (5) beliefs about consequences. Data were also collected on the effect of the CPD on the number of MURs performed on medically underserved groups (Kirkpatrick’s fourth level) before and after the intervention.

Supplemental material

Pharmacists were also asked to record at baseline and at 3 months the number of patients they had recruited from medically underserved groups over the previous 4 weeks. To facilitate recording, the following list of common medically underserved groups was provided:

  • People with disability (eg, physical, visual, hearing and learning).

  • People who are who are homebound.

  • People from Black, Asian and Minority Ethnic (BAME) communities.

  • People with mental health illness.

  • People from the lesbian, gay, bisexual, transgender and queer (LGBTQ) communities.

  • People from the traveller community, people who are homeless, or people who are refugees or seeking asylum.

  • Older people with multiple illnesses and many (>12) medicines.

  • People from any other medically underserved community.

Sample size

A sample size of approximately 60 participants (paired before/after data) was needed to provide 80% power to detect a mean change of 0.44 (behaviour change intention) or greater, assuming the SD is 1.2.

Data analysis

Descriptive statistics were used to summarise demographics and characteristics. Continuous data were presented using means and SD if approximately normally distributed and medians and IQR if non-normally distributed. Categorical data were described using frequencies and percentages.

To assess the effect of the digital learning, baseline scores were compared with follow-up data, which were collected after the intervention period. The changes between the baseline and follow-up test scores were analysed using t-tests if they were found to be normally distributed, and the mean difference and 95% CI were presented. It has been suggested that t-tests are appropriate tests and can be used where responses are recorded on a Likert scale.42 Statistical significance was assessed at the 5% (two-sided) level. All statistical analyses were conducted using IBM Statistical Package for Social Sciences (SPSS) V.24.43

Results

Recruitment of pharmacies and participants

All of the 237 community pharmacies within the Nottinghamshire area were approached to take part in the study. Three pharmacies were ineligible as they were not providing the MUR service, and 33 pharmacies declined to take part due to them being ‘too busy’, being ‘short staffed’, not having ‘enough time’ to complete the learning or questionnaire, or were ‘not interested’. One supermarket chain declined to give permission to contact their pharmacies because they had ‘other educational priorities’ for their pharmacies.

Baseline questionnaire responses (n=149 participants) were received from 122 out of the 201 pharmacies who initially expressed an interest in taking part in the study (response rate=61%). Further to this, 100 participants (67%) from 80 pharmacies completed the follow-up questionnaire. After excluding two of the 100 participants who had no baseline survey (follow-up questionnaire link mistakenly forwarded by a work colleague) and a further two that were found to have duplicate records of the follow-up survey, the adjusted follow-up participant response rate was 64% (96/149) (figure 1).

Figure 1

Flowchart of the study process.

Characteristics of recruited pharmacies and participants

The profile of pharmacies that completed the follow-up questionnaire was found to be similar to those completing the baseline survey, suggesting there was no influence by pharmacy type (table 1). Most pharmacies reported being part of a multiple or classed as an independent, with almost a fifth being co-located within a general practice. Approximately three-quarters of the pharmacies had a single pharmacist on duty with most dispensing between 100 and 400 prescriptions items per day.

Table 1

Comparing the characterises of pharmacies between the baseline survey with the follow-up survey

Approximately half of the 149 participants were female (47%), with a mean age of 37 years. The majority (81%) of participants were pharmacists, with the remainder being dispensers, medicine counter assistants, non-pharmacist managers and preregistration pharmacists (table 2). Most of the participants reported having been in their role for 1–5 years (34%) and having worked on average 31–40 hours per week (44%). Two-thirds of respondents (65%) reported having attempted part of or all the digital learning. Of those who did not complete the resource, the most common reason provided was that they did not have enough time or that the topic of the learning material was not perceived as necessary (table 2).

Table 2

Comparison of the characteristics of participants who completed the baseline survey with those completing the follow-up survey

Concerning the 120 pharmacists, most respondents were either the pharmacy manager (32%) or the branch manager (29%) or described themselves as an employee pharmacist (27%). Almost half (43%) reported being qualified as a pharmacist for 10 years or less and a quarter between 11 and 20 years. Forty-one per cent of pharmacists had been accredited to perform MURs for more than 10 years with most (72%) not having undertaken any further MUR training since accreditation (table 3).

Table 3

Subgroup comparison of the characteristics of pharmacist participants who completed the baseline survey with those completing the follow-up survey

Primary outcome: behaviour change intention

When scores were compared between the five constructs of ‘behaviour change intention’ (baseline vs the end of follow-up), it was found that from the total of 96 participants who had completed both questionnaires, the mean difference of scores improved. However, there was no statistically significant results found between the differences of mean scores before and after the intervention period (table 4).

Table 4

Before/after subgroup comparison of the mean score for the five constructs of ‘behaviour change intention’ between the baseline and the end of follow-up

In the subgroup of the 62 participants who reported completing the digital learning, the improvement of mean difference of the five constructs before and after the intervention period was found to be higher than that of the total 96 participants (table 4). There was a statically significant increase in the construct relating to beliefs about capabilities; the mean difference was 0.44 (95% CI 0.11 to 0.76, p=0.009). No statistically significant differences were observed on the other four constructs.

Secondary outcome: self-reported recruitment of medically underserved groups to the MUR service

Pharmacists were asked to report the total number of MURs undertaken within the last 4 weeks and how many of these patients were from medically underserved groups. The before/after comparison analysis did not detect a statistical significance difference between both within the total sample and the subsample who had completed the digital learning (table 5).

Table 5

A subsample before/after comparison of the pharmacist-reported number of MURs with medically underserved groups

Discussion

Main findings

This study found that a digital educational intervention has the potential to positively influence pharmacy professionals’ ‘beliefs about capabilities’ construct of behaviour change intention. This construct achieved statistical significance, suggesting a possible improvement in professionals’ confidence to interact and engage people from marginalised communities. There was a lack of statistical significance observed for the other four constructs.

The reported high baseline scores for ‘intention’, ‘moral norms’ and ‘beliefs about consequences’ may have been influenced by social desirability or approval bias.44 This may have resulted in a ceiling effect, which meant differences in scores before and after the intervention could not be detected. Given the behaviour being measured was ‘actively engaging with or inviting patients who are underserved for an MUR’, respondents may have been inclined to score themselves highly at baseline because they felt this was the right or ethical thing to do. The final construct ‘social influence’ relates to how the respondents’ peers are perceived. It is well known that pharmacists often feel a notion that there is frequently organisational pressure to undertake MURs resulting in many feeling the service is consequently inefficacious or suboptimal.29 30 This view may explain the lack of change with this construct.

When recruitment from medically underserved groups was examined, statistical differences were not detected at 3 months. There are several practice-based barriers that may have made recruitment from these groups more challenging. First, there is currently no financial incentives to offer the service to such groups that are deemed ‘hard to reach’. For example, there may have been a lack of available resources to provide translation services or a lack of staffing to allow pharmacists to undertake visits to people who are homebound.45 Second, there were low numbers of front-line pharmacy support staff participating in the study, suggesting either lack of interest with the subject or difficulty for the pharmacist-in-charge to adequately engage staff or provide them time to complete the training. With support staff routinely being involved in offering and recruiting patients for MURs, it may have been challenging for pharmacists to enable change without them also completing the digital learning. Third, from a patient perspective, there is evidence that pharmacy services are generally poorly understood and that engagement and understanding of their value are varied or conflicting, with consequences for framing and sense-making.46 These challenges may have been greater given medically underserved groups are not routinely approached or engaged with such services.39 Time may be needed for such marginalised groups to become accustomed to be offered services from the pharmacy.

Other more methodological reasons why there was no detected increase in numbers may have been because of the challenges in identifying patients belonging to these groups (eg, people from the LGBTQ community) or the infrequency in which they present at the pharmacy (eg, people who are homeless). A large-scale trial is needed to ensure sufficient people are recruited to detect differences. It is also not known whether a different outcome may have resulted if respondents could choose to undertake the digital educational intervention at a time that was convenient to them.

Implications

Medication review services has seen significant reconfiguration and investment in light of patient widespread problems taking medicines47 attributed to concerns about dependency, tolerance and side effects.48 49 The community pharmacist workforce is increasingly being deployed, predominantly in developed countries, to promote effective use of medicines.50 51 However, there remains significant challenges to ensure equitable access to these services.

This study has several important implications for pharmacy organisations, educationalists and policymakers. To target more vulnerable groups (who may benefit most from an intervention), there is a need to redress concerns over the lack of perceived effectiveness and cost-effectiveness of MURsand this could represent an opportunity to enhance professional status.52 For educationalists and those offering CPD courses, the co-production approach could ensure greater patient involvement and promote their unique perspective and preferences. Alongside this educational intervention, policymakers may wish to reconsider more funding to encourage scope for future development. In one evaluative study by Latif and colleagues, making additional service costs available to pharmacies to deliver MURs to vulnerable homebound patients potentially led to a reduction in hospital admissions.53

Future research should consider the broader influence that public engagement and health promotion campaigns have at engaging marginalised communities in health services. Strategies are also needed to develop policy reforms to ensure people have more equitable access to care and how system-wide quality improvements can be achieved to proactively increase engagement with communities perceived as being ‘hard to reach’.54

Strengths and limitations

To our knowledge, this is the first study attempting to triangulate findings from self-reported pharmacy professionals’ behaviour change intention and to assess this alongside actual changes in practice. The co-produced intervention sought to include views of both patients and professionals, and the digital format was a feasible means of delivery to pharmacy professionals. There were good baseline responses from pharmacies (61%), which may have been due to the £25 gift voucher incentive, which was made available to participants. However, there were approximately one-third of respondents who did not complete the follow-up questionnaire, and this could have potentially skewed the results. Out of the original sample, 33 pharmacies declined to take part in the study, and out of the 149 participants who completed the baseline questionnaire, just over 40% reported completing the digital learning. The extent to which these numbers reflect barriers to learning or institutional indifference to the issue is not known. Furthermore, this study was conducted in one geographical region. It is unknown to what extent the sample population is representative of other areas or those pharmacies in that are in more remote locations.

There are several other limitations to this study. Regarding study design, this was a before and after study. As Grimshaw et al notes,55 although such designs are relatively easy to conduct and are superior to observational studies, they can be intrinsically weak evaluative designs with non-randomisation making it difficult to attribute observed changes to the intervention. It is also unknown whether participants completed the digital learning as intended, to what extent the digital learning accommodated different learning preferences or whether any behaviour change intention was sustained beyond 3 months.

Regarding aspects of the digital resource which may have influenced participants beliefs about capabilities, we speculate that the final RLO called ‘effectively interacting and engaging patients’ may have had the greatest impact, although we cannot be certain. Lastly, this study relied on self-reports of intention measures as well as the number of patients engaged, so the actual recruitment and engagement with the underserved communities is not known.

Conclusion

The co-produced digital educational intervention was shown to be effective at improving the perceived capabilities of pharmacy professionals towards engaging with the medically underserved. However, this resource alone may not be sufficient to bring about actual practice change. Changes in the organisations and to the policy may also be needed to achieve meaningful engagement and traction with patients who belong to medically underserved groups. This study adds to the continued debate on how best we can make services more equitable in order to tackle health inequalities. In this respect, the study provides a novel approach and information on the feasibility of delivering the educational intervention to pharmacies. Future research should focus on the interplay between the agency, organisation and policy constructs to better identify and understand the barriers to effective practice change.

Acknowledgments

The authors would like to acknowledge and thank all the pharmacy organisations, pharmacists and pharmacy support staff who were involved with the study. We also extend our thanks to Andrea Venn (School of Health Sciences, the University of Nottingham) for her help with the statistical analysis. We are also grateful to our patient and public involvement representatives Mahomed Khatri and Abida Malik. The research was supported by Health Education England (HEE) and National Institute for Health Research (NIHR). The views expressed are those of the authors and not necessarily those of HEE or NIHR.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
  46. 46.
  47. 47.
  48. 48.
  49. 49.
  50. 50.
  51. 51.
  52. 52.
  53. 53.
  54. 54.
  55. 55.

Footnotes

  • Contributors AL is the Chief Investigator (CI) and made substantial contributions to the overall conception, development and design of the study. KP, CA, JW, JS, LC and HW provided guidance on the methodology and direction of the study, specifically on qualitative aspects of the survey (KP, CA and JW), statistical analyses (LC) and pedagogical advice developing the digital learning educational intervention (HW and JS). NG and SC were responsible for data input and data analysis and contributed to the write-up. EA, SG and NA contributed to the logistical aspects of recruitment, including advice on access to underserved communities, study administration and conduct. All named authors contributed to editing and approved the final manuscript.

  • Funding This study is funded by the Department of Health through the Health Education England and National Institute for Health Research Integrated Clinical Academic Programme (grant number ICA-CL-2015-01-008).

  • Competing interests None declared.

  • Patient consent for publication Not required.

  • Ethics approval The study received ethical approval from East Midlands Research Ethics Committee (REC ref: Derby 16/EM/0237) on 15 July 2016, along with full governance clearance through the NHS Health Research Authority.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data availability statement All unpublished data related to this research project are available and can be requested by emailing the Chief Investigator Dr Asam Latif (asam.latif{at}nottingham.ac.uk).