Objective To pilot and feasibility-test supervised final year undergraduate pharmacy student-led medication reviews for patients with diabetes to enable definitive trial design.
Method Third year pharmacy students were recruited from one UK School of Pharmacy and trained to review patient's medical records and provide face-to-face consultations under supervision while situated within the patient's medical practice. Patients with type 2 diabetes were recruited by postal invitation letter from their medical practice and randomised via automated system to intervention or usual care. Diabetes-related clinical data, quality of life, patient reported beliefs, adherence and satisfaction with medicines information were collected with validated tools at baseline and 6 months postintervention. The process for collecting resource utilisation data was tested. Stakeholder meetings were held before and after intervention to develop study design and learn from its implementation. Recruitment and attrition rates were determined plus the quality of the outcome data. Power calculations for a definitive trial were performed on the different outcome measures to identify the most appropriate primary outcome measure.
Results 792 patients were identified as eligible from five medical practices. 133 (16.8%) were recruited and randomised to control (n=66) or usual care (n=67). 32 students provided the complete intervention to 58 patients. Initial data analysis showed potential for impact in the right direction for some outcomes measured including glycated haemoglobin, quality of life and patient satisfaction with information about medicines. The intervention was found to be feasible and acceptable to patients. The pilot and feasibility study enabled the design of a future full randomised controlled trial.
Conclusions Student and patient recruitment are possible. The intervention was well received and demonstrated some potential benefits. While the intervention was relatively inexpensive and provided an experiential learning opportunity for pharmacy students, its cost-effectiveness remains to be determined.
Trial registration number ISRCTN26445805; Results.
- EDUCATION & TRAINING (see Medical Education & Training)
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
The study followed recommendations published by the Medical Research Council for implementation of feasibility and pilot studies.
The intervention was developed with significant stakeholder involvement, a range of primary outcome measures were tested for suitability and the process for collecting resource utilisation data was identified.
Self-selection bias was found within those students who consented to participate.
The trial was unblinded with the service providers, patients and research all aware of group allocation and intervention content.
The large number of statistical tests carried out creates the possibility that findings could be false positives and as this was a pilot and feasibility study which, therefore, used a low power we could potentially fail to detect small to moderate sized effects.
It is estimated that preventable harm from medicines costs the National Health Service (NHS) in England £750 million per year.1 A systematic review in 2009, based on UK research, estimated that only between 4% and 21% of patients achieved the optimum benefit from their medication.2 A systematic review of publications between 1966 and 1999 reported the prevalence of preventable drug-related admissions to hospital as 4.3%.3 Additionally, patients not taking their medicines as agreed with the prescriber has been reported to cost the UK NHS an estimated half a billion pounds a year.4 Consequently, interventions designed to reduce adverse drug events and improve patient medicines-taking behaviours are required.
Medication review (MR) has been defined as ‘a structured, critical examination of a patient’s medicines with the objective of reaching an agreement with the patient about treatment, optimising the impact of medicines, minimising the number of medication-related problems in addition to reducing waste.5 MR in the UK was described as operating at four different levels,5 with the key component of level 3 medication reviews being the involvement of the patient while accessing medical records.
Pharmacist-led medication reviews have been shown to reduce costs associated with unnecessary prescribing of medication while potentially providing patient benefit.6 However, recent UK-based research utilising pharmacists to provide medication reviews found a counter-intuitive increase in hospitalisation,7 with one partial explanation being the didactic nature of the pharmacist communication.8 ,9 Effective communication skills are necessary to improve patient behaviours in terms of lifestyle10 and medication taking.11 Consequently, models of consultation behaviour have been developed and are commonly used within the education of healthcare professionals.12 ,13
While UK pharmacy graduates develop expertise in the pharmacology and therapeutics of medicines, undergraduate training currently lacks significant patient contact. This provides limited opportunities for the development of clinical and communication skills during training.14 In contrast, medical students routinely work with patients during their undergraduate training15 and undergraduate students within Schools of Dentistry and Optometry provide services to patients under the supervision of clinical tutors to improve both their clinical and communication skills.16 ,17
Involvement of pharmacy students in the provision of healthcare services in other countries has been reported18 ,19 with very good prescriber acceptance of student recommendations.20 However, pharmacy student provision of medication review to patients in the UK, with the dual aims of demonstrating patient benefit and improving student communication and clinical skills, has not been tested. For new models of care to be adopted, it is necessary to demonstrate that they are likely to be cost-effective. There is currently no evidence of this for the provision of pharmacy student-led medication review services.
Two and a half million of the UK population currently have type 2 diabetes with an estimated direct cost to the health system of £8.8 billion/annum.21 Pharmacist-led medication reviews for patients with diabetes have demonstrated significant reductions in blood pressure22 ,23 and glycated haemoglobin (HbA1c),24 ,25 both of which are necessary to reduce long-term morbidity.26 Approximately 60% of patients are achieving the target HbA1c below 7.5% (59 mmol/mol). 27 Owing to the availability of clearly defined national treatment guidelines28–30 and increasing numbers of patients with type 2 diabetes, medication review for patients with diabetes is a health service which pharmacy students may be able to usefully provide.
A pilot and feasibility study was, therefore, undertaken in line with national guidance for the evaluation of complex interventions31 to determine recruitment and attrition rates for students and patients; describe the suitability of using student volunteers; test data collection for a future cost-effectiveness analysis; describe the potential effects of the intervention; identify the most suitable primary outcome measure; and estimate variance around this to enable a future trial to be effectively powered.
ISRCTN No 26445805 was obtained retrospectively rather than prospectively due to misinterpretation of an National Institute for Health Research (NIHR) email stating that “NIHR Clinical Research Network (CRN) Coordinating centre had developed a process which enables automatic registration of all new NIHR Clinical Research Network Portfolio studies via the Portfolio.” We did not notice that they provided details of ISRCTN registration via UKCRN Portfolio, later in the same email.
Student recruitment and preparation
All 84 third year pharmacy students from one UK school of pharmacy were invited to participate in June 2011. The intervention was timetabled to occur during the final year (fourth) of their undergraduate studies. Informed consent was obtained from students agreeing to participate. A reserve list was created and used to resolve any anticipated drop-out caused by the additional workload created by the study within the students’ final year.
Standard education process already included basic training in consultation skills, data governance and observation of a primary care doctor in practice. In addition, participating ‘study students’ undertook four half-day training sessions comprising the following:
Use of medical practice information systems using ‘dummy’ patient records;
Revision of ‘pharmaceutical care planning’ using a care plan designed to enable recording of patient details and also to provide a guide to their consultations;
A consultation skills workshop which included utilising dummy primary care patient records and training in basic behaviour change counselling;
Two medicines-related consultations with pre-prepared and scripted professional role-play actor ‘patients’, following which individual and group feedback was provided.
All student activities connected with this trial were undertaken outside the university curriculum, with students donating their time. Student preparative training was undertaken at the University of East Anglia, apart from training in the use of computerised medical records which was provided by NHS Norfolk and Waveney.
Examination results for students (both participating and non-participating) were obtained at the end of year three (ie, shortly after recruitment) to identify potential student self-selection bias.
Medical practice and patient recruitment
Five Norfolk-based medical practices were purposively recruited by NHS Norfolk and Waveney. The inclusion criteria were:
Pharmacist working as a prescribing advisor within the practice;
Using the SystmOne IT medical record system;
Over 200 patients registered with type 2 diabetes.
Presence of a pharmacist was required to enable student supervision; the same system facilitate student training. A target number of patients was required to increase the opportunity for meeting recruitment targets.
Patients in each medical practice who met the following criteria were posted a letter from the practice asking them to participate in the study:
Prescribed non-insulin medication for type 2 diabetes mellitus for at least 2 years to increase likelihood that therapy is stabilised.
Deemed unsuitable for inclusion in the trial by their medical practitioner for any reason;
Enrolled into other clinical trials;
Diagnosed with a terminal illness.
All recruited patients were randomised to intervention or control (standard care) using an automated randomisation system, developed and controlled by the clinical trials unit, which ensured concealed allocation. Randomisation was undertaken in blocks of four to maximise equality of group size. All researchers and clinical staff involved with generating outcome date were blind to participant allocation.
As a pilot study it was decided to test a number of potential primary outcome measures, with results enabling a decision as to which measure to use in a future study:
Secondary outcome measures were the effect on:
Health-related quality of life (EQ-5D);
Satisfaction with information about medicines (SIMS);32
Medication adherence (MARS);33
Patient's beliefs about medicines (The Beliefs and Medicines Questionnaire);34
Diabetes Treatment Satisfaction Questionnaire (DTSQ).35
Level 2 medication reviews were undertaken by students between November 2011 and February 2012 while student-led patient consultations (level 3 medication review) took place between December 2011 and March 2012.
Sample size justification
As a pilot study it was not appropriate to power the study. Consequently we determined the likely precision of the study for estimating the effect of the intervention on the continuous end points by estimating the expected value of the half-width of the 95% CI around the difference in means between the intervention and control groups. Assuming 80 patients in each group and a SD of 1.5% in the primary outcome variable of HbA1c then the estimate from this pilot study of the effect of the intervention on this end point would be within 0.5% of its ‘true’ value. An observed difference in group means >0.5% (eg, HbA1c 7% compared to 7.5%) would be statistically significant.
From each of the five practices, 32 patients were, therefore, required providing 160 in total (80 in each of intervention and control arms). It was planned that each student would be allocated two patients in the intervention arm for review and consequently 40 students were required.
Both intervention and control participants were posted a questionnaire comprising the secondary outcome measures, which included an additional question asking whether they used a medicines compliance aid.
The patient notes within the medical practice were investigated to obtain:
Most recent results prior to recruitment for HbA1c, blood pressure and lipid profile;
Medication utilisation (cost of all prescriptions issued for each patient for a baseline period of 3 months prior to intervention and 6 months postintervention;
NHS resource utilisation calculated as cost (using standard NHS staff cost) of all NHS contact for a baseline period of 3 months prior to intervention and 6 months post-intervention in primary and secondary care.
The last two items were included to determine the feasibility of collecting data for a future cost-effectiveness analysis within a randomised controlled trial.
At the patient's medical practice, students were randomised to work in pairs. This provided additional support and shared learning in addition to the wider clinical experience provided by access to additional patient records. Each pair, therefore, worked to undertake level 2 medication reviews for four intervention patients under the supervision of a PCT pharmacist. Students compared prescribing with national guidance28–30 and created individualised pharmaceutical care plans (PCP) on a predefined pro forma.
PCPs included demographics, allergies, special needs, lifestyle for example, diet and smoking status, relevant medical history, medication adherence, pharmacy use, current prescribed medication, over the counter, herbal and homeopathic preparation use and any care issues identified. After discussion and agreement with the supervising pharmacist, care issues identified were fed back on a custom-designed form, to either the patient's specialist diabetes nurse or medical practitioner who then decided on the final action.
Patients were then offered a range of flexible dates and times, to maximise participation of a meeting between each student and an individual patient.
The presence of a supervising pharmacist was ensured during all student-led medication reviews to ensure competence. The consultation (level 3 medication review) took place at the patient's medical practice and was separated by at least 2 weeks from the level 2 review to enable the doctor or nurse to rectify or question any problems identified by students, prior to the subsequent student-led consultation. As planned in the protocol, each student provided two patient consultations which had no time limit imposed on their duration.
Six months postintervention, a questionnaire was posted to both intervention and control participants. The questionnaire was identical to the baseline version but with an additional question regarding frequency of community pharmacy service utilisation. Intervention participants were also asked to report any change in utilisation of community pharmacists following the student consultation to identify any change in attitude to or view of community pharmacists. The same data as baseline were collected from the medical practice, with HbA1c, blood pressure and lipid profile collected at 6 months postintervention with a cut-off point of 1 year; and medication and resource utilisation for the 6-month period postintervention.
Stakeholder meetings were held with patients, students, primary care pharmacists and medical practice staff both before and after the intervention. Interested individuals were recruited prior to the study's implementation to inform the design of the intervention and trial, while study participants were recruited postintervention to learn from their experiences. All meetings were recorded and transcribed verbatim.
The variance in the difference between each primary or coprimary outcome measure between groups was undertaken on an intention-to-treat basis using independent t test and Mann-Whitney U test. The patient recruitment rate and the medicine-related consultation uptake rate were both determined. SPSS V.22 was used for analysis.
Stakeholder meeting analysis
Simple content analysis which proceeded to identify all themes, as recognised by the researcher, was undertaken for development meetings with the main learning points recorded for action as appropriate. Review meeting analysis followed the general principles of the framework approach.36 There was no independent analysis of the data. Nvivo 10 was used to facilitate analysis.
Health economics analysis
As a pilot study we report completion rates for resource use items and the EQ-5D. Additionally, unit costs37 were extracted in order to enable the cost of the intervention to be estimated.
All five medical practices which responded to recruitment requests were consented to join the study.
Figure 1 summarises the patient recruitment process which achieved a 16.8% consent rate. Recruitment rates within the five medical practices were 17.2%, 19.6%, 20.1%, 18.5% and 9.4%. The research team received a number of contacts from patients who had been approached by the medical practice with a 9.4% response rate to complain that they had received recruitment letters without stamps. The first two practices recruited in time to enable students to complete medication reviews before Christmas 2011. The other three practices recruited later resulting in student-led medication reviews in one practice being undertaken in March 2012. Of the 67 patients randomised to intervention, 91% remained in the study prior to the student-led medication review with 100% of those agreeing to an appointment with a student for a consultation. Of these, three (4.9%) failed to attend the consultation.
Figure 2 provides a summary of the flow of students at each stage of the study. Of the 47 students who volunteered and completed a consent form, 12.75% were male. The first 40 students volunteering were recruited with the remaining seven forming the reserve list used if recruited students left the study. Patient consultations were undertaken by 32 of the 47 (68%); however, of these six only undertook one consultation due to patient numbers. Mean (SD) examination scores at end of year three (at recruitment) for participating and non-participating students were 62.80 (7.91) and 58.91 (7.98), respectively. Academic performance of participating students was significantly better than non-participating students at the point of recruitment (p<0.05, independent samples t test).
Table 1 presents baseline, demographic, clinical and questionnaire data for control and intervention patients. The data indicate that randomisation resulted in reasonably comparable groups, although the wide SD demonstrates considerable numbers of patients in each group were failing to achieve clinical targets.
Table 2 presents 6 months postintervention data including clinical data and results of patient-completed questionnaires. Questionnaire responses were received from 94 (70.7%) of the 133 patients with non-respondents and omission of responses to individual questions being comparable across the two groups. Significant differences between intervention and control groups were only observed for change in quality of life and some elements of SIMS.
Figure 3 illustrates a comparison of the SIMS questionnaire responses for intervention and control patients at follow-up (6 months postintervention). It demonstrates that patients in the intervention group were significantly more satisfied with five parameters (one action and usage, four concerns) out of the 17 questions.
Control n=34 Intervention n=36.
Twenty-five (55.5%) patients who had met a student for a level 3 medication review and answering this question agreed or strongly agreed that they were far more likely to speak to a pharmacist about their medicines or their health following the medication review, while 11 (24.5%) were unsure.
It was calculated that for a full randomised controlled trial (RCT) to demonstrate an effect on HbA1c, 159 patients would be required in each arm of control and intervention to demonstrate 80% power with 214 patients per group to demonstrate a 90% power. Data utilised for sample size analysis are presented in table 3.
Health economics analysis
The mean per participant cost of the intervention was £164.41; table 4 provides a breakdown of the component parts. We used different versions of the EQ-5D (the five-level version38 at baseline and the three-level39 at follow-up) to assess whether completion rates differed according to the number of levels. The response rates were slightly higher for the EQ-5D-3 L and the mean change in EQ-5D score was slightly higher for the intervention arm (see tables 1 and 2). Complete cost and effect data were available for 72 participants (54.1% of the sample).
All stakeholder groups supported the testing of the idea. There was agreement that student-led consultations should take place at the medical practice of each patient rather than at the university, should not be time-limited and should be supervised. Postintervention stakeholder groups agreed that the experience had been generally positive, had provided both student and patient benefit and raised awareness of the role of pharmacists.
Table 4 provides a summary of the main points learned from the stakeholder meetings before and after intervention where opinions did not concur across groups.
Table 5 presents identified intervention costs. It can be seen that there are significant fixed costs associated with setting up the service: the mean cost per participant is relatively small.
This pilot study has demonstrated the acceptability and practicality of pharmacy students providing full medication review to patients with type 2 diabetes under supervision. All stakeholder groups displayed support for the concept, with patients also displaying a willingness to participate in a subsequent RCT. Medical practices were purposively selected, and no problems were experienced with patient recruitment, though recruitment rates were relatively low (17%) and may display a better response rate without postal issues experienced at one medical practice. Nevertheless, future recruitment for a full RCT would be possible and may display a better response without postal issues experienced at one medical practice. Importantly, there was also a very low patient dropout rate (<10%). The logistics of patients having to attend an additional clinic within the intervention group resulted in the loss of patients due to illness and bereavement which were unavoidable losses to the study and two due to forgetting to attend. A longer period to allow for rebooking and reminders closer to the time of the appointment may have prevented these drop-outs. A longer time period to allow for rebooking and reminders closer to the appointment may have helped but would increase the costs. Potential patient benefit was also identified within some of the outcome measures. The results, therefore, provide evidence that within an RCT, sufficient patients could be expected to agree to attend for a medication-related consultation.
As this was a pilot study, and had small participant numbers we did not expect to demonstrate significant effects in our outcome measures. Students were volunteers and may not represent a full population of undergraduate pharmacy students. All participating medical practices were requested to start recruitment at the same time; however, results demonstrate patient recruitment proceeding over a period of greater than 4 months, resulting in logistical issues within the project. Ethical reasons required recruitment to be initiated via the medical practices, but results suggest that closer communication and support may be required between the researcher and medical practices to facilitate earlier recruitment. Written appointment information may aid patient attendance and prevent the small number of patients failing to attend due to forgetfulness. The large number of statistical tests carried out, increases the likelihood of false positives. Conversely as a pilot and feasibility study with limited sample size there is an increased likelihood of false negatives.
While student willingness to participate was high, pressures of concurrent timetabled course work and a lack of confidence in ability to perform the consultation resulted in significant drop out during the progress of the study. Integration of the service into the curriculum did not result in drop out from similar non-UK studies.18 ,19 Participating students were volunteers and, therefore, self-selecting. Given that they were, on average, academically superior when compared to non-participating students, they would potentially have performed better than non-participants during a student-led consultation. Most studies do not mention this effect and any future study utilising volunteer students should recognise and allow for it.18 ,40–43 The educational element of this study was not considered within this paper as this will form the focus of a future submission. The quality of medicines information given to patients affects individual's perception of whether it has met their needs and if they are satisfied with the information provided.32 It is reasonable to speculate that repetition of information over a period of years to patients with a long-term condition would have resulted in a greater understanding of and, therefore, satisfaction with information about their medicines. This may have reduced the ability to improve scores for many of the individual questions. While higher scores for SIMS is theoretically a predictor for better adherence (MARS)32 no improvement in adherence was observed. The relatively high proportion of patients who reported using medication compliance aids prior to the intervention might have reduced the potential for the intervention to further improve adherence. Adherence, beliefs about medication, satisfaction with diabetes treatment and quality of life all displayed a change in the direction which favours the intervention, all of which support a full study going ahead. No evidence is available to definitively explain the change in blood pressure seen in the control group and reasons for this would only be speculative, but it may simply have been a chance finding. It may be more appropriate to focus the intervention on those patients with the greatest HbA1c or the lowest reported satisfaction with information or adherence, however this may affect the recruitment rate and would require careful consideration prior to implementation in a full RCT if using the results from this study for it basis.
Results demonstrate that HbA1c would appear to be a sensible primary outcome measure for a future study. A sample size of 214 patients per group (428 in total) would be required to demonstrate a 90% power. This would equate to 107 students (two patient consultations per student), which is achievable within a full RCT undertaken over more than one school of pharmacy. However, recent National Institute for Health and Care Excellence (NICE) guidance recommends the utilisation of a cardiac risk measure (QRisk2)44–46 which represents a compilation of clinical data. Insufficient data is available to calculate a sample size for QRisk2, therefore, the pragmatic decision would be to utilise a primary outcome measure of HbA1c with QRisk2 possibly utilised as a secondary outcome measure.
Implementation of student activity described within this study is in line with current government agenda for pharmacy education.47 Evidence does not exist in the UK to support the training of undergraduate pharmacy students when undertaking activities with real patients, although examples exist outside the UK.18 ,19 ,42 This study does not provide definitive evidence for this, but does provide support for a future definitive RCT to test this hypothesis.
With a known patient recruitment rate and low dropout rate this demonstrates that if utilising the same protocol for a future RCT, not only can sufficient numbers of patients be expected to be recruited and retained. Medical practices were chosen because they all used the same software system for electronic medical records, as this would facilitate student training, however, utilising additional systems would increase the number of general practitioner practices available for recruitment. Changes may be warranted to patient selection criteria, as recruitment of patients who are not yet clinically stabilised may be more receptive to information regarding their medicines. NICE CG6644 recommends a blood pressure target level of <140/80 mm Hg for most people with type 2 diabetes, and <130/80 mm Hg for those at more particular risk. The latter group includes people with raised albumin excretion rate (microalbuminuria or worse), estimated glomerular filtration rate <60 mL/min/1.73 m2, those with retinopathy, and those with prior stroke or transient ischaemic attack. Data to enable such differentiation was not obtained within the pilot study and should be included in the design of a future definitive RCT. Provision of opportunities for students to undertake more than two consultations in future studies may demonstrate further student and patient benefit. Results provide evidence that within an RCT, sufficient patients could be expected to agree to attend for a medication-related consultation. Written appointment information may aid patient attendance and prevent the small number of patients failing to attend due to forgetfulness. Where acceptable to participants, email appointments and reminders for consultations may be effective. This pilot study confirms that the data required for evaluation of health economics is possible in a RCT. To address the rate of availability of cost and effect data, in any future study we would make every effort to ensure that baseline measures are completed prior to randomisation. The design of a definitive trial should ensure that medical practitioners receive feedback from the students to potentially increase the effectiveness of the intervention. The results from this study display good generalisation, as recruitment and the intervention followed existing scenarios where possible, however student academic ability may affect interpretation. Results support a future RCT as the intervention appeared to have the potential to improve blood glucose sugar control, quality of life and medicine information and these findings need more formal testing.
Thanks are due to the patients, medical practices and their staff, and pharmacy students who took part in the study. Thanks are due to the academic staff at the UEA for guidance and practical assistance, the Norwich Clinical Trials Unit and also to practice-based pharmacists who assisted with supervision.
Contributors DJW conceived the study and led the writing of the proposal for funding, provided day to day supervision of study conduct, analysis and interpretation of data, and co-led the writing of the paper, including revisions and final draft. DJW, RPA, DB, RH, AH, NN were coinvestigators, contributing to writing of the proposal, oversight of the study conduct, data analysis and interpretation, drafting of the paper and approved the final version. GB undertook the analysis and interpretation of the health economic data and led the drafting of the health economic components of this article. LS provided oversight for the statistical analyses. PFG, DJW, DB, RPA provided the expertise on the design and delivery of the pharmacist training. RPA was responsible for daily study conduct and coordination, acquisition of the data, analysis, producing tables and figures and interpretation of data and co-led with DJW the drafting of this paper. DJW approved the final version. All authors participated in a critical revision of the manuscript and have approved the final version.
Funding This work was supported by the National Institute for Health Research (NIHR) under Research for Patient Benefit grant no. PB-PG-0909-19198. The views expressed are those of the authors and not necessarily those of the NHS, NIHR or the Department of Health.
Competing interests DJW declared a consultancy with Health Education England to determine the costs associated with clinically training pharmacists.
Patient consent Obtained.
Ethics approval Ethical approval was obtained from Cambridge three ethics committee in January 2010 and NHS management permission was obtained from NHS South Norfolk CCG (formerly NHS Norfolk and Waveney PCT) prior to start of the study. Ethics ref no. 10/H0306/77. University of East Anglia ethical approval was obtained to permit collection of student examination results.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data are available.