Article Text
PDF
Abstract
Objectives A Gateway to Medicine programme, developed in partnership between a further and higher education setting and implemented to increase the socioeconomic diversity of medicine, was examined to identify precisely what works within the programme and why.
Design This study employed realist evaluation principles and was undertaken in three phases: document analysis and qualitative focus groups with widening access (WA) programme architects; focus groups and interviews with staff and students; generation of an idea of what works.
Setting Participants were recruited from a further/higher education setting and were either enrolled or involved in the delivery of a Gateway to Medicine programme.
Participants Twelve staff were interviewed either individually (n=3) or in one of three group interviews. Nine focus groups (ranging from 5 to 18 participants in each focus group) were carried out with Gateway students from three consecutive cohorts at 2–3 points in their Gateway programme year.
Results Data were generated to determine what ‘works’ in the Gateway programme. Turning a realist lens on the data identified six inter-relating mechanisms which helped students see medicine as attainable and achievable and prepared them for the transition to medical school. These were academic confidence (M1); developing professional identity (M2); financial support/security (M3); supportive relationships with staff (M4) and peers (M5); and establishing a sense of belonging as a university student (M6).
Conclusions By unpacking the ‘black box’ of a Gateway programme through realist evaluation, we have shown that such programmes are not solely about providing knowledge and skills but are rather much more complex in respect to how they work. Further work is needed to further test the mechanisms identified in our study in other contexts for theory development and to identify predictors of effectiveness in terms of students’ preparedness to transition.
- qualitative research
- education & training (see medical education & training)
- medical education & training
Data availability statement
No data are available. NA.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
- qualitative research
- education & training (see medical education & training)
- medical education & training
Strengths and limitations of this study
Our findings elucidate a working programme theory of a Gateway to Medicine programme and may be useful in the generation and development of other access to medicine programme aims and curricula.
Data collection included a longitudinal aspect, which ensured changes occurring over the course of the Gateway programme’s evolution were captured in the interviews.
The use of realist evaluation and identification of six key contexts, mechanisms and outcomes provides an evidence base as to how Gateway programmes work in respect of providing the necessary context and mechanisms, related to outcomes, for students to overcome barriers to entry to medicine.
Our study was carried out in one context, which may limit its conceptual generalisability, or transferability, however, Gateway programmes are increasingly commonplace, and we do not think the aims and content of the programme we studied are unique.
As with any voluntary study, there would have been an element of participant self-selection.
Introduction
Increasing the diversity of medical students is a global challenge. Certain groups are under-represented in the medical workforce and medical student body.1 2 This under-representation is associated with social and demographic factors such as ethnicity, minority group membership or low-income, which are in turn related to a multitude of historical and social systemic factors which vary by country.3–6
Governments approach widening participation in education and medicine through macro-level policies which are then enacted by universities and medical schools in the form of widening access (WA) initiatives.7–9 WA to medicine encompasses a range of interventions from outreach schemes (eg, activities undertaken by universities or professional medical bodies to engage students from WA/under-represented backgrounds), to the particular use of selection tools or contextual data, to ‘Gateway’ programmes.10 11 Gateway programmes are typically 1 year transitional courses, either stand alone or linked to a standard medical programme.12 They are designed to attract students with educational and social disadvantage and to support these students to succeed.
Despite considerable investment by governments and associated agencies in Gateway programmes (eg,13–15), to date evidence of their effectiveness in terms of educational outcomes has been limited to small, mostly descriptive, single site studies.16–18 However, a recent multi-site study identified that Gateway to Medicine courses do work, with many students thriving academically and with the majority graduating as doctors.19 20
This is encouraging, however, we now need to understand how these programmes work and what contributes to their effectiveness. Research to date has looked only at specific aspects of supporting WA students into medicine, such as the role of mentoring and the personal qualities needed to be a mentor (eg,21–23). This is useful but insufficient: WA Gateway programmes typically contain many potential, inter-relating components or mechanisms of action, of which mentorship (for example) is only one. They tend to be an academic year in length, include many different activities (eg, tutorials, laboratory classes, skills practice, feedback, examination practice, admission preparation), diverse curricula (formal, informal and hidden),24 different target groups, different cocurricular activities and subtly different aims and objectives. In other words, WA Gateway programmes can be considered complex educational interventions with multiple, interacting components or potential mechanisms of action.25 Detangling what these mechanisms of action are and how they contribute to effectiveness is critical in ensuring that efforts are evidence-based, and resources are well spent.26 Further, and although the quality of WA research has improved in recent years,27–29 there is still a need for more robust and theory-driven approaches to identify conceptual generalisability.8 30 31
In summary, it is essential that WA programmes are evaluated to understand how and why they work, and for whom. To address this gap in the literature, our aim was to examine how the various interconnecting parts of a WA intervention can be delineated to identify precisely what works and how. To do this, we drew on realist evaluation,32 a theory-driven approach to evaluation of social programmes, developed to understand how interventions work in the social context within which they are implemented.32 33 Realist evaluation is useful in terms of understanding why the same intervention may produce different outcomes when implemented in different settings: what works, for whom, how and under what circumstances.32 34 Moore35 and Wong et al36 proposed that realist evaluation lends itself particularly well to evaluating educational interventions in the complex field of medical education, developing new knowledge and insights by moving beyond simplistic evaluations of ‘Did it work?’ to ‘Why did it work (or not)?’. We anticipate that this study will add knowledge in respect to making recommendations on tailoring, implementing and designing strategies to widen access to medicine. Our research will address the questions: what are the various interconnecting parts of a WA intervention which work?; how do the various interconnecting parts of a WA intervention work together?
Methods
Overview of context
The Gateway programme under study commenced in 2017 in response to a Scottish Government call for initiatives to support those from less traditional/privileged backgrounds to pursue a career in medicine. The programme is delivered in partnership with a further education (FE) college and was developed by programme architects at both institutions. Gateway students spend the first session/semester attending classes at the partner FE institution and the second at the host university. Through both semesters, students are provided with university campus accommodation and undertake a programme of cocurricular activities with a dedicated tutor. These cocurricular activities are designed to support students in pursuing a career in medicine, from preparing them for pre-entry assessments, to developing a professional identity, to adapting to living away from home. Bursaries are available and students are also offered the opportunity to undertake bank staff work as a healthcare support worker (HSW) within the local National Health Service board to gain healthcare experience and income. Gateway students are guaranteed entry into the first year of medicine at the host university if they fulfil predetermined academic criteria and perform satisfactorily on the other medical school admissions processes (UCAT (https://www.ucat.ac.uk/ucat/) and a Multiple Mini Interview (MMI)).
Methodology
This study employed realist evaluation principles32 positioned within a critical realist ontological perspective.37 Realist evaluation describes what mechanisms cause which outcome (intended or unintended consequences) and in which context (social and cultural conditions external to the interventions).32 This is typically presented as context (C), mechanism (M) and outcome (O) configurations. These configurations foster an understanding of what works for whom in what circumstances.
The aim of undertaking realist evaluation is to generate an initial programme theory whereby key CMOs configurations are identified, which are then tested and refined.32 38 Programme theory may be derived deductively, inductively and/or formulated from stakeholders’ mental models.39
Data collection
Driven by a realist evaluation approach, this study proceeded in three key phases (table 1).
The realist evaluation process and data sources
Phase 1 was an analysis of the Gateway programme promotional materials from the host university website and the Scottish Government website. The rationale behind the selection of these specific documents was that they had either been used to inform the Gateway programme development and to conceptualise. The programme theory was further refined via group and/or individual interviews with key programme architects (those involved in developing and implementing the programme) where programme aims and context were explored. Twelve staff were interviewed either individually (n=3) or in one of three group interviews. Staff were interviewed in the early stages of programme implementation. Staff interviews included questions on how the vision for the programme, how this had been operationalised, and challenges anticipated or experienced. This process aimed to initially identify the key CMOs involved in the Gateway course, to develop an initial programme theory (ie, how the Gateway programme was envisaged to work particularly in relation to understanding the context).
In phase 2, to test the initial programme theory, we gathered qualitative data from those who had experienced the programme using a purposive sampling approach. This included students on the programme and staff delivering teaching. At the time of data collection, three cohorts, totalling 65 students, had entered the programme. Nine focus groups (ranging from 5 to 18 participants in each focus group) were carried out with Gateway students from three consecutive cohorts at 2–3 points in their Gateway programme year. The longitudinal nature of data collection meant some students were interviewed at multiple time points whereas others may have only contributed to one focus group. Students were asked how they were settling into the Gateway programme, what worked well, what did not work so well, any challenges experienced, particular highlights and recommendations for improvement. Two members of staff were also interviewed again (they had previously been interviewed as stakeholders and were also involved in programme delivery), in the third year of the programme, and asked the same questions
After obtaining ethical permission, staff and students were invited by JC, KA or KGS to participate in the study via email. Staff focus groups and interviews were conducted by JC, KA or KGS, student interviews and focus groups by KA or KGS, either in person or virtually (during the 2020 COVID-19 pandemic). Each interview was recorded with written consent. Verbatim transcription was undertaken by a third party. Individual identifiers were removed at the analysis stage.
In phase 3, we used the interview data to test the CMOs developed in phase 1, by comparing what happened vs what was envisaged. We then refined the programme theory by considering if the data supported the initial programme theory.
Data management and analysis
Document data were coded by KGS to identify an initial programme theory and findings reviewed by JC. Preliminary analysis of interview and focus group data, both in relation to the initial programme theory and programme theory, was iterative and carried out by KA and KGS. These data were then analysed formally by KGS using NVivo V.12 Pro. In accordance with the preferred retroductive approach to realist research40 both inductive (codes developed from the data) and deductive approaches (codes developed from the research question) were used.41 The inductive and deductive approaches were therein advanced to consider a more retroductive approach whereby data were interrogated to identify causal pathways. Inductive codes were generated by coding all statements initially in terms of content and were further refined by grouping into overarching themes by KA and KGS. The deductive code template was developed by JC and KGS as per the three core concepts of realist evaluation (CMO) and related only to content which was pertinent to what ‘worked’ within the Gateway programme. Initially, themes relating to outcomes were developed and then mapped to mechanisms with the context unto which they ‘worked’ identified. CMO configurations were then worked up into causal pathways using the aforementioned retroductive approach and compared with the initial programme theory. CMO configurations were reviewed and any disagreements were resolved via discussion.
Patient and public involvement
Patients and the public were not involved in the design, or conduct, or reporting, or dissemination plans of our research.
Results
The initial programme theory (table 2) was generated via document analysis of Gateway material along with interview data derived from the programme architects (phase 1). It was drafted in relation to predicted CMOs. The initial programme theory was subsequently refined into a programme theory (phase 2) on analysis of interview data. The interview data analysis generated a programme theory whereby six inter-relating mechanisms, which helped students see medicine as attainable and achievable and prepared them for the transition to medical school, were identified. These were academic confidence (M1); developing professional identity (M2); financial support/security (M3); supportive relationships with staff (M4) and peers (M5); and establishing a sense of belonging as a university student (M6).
Initial working programme theory
Phase 1: identifying a programme theory
Web data detailed the envisaged outcomes of the Gateway Programme—promoting equality in access to medicine and ensuring students are prepared to study medicine: ‘… to provide a novel, accessible and supportive route into medicine’ for students from a WA background which … will allow them to reach their full potential and become doctors’ (University of Aberdeen webpage text 2020). These aims were principally based on university, college and government drivers for WA.
Programme architects (n=5) saw broad entry criteria as key, as these would overcome academic hurdles, which are the primary reason for rejection to medical school, but which may not accurately identify potential for those disadvantaged by systemic, social or demographic factors. They wanted the entry criteria to challenge preconceived ideas of deprivation (eg, that deprivation may not merely be experienced by those living in the most deprived postcode areas). Their vision of the programme centred on the appropriateness and relevance of the curriculum, promoting equal opportunities for students, ensuring the right students were admitted to the programme and that students’ transitions to, and through, the programme were adequately managed. This last point included providing the opportunity for students to train and work with the local healthcare provider, so students could gain relevant work experience in healthcare and financially support themselves. Table 2 outlines the initial programme theory in terms of predicted context, mechanisms and outcomes.
Phase 2: testing the programme theory
The programme theory was tested by collecting and analysing data from staff and student focus group and interviews. Data from the three cohorts of students were merged to protect anonymity.
Admissions and progressions
In addition to fulfilling the requisite academic entry criteria, applicants were required to be resident in a postcode within one of the most deprived areas in Scotland (as determined by the Scottish Index of Multiple Deprivation: n=30 students),42 be currently in care or a care leaver (n=3) or meet three of the following: attended a school identified as under-performing by the national Scottish Funding Council (n=47)) (University of Aberdeen 2019); first in family to enter higher education (n=34); being a registered carer (n=4); eligible for free school meals (n=28); resident in a remote or rural location (as determined by the Urban Rural Classification of the Scottish Government (n=14); estranged from family (n=3); eligible to receive an Education Maintenance Award (n=35); evidence of hardship from their High School Head Teacher (n=15) and/or English as a second language (n=11). While there has been variation in the numbers fulfilling specific eligibility criteria across each of the cohorts, the diversity within each has been maintained.
Student and staff perspectives
Student and staff findings were grouped into six distinct themes (tables 3 and 4) prior to grouping into CMO configurations. These related to what ‘works’ in the Gateway programme: establishing staff support, developing peer support networks, identity formation, experiencing a tailored and relevant curriculum, establishing geographical familiarity and provision of financial support. Findings are presented below in relation to each category and relevant quotes presented in table 4. Some of these relate directly to the CMOs in the Initial Working Theory (table 2) and these are referenced (eg, C1). Other findings were developed in this testing phase and are referenced as such (not in initial working theory (NIIWT)).
Student and staff perspectives in relation to themes
Detailed staff and student findings with exemplar quotes
Addressing practical issues
Students and staff highlighted the importance of addressing practical issues, such as ensuring familiarity with the city, campus, university processes and staff (NIIWT). This seemed to enhance students’ confidence in relation to transitioning through the course (M1) and contributed to their sense of preparedness to study medicine (NIIWT). Another practicality was work experience (C2). Having the opportunity to undertake work as an HSW was perceived, by both students and staff, to be a significant pull factor of the Gateway programme in terms of insight into healthcare and income generation (M3). The provision of bursaries was also a key pull factor (M3).
Establishing staff support
Staff support was critical to students’ development (C3). Students highlighted the importance of staff facilitating, via social media, development of peer support networks prior to arrival (NIIWT). Students and staff reported the benefits of staff supporting transitions away from home and from one educational environment to another (M4). This was enhanced via the provision of one-to-one support which gave students a safe space to report any relevant personal circumstances (NIIWT).
Developing peer support networks
Students and staff reported that the opportunity to develop a relatively small peer support network (M5) with students from a similar background was beneficial for students in terms of developing confidence and providing support (C3). Students also highlighted that being able to integrate within the wider university student body (M5), for example, via membership of university societies, was helpful when transitioning through educational environments.
Development of professionalism and identity
Students reported that it was important that they were referred to as university students throughout the Gateway year (C4), and to get to know senior university staff (to assist in assimilation into university (C3)). Staff and students identified the programme, and its interrelated components (eg, opportunity to work as an HSW (C2)) as important in developing the professional identity of a medical student (M2) and increasing their self-confidence (M1). Progression on the course proved that they had the capability to study medicine (C5). Staff also highlighted that the programme content (C1) helped students to develop their identity as a young adult (M1).
Experience of relevant curriculum
Both staff and students saw the Gateway curriculum as a steppingstone to university (C1)—increasing autonomy for learning to develop preparedness for transitions (M1). In addition, both staff and students believed that the practical sessions (eg, MMI and UCAT preparations) helped students develop relevant knowledge and skills which would assist them in making an application in medicine and to overcome barriers to access to medicine in terms of their background (C1). There was a sense of co-construction of the programme as it moved forward, with student feedback shaping programme refinement (eg, removal of some modules) (NIIWT).
Phase 3: testing the programme theory and refined CMOs
Six mechanisms were identified in phase 2, three of which were reflective of our initial working programme theory (table 1). The six mechanisms which contributed to the success of the Gateway programme and students experiencing successful transitions included: development of confidence in abilities (M1), development of professional identity (M2), establishment of financial security (M3), development of positive relationships with staff (M4) and peers (M5), and establishing a sense of belonging (M6). In phase 3, we refined the initial working programme theory following testing (figure 1, table 5).
Refined programme theory.
Refined programme theory
Students’ development of confidence in their abilities related to both interpersonal skills and academic ability (M1). These were facilitated by undertaking a curriculum which they perceived as relevant to medicine (C1), being provided with an opportunity to undertake paid healthcare experience (C2) and feeling supported over the course of the programme (C3). The various contexts were critical in enabling students to develop new ways of learning, knowledge specific to medicine and an understanding of the non-technical skills required to be a doctor. These key contexts and mechanisms enabled students to successfully transition through educational environments (O1), view an application to medicine as both attainable and achievable (O2) and develop a sense of preparedness to transition to medical school should they be accepted (O3).
The development of professional identity (M2) was enabled by providing students with the opportunity to undertake a placement, and paid work if they wished (C2). Being identified as a university student from the outset (C4), while attending the partnership college, was important in developing a professional identity as a doctor, as was feeling adequately challenged (C5). Having the opportunity to develop a professional identity contributed to students viewing an application to medicine being within their reach (O2).
Establishing financial security (M3) was facilitated by being provided with the opportunity to undertake paid work as an HSW (C2) and via provision of bursaries to support living costs over the course of the Gateway year (C6). Feelings of financial security were important to students when considering their suitability to make an application to medicine (O2) since this alleviated some of the stress associated with moving away from home and ensured they felt prepared to transition to medical school should they be successful (O3).
The development of positive relationships with academic staff (M4) and peers (M5) were critical factors in ensuring that students were supported through their studies (C3) and able to successfully transition through educational environments (O1) and in ensuring they felt prepared to make a transition both away from home (O4) and to medical school should they be successful in their application (O3). Feelings of support within the programme were enhanced by staff providing one-to-one support to students and facilitating the formation of early peer support networks from the outset. Students felt that developing strong peer support both within and out with the programme, via having the opportunity to join university societies, were important factors in developing a support network.
Establishing a sense of belonging (M6) was important to students in the context of medicine itself, the city and university and in facilitating students to successfully transition through educational environments (O1), view an application to medicine as both attainable and achievable (O2) and develop a sense of preparedness to transition to medical school should they be accepted (O3). This sense of belonging was facilitated by allowing students to develop familiarity with the university (C7) and city (C8) environments over the course of their Gateway year, in addition to ensuring students were well supported over the course of the programme (C3).
Discussion
To the best of our knowledge, this is the first study to use a realist approach32 to evaluate a Gateway to Medicine programme in relation to what works, for whom and in what circumstances. We identified six inter-relating mechanisms inherent in the Gateway programme under study, each of which facilitated students towards their goal of studying medicine: developing confidence and professional identity; financial security; positive relationships with staff and peers; and establishing a sense of belonging. Identification of these key CMOs starts to unpack the ‘black box’ of Gateway to Medicine programmes. Our findings elucidate a working programme theory of a Gateway to Medicine programme and may be useful in the generation and development of other access to medicine programme aims and curricula.
Previous studies have indicated that students from WA background lack both the academic qualifications42 43 and social support and links which can facilitate entry into medicine.11 44–46 The Gateway programme addressed these ‘deficits’ by helping students develop confidence in their academic ability, and increasing their understanding of medicine and the medical school application process. The second mechanism was linked to professional identity development and a sense of belonging as a university student. The literature on strategies to promote a sense of belonging in under-represented groups highlights the importance of ensuring that academic environments are inclusive.47 These were enabled by the work placements, being a university student and feeling adequately challenged by the Gateway curriculum. Establishing financial security was identified as mechanism three. This was facilitated by the provision of (paid) healthcare work experience and bursaries to support living costs, which addressed the significant practical barrier of being able to afford to come to university and commit to a long programme of study, long reported as an issue for students from socioeconomically disadvantaged backgrounds (eg,48 49).
The fourth and fifth mechanisms were the development of positive and supportive relationships with academic staff and peers, important for social cohesion and assimilation within the university.50 Indeed, social influences are a key factor in helping students from disadvantaged backgrounds develop agency and establish a sense of belonging in the university environment.51 Finally, mechanism six was a sense of belonging, which helped students see medicine as attainable and achievable and prepared them for the transition to medical school. This suggested that the Gateway programme helps students manage the social and cultural shift from home to university52 which may be more challenging for WA students compared with their counterparts for whom university/medicine has always been part of their ambition or assumed as achievable (eg,53).
Reflecting on our findings, we propose that the six key mechanisms identified in this study could be viewed as fostering the development of self-determination in the Gateway students. Self-determination is defined as ‘the capacity to choose and to have those choices’ (p38)54 and pivots on three tenets: autonomy (feeling that we are able to exercise control over the execution or direction of a behaviour), competence (feeling that we can exercise self-efficacy in interactions with our environment) and relatedness (establishing a sense of belonging, and developing secure and supportive relationships with others). We tentatively suggest that the Gateway programme provided the environment and instructional experiences which helped students develop the cognitive, social and behavioural qualities needed to achieve the goal of studying medicine.55 56 Equally, we posit that more privileged students—‘traditional’ medical students—are likely to have had the familial, social and educational contexts which facilitate self-determination earlier in life.57 The applicability of this conceptual framework in relation to Gateway to Medicine programmes requires further exploration.
Realist evaluation proposes that the identification of programme theories should precede testing and refining those theories.32 34 This process is not linear but iterative. New concepts were identified which were not initially formulated as programme theories during the testing process, so we revisited the initial programme theories to accommodate these new concepts. This process was useful in terms of enriching the analysis, as was collecting data from different perspectives (staff and students: data triangulation58). The framework of a realist evaluation is also useful in respect of establishing dependability and confirmability.59 Our study was carried out in one context, which may limit its conceptual generalisability, or transferability,59 60 however, as stated in our introduction, Gateway to Medicine programmes are increasingly commonplace, and we do not think the aims and content of the programme we studied are unique.
As with any voluntary study, there would have been an element of participant self-selection. However, our student participant group was large and diverse in terms of student background, allowing inclusion of a wide range of views and experiences. The number of staff involved in the delivery of the Gateway programme was relatively small, and we were able to gather the views of those who had the most student contact. Student data were collected by KA and KGS, who were external from the design and teaching of the Gateway programme, to minimise any power differentials and elicit more honest answers about the challenges of the programme. Combining data from interviews and focus groups was a pragmatic decision and we acknowledge that both methods have their strengths and weaknesses.61 Data collection included a longitudinal aspect, which ensured changes occurring over the course of the Gateway programme’s evolution were captured in the interviews. Even longer-term follow-up could usefully consider students’ progression through medical school and into postgraduate training in respect of how the Gateway programme prepared them for later transitions. Given emerging evidence that medical students from WA backgrounds are more likely to select particular medical careers,20 62 63 longitudinal studies of professional identity formation in this group would be a useful addition to the literature.
Another area for future study may be to focus specifically on liminality, to explore the transition and associated emotions between the identity of a school pupil and a medical/university student.64 65 Linked to this, our focus is a Gateway programme in a context where 90% of students enter medicine directly after high school. The mechanisms which contribute to the success of a Gateway programme and students experiencing successful transitions are likely to be very different in contexts with graduate entry to medicine. More generally, further work is needed to examine and further test the mechanisms identified in our realist evaluation in other contexts.
Recognising that no research is free of the biases, assumptions and personality of the researcher and we cannot separate self from those activities in which we are intimately involved,66 we constantly considered our own positions in relation to the study and the data. We were continuously reflective about how our differing life courses (eg, life stage), education and training, and experience of research and practice in WA to medicine may have shaped data collection and interpretation. Perspectives differed but all authors shared a strong belief in the importance of addressing inequality and increasing medical student diversity through extending knowledge and changing practices.
While a realist approach allowed us to identify exactly what works within the programme, we do not know which mechanism(s) was most important. To examine this requires different methodological approaches, such as a discrete choice experiment (DCE).67 A quantitative DCE study would require WA students and relevant staff to rank mechanisms in terms of importance to what works within a Gateway programme. Undertaking such work would promote the application of findings and enable educators to precisely tailor a programme to maximise effectiveness.
Conclusion
The use of realist evaluation and identification of six key CMOs provides an evidence base as to how Gateway programmes work in respect of providing the necessary context and mechanisms for students to overcome barriers to entry to medicine. By unpacking the ‘black box’ in this way, we have shown that Gateway programmes are not solely about providing knowledge and skills but are rather much more complex in respect to how they work.
Data availability statement
No data are available. NA.
Ethics statements
Ethics approval
The study was approved by the College of Life Sciences and Medicine Ethics Review Board, University of Aberdeen. Participants provided written consent to take part in the study and were made aware of confidentiality, anonymity and data handling procedure in advance of taking part.
Acknowledgments
We would like to thank all our study participants for their valuable input into the study and all those who set up and supported the programme. In particular, thank you to Professor Rona Patey, Professor Stephen Davies, Dr Wendy Dollery, Anna Johnston, Dr Christine Kay, Professor Colin Lumsden, Dr Pietro Marini, Dr Sally Middleton, Sarah Miller, Gwen Smith, Laura Young. In addition, we would like to thank Pat Maclennan for all administrative support and Scottish Government for granting the funding.
References
Footnotes
Twitter @kgibsonsmith7
Contributors JC formulated the original plan for evaluating the programme, which was designed collectively by JC. JC obtained the necessary ethical permissions for this study. KA and KGS carried out data collection and preliminary data analysis with support from JC. KGS and JC applied the realist evaluation approach to the data, and wrote the first draft of the paper, which JC edited extensively. KA contributed to later versions of the paper and approved the final version of the paper.
Funding The programme and work was supported by Scottish Goverment.
Competing interests None declared.
Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review Not commissioned; externally peer reviewed.