Article Text

Download PDFPDF

Protocol
Prospective observational cohort study of factors influencing trial participation in people with motor neuron disease (FIT-participation-MND): a protocol
  1. Emily Beswick1,2,3,
  2. Stella A Glasmacher1,3,
  3. Rachel Dakin1,2,3,
  4. Judith Newton1,2,3,
  5. Alan Carson1,
  6. Sharon Abrahams2,4,
  7. Siddharthan Chandran1,2,3,5,
  8. Suvankar Pal1,2,3,6
  1. 1Centre for Clinical Brain Sciences, University of Edinburgh Division of Medical and Radiological Sciences, Edinburgh, UK
  2. 2Euan MacDonald Centre for Motor Neuron Disease Research, University of Edinburgh Division of Medical and Radiological Sciences, Edinburgh, UK
  3. 3Anne Rowling Regenerative Neurology Clinic, University of Edinburgh Division of Medical and Radiological Sciences, Edinburgh, UK
  4. 4Human Cognitive Neurosciences, The University of Edinburgh, Edinburgh, UK
  5. 5UK Dementia Research Institute, University of Edinburgh Division of Medical and Radiological Sciences, Edinburgh, UK
  6. 6The National Creutzfeldt-Jakob Disease Research and Surveillance Unit, Western General Hospital, Edinburgh, UK
  1. Correspondence to Dr Suvankar Pal; suvankar.pal{at}ed.ac.uk

Abstract

Introduction Motor neuron disease (MND) is a rapidly progressive and fatal neurodegenerative disorder with limited treatment options. The Motor Neuron Disease Systematic Multi-Arm Randomised Adaptive Trial (MND-SMART) is a multisite UK trial seeking to address the paucity in effective disease-modifying drugs for people with MND (pwMND). Historically, neurological trials have been plagued by suboptimal recruitment and high rates of attrition. Failure to recruit and/or retain participants can cause insufficiently representative samples, terminated trials or invalid conclusions. This study investigates patient-specific factors affecting recruitment and retention of pwMND to MND-SMART. Improved understanding of these factors may improve trial protocol design, optimise recruitment and retention.

Methods and analysis PwMND on the Scottish MND Register, Clinical Audit Research and Evaluation of MND (CARE-MND), will be invited to participate in a prospective observational cohort study that investigates factors affecting trial participation and attrition. We hypothesise that patient-specific factors will significantly affect trial recruitment and retention. Participants will complete the Hospital Anxiety and Depression Scale, 9-Item Patient Health Questionnaire and State-Trait Anxiety Inventory-Form Y to evaluate neuropsychiatric symptoms, the ALS-Specific Quality of Life Questionnaire-Brief Form and Centre for Disease Control and Prevention-Health-Related Quality of Life for quality of life and a novel study-specific questionnaire on Attitudes towards Clinical Trial Participation (ACT-Q). Clinical data on phenotype, cognition (Edinburgh Cognitive and Behavioural ALS Screen) and physical functioning (Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised) will also be collated. Caregivers will complete the Brief Dimensional Apathy Scale. After 12 months, a data request to MND-SMART will evaluate recruitment and retention. Descriptive statistics will summarise and compare assessments and participants reaching impairment thresholds. Variable groupings: attitudes, quality of life, cognition, behaviour, physical functioning, neuropsychiatric and phenotype. Univariate and multivariable logistic regression will explore association with participation/withdrawal in MND-SMART; presented as ORs and 95% CIs.

Ethics and dissemination Ethical approval was provided by the West of Scotland Research Ethics Committee 3 (20/WS/0067) on 12 May 2020. The results of this study will be published in a peer-reviewed journal, presented at academic conferences and disseminated to participants and the public.

  • neurology
  • motor neurone disease
  • clinical trials
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • The first observational cohort study prospectively assessing factors influencing people with motor neuron disease to participate, and remain in, a clinical trial.

  • Better understanding of factors that affect recruitment and retention can inform future trial design.

  • Impossible to account for all potential influences on the variability in human behaviour.

  • As the population is Scotland-based, there may be additional barriers to participation or factors affecting attrition in trial sites across the UK.

Introduction

Clinical trials in motor neuron disease

Motor neuron disease (MND) is a rapidly progressive, incurable and uniformly fatal neurodegenerative disorder. Mean age of onset is 65.3 years and only 51.3% of people with MND (pwMND) survive more than 12 months from diagnosis.1 The disorder has a significant impact on multiple aspects of an individual’s life necessitating a holistic approach to clinical care and trial design.

There is an urgent need for new therapies in MND. Only one disease-modifying therapy, riluzole, has been approved for treatment in the UK, with limited impact on median survival.2 The recently published Airlie House guidelines encapsulate the new direction of trials in this area; with clear recommendations to rethink outcome measures, stratify participant characteristics and use academic consensus and historical trial findings to inform future design.3

Recruitment and retention in MND trials

The accurate identification of factors that impact on recruitment and retention of participants in research studies is important when considering trial design.4 Recruitment should involve selection of participants representative of the target population, in numbers sufficient to fulfil trial-specific power calculations. Previously, while restrictive inclusion criteria have been advantageous to stratify a heterogeneous population to detect an effect, results from these studies may not be readily generalisable, and restrict opportunities for research participation. While 83% of pwMND indicated that they would be open to participating in research trials,5 surveyed clinicians estimate enrolment figures of 25% in trials, primarily due to unsuitability of pwMND within stated inclusion criteria.6

Trials have utilised narrow inclusion criteria in an attempt to stratify subgroups, however, this may impact on homogenisation of trial outcomes at the cost of inclusivity.7 As MND-SMART (Motor Neuron Disease Systematic Multi-Arm Adaptive Trial) involves broader inclusion criteria than many previous trials, we expect higher rates of enrolment.

Attrition is defined as the loss of participating individuals to follow-up or as a result of missing data at one of more time-points.8 While some attrition is inevitable, ensuring optimal retention is an important consideration in trial design. Clinical trials in pwMND frequently report attrition rates over 20%;9 10 risk of bias is high at attrition rates in this threshold.11 Any level of attrition may result in bias in results reported as the characteristics of those individuals remaining, versus those lost to follow-up or with significant levels of missing data, may differ.

Suboptimal recruitment and retention can affect a study’s power, in turn significantly impacting conclusions.12 These methodological issues can lead to trials reporting invalid or inconclusive results, prolonged trial times and potential premature termination.4 13 Further investigation of factors that may account for variability in recruitment and retention, particularly within MND, is essential to devise strategies to address issues in enrolment and attrition and improve trial delivery.

New directions in MND trials

MND-SMART is a multisite UK clinical trial, which seeks to evaluate the effects of repurposed medicines with potential neuroprotective properties. Full details of the trial design and selection criteria are available at clinicaltrials.gov (NCT04302870) and EudraCT (Trial record number: 2019-000099-41). MND-SMART is a long-running trial, expected to evaluate several candidate repurposed drugs over the next two decades under a single umbrella protocol. Currently, memantine and trazodone are being evaluated against placebo.

Primary objectives are to assess the impact of these candidate drugs on functional ability, as measured using the Amyotrophic Lateral Sclerosis Functional Rating Scale-Revised (ALS-FRS(R)),14 and also on survival. Secondary outcomes include the impact of these medicines on cognition, respiratory functioning, affective symptoms and quality of life in pwMND.

The multiarm, multistage, adaptive design has been shown to be particularly beneficial in enabling a reduction of patient numbers and time required to test more than one candidate drug in later stage trials of stroke15 and cancer16. These may be particularly crucial changes in trial delivery for rarer and higher-burden diseases such as MND. Broad inclusion criteria intend to promote participation and ensure that the trial is available to a large number of pwMND, ultimately intending to capture the heterogeneity of this condition and improve the generalisability of findings. Establishing multiple stages with predefined interim analysis also reduces the chance of a patient taking an ineffective drug for longer than necessary, crucial in a condition with such a short life expectancy.

Rationale

A review of clinical trials in oncology17 identified three areas that impact on recruitment: patient factors, trial factors and doctor factors. This concept was also reflected in Atassi’s5 review of factors affecting adherence in MND trials; study population characteristics, trial design and site/staff facilities. MND-SMART seeks to address many trial factors such as inclusive trial participant criteria, remote follow-up appointments to address progressive disability and liquid medication to minimise potential swallowing difficulties.

In MND-SMART, many of the trial and doctor-specific factors that have previously affected engagement with MND trials have been addressed. This provides us with a unique opportunity to explore how patient-specific factors can also influence trial participation decisions. Although focused on a single trial, we believe these findings will inform future trial design, promote inclusivity and support trial teams in retaining participants.

The presence of neuropsychiatric conditions, behaviour change and cognitive impairment pose significant challenges for recruitment and can impact on a person’s ability to give informed consent and adhere to study protocol.5 18 Participants’ demographic characteristics19 20 and attitudes towards research and health behaviours21 may also be predictive of trial enrolment and attrition.

However, we currently have no knowledge of how prevalent and impactful these patient-specific factors are on pwMND and their decision to participate and remain in a clinical trial. This study will seek to address this knowledge gap, exploring what factors define the trial ‘participant’ and are associated with retention at follow-up.

Aims and hypothesis

This prospective observational cohort study will investigate how patient-specific factors impact on recruitment and retention within the context of the first multi-arm multicentre UK clinical trial in MND.

Aims

  1. Evaluate the characteristics of individuals who do, or do not, participate in MND-SMART

  2. Compare the characteristics of FIT-P-MND participants who remain enrolled on MND-SMART after 12 months and those who are lost to follow-up

Hypothesis

We hypothesise that patient-specific factors, such as neuropsychiatric symptoms, cognitive impairment, behavioural change, phenotype, quality of life and physical functioning will significantly impact on pwMND’s decision to participate, and remain in, MND-SMART.

Methods

Study design

This prospective observational cohort study will evaluate how patient-specific factors in pwMND affect their participation in MND-SMART, a multi-arm UK-wide clinical trial.

Using a range of assessments this study will evaluate patient-specific factors in pwMND at a specific point in time: neuropsychiatric symptoms (specifically depression, anxiety and suicidality), apathy, attitudes to clinical trials and quality of life. This will be supplemented with clinical care data and trial participation data derived from the individual’s Clinical Audit Research and Evaluation of MND (CARE-MND) register record, and MND-SMART data if they choose to also participate in the trial.

After 12 months, we will use an additional data request to MND-SMART to explore which of the FIT-P-MND participants also joined the trial, and of these, who remains enrolled in the trial after 12 months. This study will explore how the patient-specific factors, evaluated through questionnaires and clinical data, impacted on the recruitment to, and retention of, this cohort of pwMND to MND-SMART.

CARE-MND register

The FIT-P-MND project will use CARE-MND to facilitate recruitment, access clinicaldata for pwMND living in Scotland.

Established in 1989, the Scottish Motor Neuron Disease Register was the first population-based register for MND in the world.22 In 2015, the register was relaunched as the electronic platform CARE-MND. This has facilitated detailed longitudinal phenotyping of pwMND in Scotland from diagnosis to death, with allied tissue and brain banks and a research interest register allowing pwMND the ability to register interest in future observational and interventional studies.23 The CARE-MND register has 99% case ascertainment for pwMND in Scotland where there is an incidence of 180–220 new cases a year, and a prevalence of approximately 450 pwMND.23 FIT-P-MND will focus on Scottish participants.

Stages of study

This study will involve three time-points of data collection, with participants directly involved in the first stage only:

  1. Questionnaire completion: participant and caregiver questionnaire packs.

  2. CARE-MND data request: additional covariates collected in routine clinical care.

  3. MND-SMART data request: trial involvement and participation.

Study Timeline

Timeline for the current study was impacted by the COVID-19 pandemic, as non-COVID research and recruitment was temporarily halted. Table 1 provides an overview for key time points in the study, and projected dates for recruitment and data collection.

Table 1

Overview of FIT-participation-MND study timeline

Recruitment

All individuals on the CARE-MND register who have consented to receive information on studies which they may be eligible for will be invited to participate in FIT-P-MND via a postal invitation pack.

Potential FIT-P-MND participants will receive this postal pack with information on the study and a Consent Form. They will also be asked to identify a caregiver who would be willing to complete a behaviour questionnaire and they will receive a separate Consent Form and Information Sheet.

Participants can indicate on their Consent Form their preferred completion method; online survey, in-person appointment in Edinburgh, postal or telephone. These options have been selected to maximise accessibility and inclusivity.

Sample size considerations

This study will aim to recruit a sample of 120 individuals with a diagnosis of MND.

The required sample size was determined using the primary research objectives, which will be answered using regression analysis. The calculation is based on the use of a logistical regression model, as recruitment of pwMND to the MND-SMART clinical trial is a binary outcome variable (yes/no to participation).

An OR (measure of association between an exposure and an outcome) of 1.70 with power at 0.70 provides a sample size estimate of 111.

There are around 420 pwMND in Scotland at any point in time, circa 220 of whom have provided consent on CARE-MND to be contacted about research. All participants on the CARE-MND register who are eligible will be invited to participate.

Previous research using postal questionnaires in pwMND reports a responserate of 63%.24 However, we anticipate that adding the options of completion via online survey or telephone will improve response rates. As a result, we expect 120 individuals to be an obtainable sample size, based on a 60% response rate estimate.

Across all Scottish sites, the MND-SMART projected recruitment is 100 participants per year, with attrition due to death or withdrawal predicted at 20% annually. We estimate that around 80% of the 120 participants in FIT-P-MND will also enrol in MND-SMART, 100 people. Based on projected annual attrition rates of 20% for MND-SMART, we expect 80 of these individuals to remain in MND-SMART 12 months later.

As this is an exploratory study, looking at nine variables (using grouping to simplify analysis and presentation), and a relatively rare condition, sample size is based on the number of potential participants available and descriptive analysis methods will be utilised to explore the data.

Study assessments

Table 2 includes a summary of all study assessments included in FIT-P-MND participant and caregiver engagement and data requests. The questionnaire set for pwMND will take around 45 minutes, depending on physical decline and speech impairment, and includes ; Hospital Anxiety and Depression Scale, 9-Item Patient Health Questionnaire and State-Trait Anxiety Inventory-Form Y. FIT-P-MND participants will also be invited to questionnaires on quality of life: ALS-Specific Quality of Life Questionnaire-Brief Form and Centre for Disease Control and Prevention-Health-Related Quality of Life. Finally, participants will be asked to complete the Attitudes towards Clinical Trial Participation Questionnaire to evaluate attitudes towards trial participation. Caregivers will be invited to complete the Brief Dimensional Apathy Scale to consider behavioural changes of the participant (circa 5 minutes). Questionnaires will take around 50 minutes in total.

Table 2

Study assessments, CARE-MND and MND-SMART data requests

Data requests to CARE-MND and MND-SMART for additional data on physical functioning, cognition and clinical phenotype enable us to reduce burden on participants by ensuring brevity in study visits. We will use ALS-FRS(R) and Edinburgh Cognitive and Behavioural ALS Screen scores from CARE-MND, or MND-SMART if the individual is also a trial participant, to ensure we collect scores closest to the time-point that the FIT-P-MND study assessments are undertaken.

Inclusion/exclusion criteria

Table 3 summarises the inclusion and exclusion criteria for pwMND and their caregivers who wish to participate in FIT-P-MND. These criteria have been primarily selected to align with the criteria for MND-SMART to ensure maximum overlap in the two participant groups.

Table 3

Criteria for FIT-participation-MND participants and caregivers

Public and patient involvement statement

PwMND were first involved in the research when they were emailed the ACT-Q, Participant Information Sheet and Consent Form and asked to provide feedback. PwMND were asked to consider the questionnaire structure of the ACT-Q, provide an estimate of the time taken to complete and asked to suggest any additional factors which may influence their attitudes towards trial participation.

PwMND were invited to provide feedback on Participant Information Sheets and Consent Forms, particularly clarity of study aims, and additional aspects of MND which may potentially affect trial participation. Feedback from these individuals was used to refine the list of exploratory covariates in the study, and particularly the items included on the ACT-Q. Time required to participate in the research was based on feedback from patients, existing time-to-complete data for each of the established questionnaires, with additional time for potential communication or physical difficulties.

All participants in the study, who chose to, will be sent a copy of the study findings. PwMND and their caregivers will be consulted regarding the best way to disseminate findings and provide feedback on initial versions of the study summary documents to ensure clarity of presentation and suitability for this audience.

Analysis plan

The study questionnaires will be grouped into domains to reduce the number of candidate variables in the analysis as shown in table 4. The total scores of individual questionnaires will be summed into an overall summary score for each domain, which will be included in the subsequent analysis. As all scores represent the same directionality (higher score indicates greater impairment) a summed score will provide an overall indication of the level of impairment for each individual per grouped domain.

Table 4

Grouping of exploratory covariates

We will present the mean scores for each assessment, displayed in the factor groupings discussed above, with ranges and SD.

Scoring the ACT-Q

The Attitudes towards Clinical Trial Participation Questionnaire (ACT-Q) is a brief trial-specific questionnaire to quantify FIT-P-MND’s attitudes towards involvement in research, and multi-arm clinical trials in particular (table 5). Developed by the investigators, based on Kessel’s survey25 and Ellis’ tripartite model17 on factors impacting trial engagement.

Table 5

Items of the Attitudes to Clinical Trials Questionnaire (ACT-Q) and grouping

Each potential response is scored on the participant’s rating of its importance to their decision-making process and an overall score for each factor will be produced per individual. Items 6, 7 and 13 will be reverse scored, indicating less agreement with the statement.

The final aspect of this questionnaire is evaluating FIT-P-MND participants’ understanding of five key features of design. Respondents will indicate on a 5-point scale to represent level of understanding.

Statistical analysis

We will use logistic regression to model the impact of the aforementioned independent variables on the FIT-P-MND participant’s decision to enrol or not enrol in MND-SMART. All variables will be considered in univariate and subsequently multivariable analysis. Results will be presented as OR and 95% CIs.

12 months after the obtaining the questionnaire responses, we will extract participation data from MND-SMART.

As this is an exploratory study with nine categories of covariates, we will not be using an adjusted alpha-level to correct for multitesting. The Bonferroni method of correcting p values may not be suitable for this analysis as hypotheses are predefined, not all variables must be significant to reject the null hypothesis and descriptive statistics will also be of relevant when interpreting the findings.26

Missing data

If particular covariates, certain assessments or questionnaires, are not completed fully by the majority of participants, we will consider removing this variable from analysis. Missing data within individual questionnaires will be handled using multiple imputation. Incomplete questionnaires will not be returned to participants. As participants do not require a caregiver to participate, a missing behavioural questionnaire will not be included in thresholds for missing data. The covariate of behavioural change will be included where possible.

Management of potential risk

All FIT-P-MND participants, and caregivers, will provide informed consent and acknowledge they have read the study information. Participant-facing documentation highlights the voluntary nature of the study and requirements of participation. There are no direct risks involved in participating, however, as some of the questionnaires focus on mental health we acknowledge this may be distressing, clinical teams will be informed of any significant scores. The individual’s GP will also be contacted to inform them of study involvement.

A potential issue is fatigue, which may be induced by the length of assessment administration. Participants will be encouraged to inform the researcher if they are experiencing any and the option to complete at home enables participants who have significant issues with physical and mental fatigue to take breaks and complete the questionnaires at their own pace.

Data management and confidentiality of FIT-P-MND participants will be managed by assigning participant ID codes to anonymise responses. The use of identifiable information will be minimised.

Ethics and dissemination

This research is co-sponsored by the University of Edinburgh and NHS Lothian. Representatives from the Academic and Clinical Central Office for Research and Development have reviewed and approved this project. Ethical approval was provided by the West of Scotland Research Ethics Committee 3 on 12th May 2020 (REC Reference: 20/WS/0067).

Only pwMND who have provided prior consent to be contacted about ongoing research on their CARE-MND record will be invited to participate. The Anne Rowling Regenerative Neurology Clinic hosts the register, the data processor at the clinic will contact the potential participants’ MND nurse prior to posting recruitment packs.

At the end of the study a lay summary will be sent to the participants, or their nominated representative, for individuals who have indicated they would like to receive one on their Consent Form. The results will be disseminated to the community at engagement events and social media. Fully anonymised data will be uploaded to a persistent DOI at the Open Science Framework; ORCID ID 0000-0001-9843-0778: https://osf.io/fxnwv/. Agreement with this data storage policy is included in the Consent Form. We intend to publish the results of this project in a peer-reviewed journal and presented at academic conferences.

References

Footnotes

  • Twitter @beswick_emily

  • Contributors Each author has contributed significantly to one or more aspects of the study. EB, SP, SAG, JN, RD, AC, SA and SC contributed to study development and design of the protocol. In addition, EB, JN and SP will lead participant recruitment and contribute to data acquisition. EB SAG, JN, SC, SA, AC and SP drafted this work and provided critical revisions and approved the final version of this protocol. In addition, SAG provided advice on analysis plans and EB and SP made significant contributions to planned interpretation of the data.

  • Funding This work was funded by a grant from MND Scotland and donations to MND-SMART SMART (Motor Neuron Disease Systematic Multi-Arm Randomised Adaptive Trial) at the Anne Rowling Regenerative Neurology Clinic and Euan MacDonald Centre for Motor Neurone Disease Research (references R45786 and D21746).

  • Competing interests Professor Carson is a paid editor at Journal of Neurology, Neurosurgery and Psychiatry, and gives independent testimony in Court on a range of neuropsychiatric topics.

  • Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting or dissemination plans of this research. Refer to the Methods section for further details.

  • Patient consent for publication Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.