Article Text
PDF
Abstract
Objectives Describe the rationale and protocol for the Upper Limb International Spasticity (ULIS)-III study, which aims to evaluate the impact of integrated spasticity management, involving multiple botulinum toxin A (BoNT-A) injection cycles and concomitant therapies, on patient-centred goal attainment. Outline novel outcome assessment methods for ULIS-III and report initial evaluation data from goal setting in early stages of the study.
Design Large international longitudinal cohort study of integrated upper limb spasticity management, including BoNT-A.
Participants and setting ULIS-III is a 2-year study expected to enrol >1000 participants at 58 study centres across 14 countries.
Interventions The study design is non-interventional and intended to reflect real-life clinical practice. It will describe injection practices and additional treatment strategies, and record clinical decision-making in a serial approach to long-term spasticity management.
Outcome measures ULIS-III will use a goal-directed approach to selection of targeted standardised measures to capture the diversity of presentation, goals and outcomes. ULIS-III will implement the Upper Limb Spasticity Index, a battery of assessments including a structured approach to goal attainment scaling (Goal Attainment Scaling—Evaluation of Outcomes for Upper Limb Spasticity tool), alongside a limited set of standardised measures, chosen according to patients' selected goal areas. Concomitant therapy inputs, patient satisfaction with engagement in goal setting, health economic end points and health-related quality of life data will also be captured.
Results of initial evaluation of goal quality Recruitment started in January 2015. By June 2015, 58 sites had been identified and initial data collected for 79 patients across 13 sites in 3 countries. Goal setting data were quality-checked and centres rated on the basis of function-related and Specific, Measurable, Achievable, Realistic, Timed (SMART) characteristics of goal statements. Overall, 11/13 centres achieved the highest rating (A++).
Conclusions ULIS-III will provide valuable information regarding treatment of and outcomes from real-life upper limb spasticity management worldwide.
Trial registration number NCT02454803; Pre-results.
- botulinum toxin A
- goal attainment scaling (GAS)
- spasticity
- rehabilitation
- REHABILITATION MEDICINE
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
The Upper Limb International Spasticity (ULIS)-III is the first large international longitudinal cohort study to describe real-life clinical practice and decision-making in spasticity management over a 2-year period of treatment.
The structured approach to goal attainment scaling linked to targeted standardised measures will improve comparability of outcomes while maintaining a patient-centred approach. This approach may also have broader application for outcome measurement in other areas of healthcare.
This study introduces new tools to capture therapy interventions and spasticity-related quality of life. While not yet fully validated, they address areas that are poorly described in other studies; ULIS-III will enable further validation.
Training and proactive feedback on the standard of goals set from an early stage in the study has helped to ensure high-quality goal setting.
This study represents a diverse sample of practice across four continents; however, the limited number of subjects per centre (n=20–30) could lead to a degree of selection bias.
Introduction
Upper limb spasticity is a common and disabling feature of neurological conditions that affect the central nervous system.1–3 It may induce pain, interfere with function or self-care and result in secondary complications such as abnormal posture, contracture, pressure areas and resultant deformity.1 Regardless of aetiology, active management is required to prevent these unwanted effects.1
There is an ever-growing body of evidence that localised injections of botulinum toxin A (BoNT-A) can be effective in the management of upper limb spasticity.4 However, the diversity of individual goals for treatment poses a challenge for the evaluation of outcomes from treatment.1 ,5 ,6 Previous studies have identified the principal goal areas of spasticity management, which include improving active and passive function, reducing pain and deformity, avoiding involuntary movements, improving mobility, and facilitating therapies such as postural management, exercise, stretching and strengthening of limbs, and splinting.7
Patient-centred goal setting is a fundamental guiding principle of rehabilitation.8–10 However, communication between clinicians and patients/caregivers to agree on treatment goals and systematic documentation of goal attainment are still not everyday practice for some rehabilitation teams.11 ,12
Described originally in the 1960s by Kiresuk and Sherman,13 goal attainment scaling (GAS) was introduced in the context of upper limb spasticity management in 200614 and has gained recognition over the past decade as an effective method for capturing and quantifying patient-centred goal achievement.6 ,15 However, it does not provide directly comparable data; therefore, standard outcome measures must be collected alongside GAS to support comparison between different practices and populations.16 Some authors have also called for more standardised goals or ‘item banks’ to reduce the variation in goal setting.17 Owing to this goal diversity, the challenge is to incorporate standardised measures that capture the diverse aims of treatment into a time-effective approach that is practical for real-life clinical practice.
The Upper Limb International Spasticity (ULIS)-III study will aim to describe real-life clinical practice and decision-making in integrated spasticity management over a 2-year period, using a structured approach to GAS that incorporates targeted standardised measures while maintaining a patient-centred approach.
The ULIS programme and the evolution of outcome measurement
The ULIS programme consists of large international observational studies investigating the use of BoNT-A injections as part of an integrated spasticity management strategy for the treatment of upper limb spasticity. The overall aim of this programme is to describe real-life clinical practice and to develop a common approach to outcome measurement that could build into a core data set for ongoing longitudinal evaluation, taking into account the diversity of presentation and clinical approaches to treatment.
The initial stage of the programme, ULIS-I,11 was a cross-sectional survey conducted across 122 centres in 31 countries that documented the clinical profiles and treatment goals and reported outcome evaluation in adults receiving BoNT-A treatment for upper limb spasticity. The majority of clinicians (78%) reported setting goals, but formal GAS was used in only 5% of centres.11 For the next stage of the programme, Turner-Stokes et al18 concluded that goal attainment may provide an acceptable common outcome measure for this context, if it was applied consistently.
ULIS-II was an international observational study to investigate goal attainment as a primary outcome following a single BoNT-A injection cycle. It was conducted in 84 centres across 22 countries in the European Union, Pacific Asia, Eastern Europe and South America. A key feature of ULIS-II was its development of a consistent standard of goal setting and application of GAS in participating centres, using the GAS-light method.16 The approach was then used to quantify and characterise patient-centred goals and to confirm the validity of GAS as an efficient measure of patient outcome.18 The study results showed that 80% of patients (n=363) achieved their primary goals and that the use of an electronic case report form (eCRF) was a feasible approach to data collection for the ULIS study programme.5 The study also confirmed the validity of the GAS T-score as an overall assimilation of primary and secondary goal attainment. Clinicians were encouraged to continue to use the standardised measures that they normally applied in routine clinical practice. Although these were diverse, some relationships emerged between the use of specific measures and certain goals for treatment. For example, visual analogue scales were commonly used alongside GAS to record the reduction of pain symptoms or improved ease of care.
ULIS-II formed the basis for development of a more structured approach, framing goals around recommended goal parameters for each goal area and using a limited set of standardised measures from which the subsets used were individually determined according to priority goal areas. These refinements to the GAS-light approach were developed in a proof-of-principle study before progression to the third stage of the ULIS programme. They are described in more detail below.
Rationale for ULIS-III
Spasticity typically varies over time, both in its severity and in the pattern of muscles affected. Its course may fluctuate, or follow a trajectory of recovery or progression, depending on the underlying condition, its phase of development and treatment.1 Ongoing treatment may include further injections of BoNT-A into the same or different muscles, physical interventions (eg, splinting, task practice or exercise, functional electrical stimulation), or the use of other antispasmodic medications.1 Longitudinal data are therefore needed to record progress over time and to capture clinical decision-making along the care pathway.
ULIS-II provided an overview of how treatment goals and outcome measures were applied in a single cycle of treatment with BoNT-A. However, it did not provide insight into the changing course of treatment over time. It recorded concomitant treatments in terms of the number of therapy sessions, but did not provide information on their content. Nor did it attempt to capture information on quality of life or health utility in relation to spasticity management.
The present study, ULIS-III, will expand the patient cohort to evaluate integrated spasticity management that includes multiple BoNT-A treatment cycles and concomitant therapies, as delivered in real-life clinical practice. It will implement a novel approach to outcome measurement using patient-centred goal setting and GAS alongside standardised validated outcome measures, in a generalisable sample, recorded longitudinally over a 2-year period.
Novel assessment methods
ULIS-III will use the Upper Limb Spasticity Index (ULS Index) to record patient-centred goals and standardised outcomes directed by priority goal areas. This is a battery of assessments designed to capture the diversity of presentation, goals and outcomes inherent in populations of patients with upper limb spasticity, while targeting measurement on the priority areas of treatment for that individual. While the goal-directed approach to selection of targeted standardised measures is novel in this context, the measures themselves are well-validated tools and are suitable for use in routine practice.
ULIS-III will also employ some new tools including:
The Upper Limb Focal Spasticity Therapy Recording Schedule (ULSTR), which records the number, duration and types of therapies related to specific goals;
The Spasticity-Related Quality-of-Life Tool (SQoL-6D), which records health utility data and is designed specifically to assess aspects of quality of life that are likely to be affected by spasticity.
Although these new instruments have not been fully validated, they address areas that have been poorly documented in previous studies and for which currently available tools are deficient.
Figure 1 summarises the process for application of measures in ULIS-III.
Process of application of measures in the ULIS-III study. BoNT-A, botulinum toxin A; GAS-eous, Goal Attainment Scaling—Evaluation of Outcome for Upper Limb Spasticity; ULIS-III, third study in the Upper Limb International Spasticity programme.
The ULS Index
The ULS Index is a battery of assessments that can be used to evaluate both patient-rated and clinician-rated components of outcome measurement in upper limb spasticity.
The three main components of the ULS Index are as follows (details provided in table 1):
Severity of presentation and confounders to recovery, including:
Demographics;
Distribution and severity of spasticity and soft tissue contractures;
Severity of impairment
– Local to upper limb (eg, motor control, sensory loss, neglect),
– General (eg, cognitive, behavioural, communicative, mood).
Individual GAS using a structured approach, including:
– Goal Attainment Scaling—Evaluation of Outcome for Upper Limb Spasticity (GAS-eous): Specific, Measurable, Achievable, Realistic and Timed (SMART) goal setting supported by targeted standard measures according to goal areas;
– Patient satisfaction with and engagement in goal setting.
A limited set of standardised measures
The measures applied are determined by the goal areas, so a standard measure is rated ONLY when that category is one of the goals for treatment.
Components of the ULS Index
Standardised measures in the ULS Index
Standardised outcome measures were selected on the basis that they were supported by published evidence of validity and were already used in clinical practice by centres in ULIS-II.
The Modified Ashworth Scale (MAS), which reports variations in muscle tone during flexion and extension, measures severity of spasticity.19 MAS was selected over other spasticity measures as it was demonstrated in the ULIS-I and ULIS-II studies to be the most widely used tool in routine clinical practice.5 ,18
The Upper Limb Spasticity-adapted version of the Neurological Impairment Scale (ULS-NIS) measures severity of functional impairment,20 and was used in ULIS-II.
The Numbered Graphic Rating Scale (NGRS) and Scale of Pain Intensity (SPIN) are visual analogue and verbal rating scales for evaluating symptoms including pain, ease of care, ease/difficulty in performing a task and sleep quality, among others.22
The Associated Reaction Rating Scale (ARRS) is used to measure involuntary movements,23 for example, those associated with walking.
The Arm Activity (ArmA) measure is a standardised scale for determining active and/or passive function.24
The Functional Ambulation Category (FAC)25 and the 10 m walk test record walking ability.
The GAS-eous tool
The GAS-eous tool was designed to provide a structured framework for the application of GAS alongside standardised measures in the context of upper limb spasticity.26 Its development was based on a previous secondary analysis7 that evaluated goals set for the treatment of upper limb spasticity (n=696 primary or secondary goals) according to GAS across four single-centre and multicentre studies.6 ,14 ,27 ,28 GAS for these studies was applied as described by Turner-Stokes,16 an adaptation of the method published by Kiresuk and Sherman.13 Goal definitions were extracted from these previous studies, classified and then mapped onto the WHO International Classification of Functioning, Disability and Health (WHO ICF).29 The results highlighted two domains and six key goal areas, which were incorporated into the GAS structure, along with their associated outcome parameters, to form the GAS-eous tool, as shown in table 2.
Classification of goals and measurement parameters that provide the framework for the GAS-eous tool
The first domain centres on ‘symptoms and impairment’ and includes spasticity-related pain relief, reduction of involuntary movements and improved/maintained range of movement to prevent contractures and deformity. The second domain centres on ‘activities and function’ and includes passive function (making it easier to care for the affected upper limb), active function (using the affected limb for everyday tasks or activities) and improving mobility (eg, maintaining balance, improved gait quality/efficiency). A small number of patients identified goals in other areas such as improving body image (cosmesis) and facilitating therapy.7
For the GAS-eous method, the patient and/or their family identify one primary and up to two secondary goals for treatment. Each goal is classified into one of the six key goal areas. SMART goal statements are then agreed on between the team and the patient/family, using one or more of the recommended goal parameters (wherever possible) to frame the SMART goal statement (see table 2).
The selected goal areas determine the standardised measures used alongside GAS within the ULS Index. Baseline and outcome GAS scores are recorded using the verbal rating scale in the GAS-light model.16 This translates into the five-point rating scale (−2 to +2) and goal scores are combined using the GAS formula to derive an overall T-score using a standard formula.13
The GAS-eous method offers several potential advantages over traditional GAS. The more structured approach is designed to streamline goal setting in busy clinical settings, thus reducing the time taken to apply GAS. In addition, targeted selection of relevant standardised outcome measures reduces the time that would otherwise be spent recording numerous, less relevant measures. Importantly, GAS-eous retains the individualised nature of patient-centred goal setting focused on the patient's own priorities.
GAS is not just a measurement tool. Evidence suggests that engagement of patients in their own goal management can be an effective intervention in its own right.30 Alongside GAS-eous, ULIS-III will record patient engagement in goal setting and their satisfaction with the goals using six-point Likert scales designed specifically for this purpose.21
Further information about the GAS-eous and associated tools may be found at the following websites: http://www.kcl.ac.uk/lsm/research/divisions/cicelysaunders/resources/tools/gas-eous.aspx; http://www.kcl.ac.uk/lsm/research/divisions/cicelysaunders/resources/tools/gas.aspx.
The ULSTR
The ULSTR, a novel instrument designed for the ULIS programme, will record the physical interventions used to manage upper limb spasticity, and relate concomitant therapies to specific goal achievement. These interventions may include splinting, shoulder supports/slings, serial casting, upper limb positioning, stretches, neuromuscular electrical stimulation, strength training or task training. The ULSTR records both the type and intensity of interventions provided to patients. It was developed as part of the proof-of-principle study for ULIS-III as there was no tool available for relating patient goals to the concomitant therapies required for their achievement. The ULSTR is still undergoing full evaluation but will be used in ULIS-III as part of that process.
The ULSTR tool can be found at the following website: www.kcl.ac.uk/lsm/research/divisions/cicelysaunders/resources/tools/Upper-Limb-focal-Spasticity-Therapy-Recording-schedule-(ULSTR).aspx.
The Spasticity-Related Quality-of-Life Tool
SQoL-6D is another novel tool that was designed for the ULIS programme to further assess the quality of life benefits of BoNT-A treatment in patients with upper limb spasticity. It is a self-completed six-item questionnaire intended to evaluate quality of life in relation to upper limb spasticity within the key goal areas defined for GAS-eous (table 2).
SQoL-6D was developed because generic health utility measures, such as the Short Form-36 Health Survey and Assessment of Quality of Life instrument, have proven insensitive for evaluating change in quality of life with focal intervention for upper limb spasticity.15 ,31 SQoL-6D is still undergoing development and evaluation in its original language (English) and has not yet been translated into other languages. ULIS-III will include piloting of the self-completed SQoL-6D in the subset of native English-speaking countries (Australia and the USA). It will be applied in this subgroup alongside the EuroQol Five Dimensions, Five Levels (EQ-5D-5L), a standardised generic health utility measure describing outcomes in five domains: mobility, self-care, usual activities, pain or discomfort, and anxiety/depression.32 ,33
The SQoL-6D tool can be found on the following website: www.kcl.ac.uk/lsm/research/divisions/cicelysaunders/resources/tools/The-Spasticity-Related-Quality-of-Life-Tool-(SQoL-6D).aspx.
ULIS-III study protocol: methods and design
The overall aims of ULIS-III are to describe real-life clinical practice and outcomes in the context of integrated upper limb spasticity management and to gain insights into which patients do best with which approaches to treatment over time. The trial protocol is available on ClinicalTrials.gov.34
Study objectives
The primary objective is to assess the attainment of patient-centred and function-related goals following repeated BoNT-A injections (where used) and alongside integrated upper limb spasticity management in real-life settings over a 2-year period. The primary outcome is the cumulated GAS T-score, defined as the mean of the individual GAS T-scores for all cycles per patient.
Secondary objectives are to:
Describe the baseline characteristics of the study population, including demographics, duration and pattern of spasticity, and confounders (eg, severity of impairment).
Describe injection practices and additional treatment strategies, and record clinical decision-making in the serial approach to spasticity management over time.
Assess the attainment of patient-centred goals by goal area following each cycle of BoNT-A injections and overall attainment after repeated cycles, alongside standardised measures of symptoms, impairment, disability (activity limitation) and participation selected on an individual basis according to the goals for treatment.
Describe and quantify concomitant therapy use and explore its relationship with goal attainment.
Carry out a substudy of ULIS-III that will assess change in quality of life among a subpopulation of patients in Australia and the USA using generic and condition-specific instruments.
Study design and setting
ULIS-III is a 2-year, international, multicentre, observational, prospective, longitudinal cohort study that is expected to enrol over 1000 participants in 58 study centres across 14 countries. The study design is non-interventional and intended to reflect real-life clinical practice.
Study centres will be located in countries with marketing authorisation for at least one BoNT-A preparation for upper limb spasticity treatment. In addition, all eligible study centres must aim to follow the UK national consensus guidelines for the use of BoNT-A in the management of spasticity,1 and be able to collect data using GAS-eous and the tools included in the ULS Index.
The investigators' decision to prescribe BoNT-A must be taken prior to and independently from their decision to enrol the patient, as well as in accordance with routine clinical practice at the study site concerned.
Ethics and dissemination
ULIS-III is conducted in compliance with the Declaration of Helsinki, the Council for International Organizations of Medical Sciences International Ethical Guidelines for Epidemiological Studies35 and the guidelines for Good Pharmacoepidemiology Practices.36 Ethics approval will be sought at each site according to local legislation. All patients must provide written informed consent to participate in the study and to allow their medical data to be collected and analysed, or patient participation must be validated in accordance with local policy/guidelines.
An electronic data capture system (Viedoc 4, PCG Solutions AB, Uppsala, Sweden) will be used by the investigators to collect data in an electronic format; data will then be anonymised and transmitted to the sponsor for analysis.
Since ULIS-III is a non-interventional study, safety data will not be collected or analysed; however, standard regulations for reporting treatment-related spontaneous adverse events still apply within each country.
Study results will be presented at international meetings and published in peer-reviewed journals.
Recruitment
Patients are required to meet the following enrolment criteria:
Adults, ≥18, 20 or 21 years of age dependent on local legislation, with upper limb spasticity, in whom a decision has already been made to inject BoNT-A.
Patients may or may not have previously received BoNT-A injections.
No previous participation in any other interventional clinical study of upper limb spasticity within the 12 weeks prior to their inclusion visit; no previous inclusion and subsequent withdrawal from this study.
A maximum of 20–30 patients per centre will be included. In order to avoid selection bias, patients in each centre will be recruited consecutively or according to a regular pattern.
Treatment
In order to replicate real-life settings, clinicians will make decisions regarding the type of BoNT-A preparation (Dysport (Ipsen Pharma, Paris, France), Botox (Allergen, Inc, Irvine, California, USA), Xeomin (Merz GMBH & Co. KGaA, Frankfurt, Germany) or other) doses used, frequency of injection, target muscles for injection, number of injection points and volume injected per point on an individual patient basis. These decisions will be made according to usual clinical practice or in accordance with the current local summary of product characteristics.
Although recruitment to the study is triggered by a clinical decision to inject BoNT-A, thereafter patients will be followed up regardless of whether they have further injection cycles or not. Patients will undergo assessments and receive further BoNT-A injections at visits arranged according to the investigator's practice. End-of-assessment visits, or phone interviews for those participants who stopped treatment during the study, will be conducted no more than 24 months after the initial BoNT-A injection.
Goal setting and goal attainment assessment
Goal setting and goal attainment assessment will be implemented using the GAS-eous tool,5 ,18 as described above. Procedures to support a high standard of goal setting are detailed below.
Goal attainment will be recorded on a five-point numerical scale (range −2 to +2) and goal scores combined to give an aggregated T-score at each visit, using a standard formula.13 Overall goal attainment will be assessed using the cumulated GAS T-score.
Outcome assessments
The outcome measures for ULIS-III will primarily be captured using the ULS Index together with the ULSTR and the two health utility measures (the SQoL-6D and the EQ-5D-5L, native English-speaking subgroup only), as described above. Table 3 summarises how they will be applied throughout the study.
Summary of outcome measures
For the purposes of comparison with other studies, ULIS-III will also record the Disability Assessment Scale (DAS),37 defining the Principal Target for Treatment (PTT) at each visit.
As part of the ULIS Index, a global assessment of benefits will be performed by the investigator as well as the patient and/or caregiver, with changes from previous visits classified as: much worse (−2), worse (−1), no change (0), some benefit (+1) or great benefit (+2).
Health economic evaluation
Healthcare resource utilisation, including direct clinical costs, indirect costs associated with spasticity and concomitant medications, will be assessed at baseline and at every subsequent visit. These will include assessment of changes in concomitant treatments, such as medications associated with spasticity and pain, changes in employment status and maintenance of healthcare, for example, nurse or caregiver. ULSTR data will be used to determine healthcare resource use associated with upper limb spasticity-related physical therapy.
Utility data (quality-adjusted life-years (QALYs)) for the subgroups of patients in native English-speaking countries will be derived using data from the EQ-5D-5L and SQoL-6D assessment tools.
Study schedule and assessments
The nature and timing of patient assessments will be in accordance with routine clinical practice at the individual study centres. It is expected that some patients will discontinue follow-up within the 2-year period, as spasticity can be a self-limiting condition. End-of-study visits or telephone interviews will be conducted 24 months after recruitment to ascertain the patient's condition and reasons for discontinuing follow-up, if this was the case.
All primary and secondary goals and outcome assessment data will be documented in eCRFs at each visit. To ensure data consistency and accuracy, all amendments to eCRF data once entered will be automatically tracked and a reason for change will be required.
Planned statistical analysis
All statistical evaluations will be performed using the Statistical Analysis System (SAS V.9 or later; SAS Institute, Inc, Cary, North Carolina, USA) according to a preplanned analysis strategy. No formal treatment comparisons will be made; however, results will be reported descriptively with 95% CIs and p values presented for exploratory purposes only. A p value of <0.05 will be considered to indicate statistical significance.
Sample size calculation
Sample size was calculated on the basis of detecting an effect size of 0.5 in the primary end point of cumulated GAS T-score across the full study. Assuming a type I error of 5% (two-sided) and a power of ≥90%, ≥800 patients will allow comparisons between seven goal areas based on cumulated GAS T-scores. This will also allow comparisons with ≥80% power in the case of an unbalanced distribution of up to 3:1 between goal areas. Assuming a 20% dropout rate, the target recruitment number is ≥1000 patients.
Effectiveness evaluation
The cumulated GAS T-score, defined as the mean of the GAS T-scores for each individual patient for all visits over the 24-month study period, will be presented descriptively using summary statistics.
Cumulated GAS T-scores, calculated by goal area, will be compared descriptively, using an analysis of variance model and individual pairwise comparisons, to assess the relative attainment of goals between the different goal areas.
The correlation between goal attainment and change from baseline (visit 1) in the associated standardised measures will be assessed using Spearman's rank correlation coefficients. The observed correlation coefficients will be assessed for difference from zero using a permutation test and p values will be presented. All other secondary end points will be reported descriptively.
Exploratory analyses
The relationship between primary outcome (cumulated GAS T-score) and intervention programme (BoNT-A and physical therapy interventions) will be explored descriptively. A stepwise linear regression model will be used to identify prognostic factors for response, which is defined as an improvement from baseline GAS T-score of at least +10 points. In addition, descriptive analyses will be carried out to evaluate and describe any possible country and centre effects.
Health economics analysis
Estimated direct and indirect healthcare costs associated with upper limb spasticity will be presented descriptively based on assigning unit costs derived from established sources of unit cost data to the healthcare resources used. The sources of unit cost data will be determined at a data review meeting. Cost-effectiveness ratios for cost per response will be based on patients' Disability Assessment Score achievement, which is defined as an improvement of ≥1 point in the DAS score in the principal target of treatment at the end of the study compared with visit 1, with separate analyses performed for each domain. GAS outcomes will also be evaluated for these subgroups. In addition, analyses will be performed on the US and Australian subgroups to evaluate cost per QALY and cost-utility.
Trial status
Recruitment began in January 2015 and patient participation duration is 2 years. It is estimated that the enrolment target of 1000 patients will be achieved by December 2016 and the final analysis of patient data is expected to be completed in the first quarter of 2019.
Quality evaluation of goal setting
The validity of GAS depends on a high standard of goal setting and documentation of SMART goal statements. Goals should be centred on improvement at the level of function, as opposed to impairment, as defined by the WHO ICF.29
In ULIS-II, an interim validation process was undertaken part-way through recruitment to ensure that clinicians were setting SMART function-related goals in accordance with the training.18 Goal statements were examined on a centre-by-centre basis and investigators were blinded to country and centre. Statements were assessed on two criteria: the WHO ICF domain for function (A, B, C); and the quality of the SMART description (− to ++), as previously described.18 It was accepted that, for some patients, goal statements would be impairment-related (eg, prevention of contractures). However, investigators expected that at least some goals from each centre would be related to function. The clinicians received feedback and had the opportunity to improve the quality of their goal statements for patients who had not yet returned for their second visit. This led to documented improvement, but by the end of the study only 25% of centres achieved the top rating (A++).18
Part of the rationale for development of the GAS-eous tool was to improve the quality of goal setting, and the recruiting centres (many of which also recruited for ULIS-II) have undergone further training for ULIS-III. Goal reviews, validation and feedback by the Steering Group will also be conducted at more frequent intervals throughout the recruitment phase to facilitate a high standard of goal setting.
Participant recruitment was initiated in January 2015. By the first goal review in June 2015, 58 sites had been selected globally, over half had received training on the study and 15 sites had started recruitment across five countries, including Australia, Austria, France, Russia and Poland. Initial patient data have been collected for 79 patients across 13 sites in three countries. Of these 79 patients, 42 set primary goals only, 24 also set one secondary goal and 13 set two secondary goals in addition to a primary goal. Goal setting data were quality checked and centres were given a rating based on the WHO ICF and SMART guidelines, as described above.18 As shown in table 4, 11/13 centres achieved the highest rating (A++).
Goals set and centre ratings at visit 1
Goals were organised into two domains and subdivided into six key goal areas. The most common areas for primary goals were passive function (30/79 (38.0%)) followed by active function (17/79 (21.5%)) and pain (17/79 (17.7%)). Although the percentages varied slightly, the total 129 goals, including secondary goals, represented a broadly similar pattern. Only two primary goals did not fit into these six key goal areas—these addressed improvement of cosmesis (perception of body image) and the facilitation of therapy. These findings provide support for the validity of the goals classification that underpins the GAS-eous tool.
Discussion
The ULIS programme sets in train a methodology that is practical for use in routine clinical practice and in future studies. This methodology will enable studies to expand their clinical data set to one of sufficient size to elucidate important findings, including which patients are most likely to benefit from what types of treatment and how best to capture the outcomes.
ULIS-III will build on previous studies that have used goal attainment to evaluate outcomes from upper limb spasticity interventions.5 ,6 ,38 It will expand the patient cohort and capture the benefits of treatment in real-life clinical practice over several treatment cycles. ULIS-III will use a more structured approach to outcome measurement incorporating both GAS and standardised measures in a targeted way that is feasible to implement in clinical practice. In addition, it will assess the wider benefits of BoNT-A treatment for upper limb spasticity by evaluating economic and quality of life data, as well as concomitant therapies.
Initial data from the inclusion visits of 79 patients across 13 centres in three countries provide support for the validity of the goals classification that underpins the GAS-eous tool, and demonstrate a high standard of goal setting in the majority of centres.
Strengths and limitations
The strengths of the ULIS-III approach include the wide international representation of participating centres, which will capture the experience of clinicians from around the globe, ensuring the generalisability of results. The use of patient-centred goal setting and GAS in ULIS-III will enable the assessment of outcomes that are important to the patient and/or their family while maintaining realistic expectations for the outcome. In addition, the structured approach to GAS in parallel with standardised measurement may improve the comparability of results across different settings. Moreover, a high standard of goal setting is supported by a comprehensive GAS training programme and interim goal reviews.
However, there are recognised limitations of the ULIS-III approach. Recruitment is restricted to 20–30 patients per centre, which may introduce some selection bias through under-representation of less common presentations of spasticity. In addition, the use of tools that are still undergoing evaluation (ULSTR and SQoL-6D) means that the data generated from these will be less robust. However, they may help to fill gaps in knowledge for which no prevalidated tools exist currently.
Despite the recognised limitations, ULIS-III will provide a unique and important set of information regarding treatment with and outcomes from BoNT-A in real-life management of upper limb spasticity worldwide. The present methodology will help to ensure credibility of results from ULIS-III, and will also underpin future studies and inform other clinical trials and cohort studies in this context.
The ULIS Programme Steering Group
Expert clinicians: LT-S (clinical lead), SA, KF, JJ
Ipsen staff: JB, PM, Hugues Berard
Acknowledgments
This work was supported by Ipsen Pharma. The authors thank all the investigators and patients who have participated in the ULIS programme and, in particular, Steve De Graaff and Ian Baguley, Australia. They also acknowledge the work of the ULIS-III project managers at Ipsen, Isabelle Gueguen and Elodie Blouquit. In addition, the authors would like to acknowledge the local coordinating investigators involved in training local investigators: Ian Baguley, Mario Nunzio Manca, Tae Mo Chung, Andrzej Friedman, Alexis Schnitzler, Jorge Hernandez Franco, Svetlana Khatkova and Raymond Rosales. They would also like to acknowledge the editorial assistance of Watermeadow Medical. Ipsen Pharma provided financial support for this assistance. Financial support for manuscript preparation was also provided through the Dunhill Medical Trust.
References
Footnotes
Contributors The protocol for ULIS-III was developed by Ipsen Pharma in conjunction with the ULIS Programme Steering Group. LT-S wrote the first draft of this manuscript but all authors were involved in its critique, adjustment and final approval. LT-S, SA, KF and JJ were involved in data collection and assembly of data. PM and JB were involved in the concept and design, and the plan for data analysis was led by PM.
Funding Ipsen Pharma.
Competing interests LT-S, SA, KF and JJ all received honoraria and conference attendance fees from Ipsen for undertaking this research. LT-S and SA have a specific interest in outcomes evaluation and have published extensively on the use of GAS in this context, as well as a number of the other standardised measures (including the ARRS, the ArmA and the Neurological Impairment Scale). All of these tools are freely available, however, and they have no personal financial interest in any of the material mentioned in this article. SA receives funding from the National Institute of Health Research (NIHR) in the form of a Clinical Lectureship award and an NIHR CLAHRC Northwest London fellowship. KF has a specific interest in outcomes evaluation and the use of the International Classification of Function in clinical settings. JJ has a particular interest in clinical and instrumental spasticity evaluation methods, goal setting, treatment strategies/techniques and outcome measurement. PM and JB are employees of Ipsen.
Disclaimer The views expressed are those of the authors and not necessarily those of the National Health Service, UK (NHS), the NIHR, NIHR CLAHRC Northwest London or the Department for Health, UK.
Ethics approval See Health Authorities list here: https://clinicaltrials.gov/ct2/show/study/NCT02454803.
Provenance and peer review Not commissioned; externally peer reviewed.