Introduction A French national smoking cessation service, Tabac Info Service, has been developed to provide an adapted quitline and a web and mobile application involving personalised contacts (eg, questionnaires, advice, activities, messages) to support smoking cessation. This paper presents the study protocol of the evaluation of the application (e-intervention Tabac Info Service (e-TIS)). The primary objective is to assess the efficacy of e-TIS. The secondary objectives are to (1) describe efficacy variations with regard to users' characteristics, (2) analyse mechanisms and contextual conditions of e-TIS efficacy.
Methods and analyses The study design is a two-arm pragmatic randomised controlled trial including a process evaluation with at least 3000 participants randomised to the intervention or to the control arm (current practices). Inclusion criteria are: aged 18 years or over, current smoker, having completed the online consent forms, possessing a mobile phone with android or apple systems and using mobile applications, wanting to stop smoking sooner or later. The primary outcome is the point prevalence abstinence of 7 days at 6 months later. Data will be analysed in intention to treat (primary) and per protocol analyses. A logistic regression will be carried out to estimate an OR (95% CI) for efficacy. A multivariate multilevel analysis will explore the influence on results of patients' characteristics (sex, age, education and socioprofessional levels, dependency, motivation, quit experiences) and contextual factors, conditions of use, behaviour change techniques.
Ethics and dissemination The study protocol was reviewed by the ethical and deontological institutional review board of the French Institute for Public Health Surveillance on 18 April 2016. The findings of this study will allow us to characterise the efficacy of e-TIS and conditions of its efficacy. These findings will be disseminated through peer-reviewed articles.
Trial registration number NCT02841683; Pre-results.
Statistics from Altmetric.com
Strengths and limitations of this study
Large national randomised trial in pragmatic conditions.
Process analysis within the trial using Medical Research Council framework and behavioural change techniques taxonomy in order to understand mechanisms and conditions of efficacy.
Every year, smoking causes 6.1 million deaths worldwide and an estimated 143.5 million Disability Adjusted Life Years (DALYs).1 Health risks associated with smoking depend on two factors: daily consumption2 and duration of smoking. Conversely, smoking cessation is good for health and the sooner a smoker quits, the better.3 ,4 People who stop smoking by the age of 40 reduce their likelihood of dying from smoking-related diseases by over 90%, and by the age of 30 the figure stands at 97%.3 Those who quit at 40 live 7 years longer and at 50 live 4 years longer4 compared with those who do not quit. In addition, smoking cessation does not just reduce mortality; it also brings down morbidity.5
Various types of support and treatment are available, with varying results. Best evidence examples include: individual professional counselling,6 nicotine replacement therapy (NRT), motivational interviewing,7 group behavioural therapy,8 nursing interventions,9 self-help tools10 for patients who prefer not to seek the help of a healthcare professional or call helplines,8 support via mobile phone text messaging.11 Whatever the method used, the relapse prevention model12 stresses the need to provide greater support in the so called high-risk situations. Non-pharmacological treatments must therefore be tailored to the patient to deal adequately with different immediate determinants (high-risk situations, coping skills in front of high-risk situations, outcome expectancies and the abstinence violation effect) and the covert antecedents (lifestyle factors, stress, denial, cravings) as these factors can contribute to relapse.
Drawing on this knowledge, the Caisse Nationale d'Assurance Maladie des Travailleurs Salariés (CNAMTS) (the French National Health Insurance Fund) and the national agency of public health (Santé Publique France—Public Health France) with the support of the French smoking cessation specialists association (Société Francophone de Tabaccologie) have come together to design, experiment and assess a new e-coaching intervention named e-intervention Tabac Info Service (e-TIS). The intervention is a mobile phone application designed to provide intensive support to smokers who are wishing to quit, including those who are not currently trying to. It is based on the effectiveness criteria of online programmes,12 psychosocial and behavioural change theories13–19 and the expertise from Société Française de Tabacologie (SFT) members. E-TIS aims, therefore, to help smokers to progress through different stages (contemplation, intention, action) by providing tailored activities, self-reporting exercises, tips and social or psychological support, reassurance and motivational text messages. All these contacts are adapted to individual characteristics and level of progress. This article describes the protocol used to assess it. The protocol follows the recommendations of the Consolidated Standards of Reporting Trials (CONSORT)20 and Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 guidelines.21
The primary objective is to assess the efficacy of e-TIS. The secondary objectives are to (1) describe efficacy variations with regard to users' characteristics, (2) analyse mechanisms and contextual conditions of e-TIS efficacy.
Methods and analyses
The intervention is complex and many variables influence the outcomes. To achieve the secondary objectives of the study, we have followed the recommendations of the Medical Research Council (MRC)22 ,23 and the Workgroup for Intervention Development and Evaluation Research (WIDER).24 In 2000, the MRC published a framework, updated in 201225 concerning the evaluation of complex interventions. The framework stresses the need to base the intervention on a theory in order to understand which components are effective and in which conditions.
In 2007, following the 21st annual conference of the European Health Psychology Society, the WIDER issued a consensus statement which outlined that specific behavioural change intervention (BCI) reporting has to be used in conjunction with the CONSORT statement. The philosophy is that greater clarity about the functional components of behaviour change interventions is essential to ensure that interventions are delivered to influence outcomes. The WIDER recommendations are now an established framework for identifying and describing the essential components for detailed reporting of BCIs. In line with these frameworks, our second objective is to assess the intervention's key functions,26 in other words, the environmental or intervention components that determine its efficacy. To achieve this, we will draw on the taxonomy by Michie et al27 ,28 which has enabled us to describe the behavioural change techniques (BCTs) used in the intervention. We will also report the external environmental or social factors and consider additional individual characteristics that could influence the efficacy of the intervention.
The evaluation will be conducted as a pragmatic randomised controlled trial combined with a process analysis. The e-TIS intervention will be compared against current practices for smoking cessation as set out on a non-interactive website (ameli-sante.fr, Cnamts).
To do this, the evaluation sets out the smoking cessation treatments as recommended by the Haute Autorité de Santé (HAS); independent national scientific body with a broad remit on health and healthcare issues) and consists of two arms: the intervention arm (use of the e-TIS intervention) and a control arm (current practices).
This pragmatic trial takes place in France on a national level. The application was launched in October 2016. The evaluation will take place between 1 January 2017 and 1 March 2017.
Inclusion criteria are: all adult smokers, who have completed the online consent form, agreeing to participate in the study, possessing a mobile phone using apple and android system, willing to use applications, and envisaging quitting smoking (in the short, medium or long term). An inclusion questionnaire is included with the consent form to screen potential participants (smoker or not, age, sex, wish to stop smoking, smartphone use) and to identify the technical characteristics for setting up the study (eg, randomisation), such as email and phone number.
The required sample size was calculated using a hypothesis of a 10% abstinence rate at the 6-month follow-up (similar to the rate observed in the StopAdvisor trial.29 Given a rate of 10% in the control group, a sample of 1500 subjects per group is required to show an OR of 1.5 (ie, a rate of 14% in the intervention group) with a power of 90% (α 0.05, bilateral test), meaning a total of 3000 persons.30
Subjects will be recruited as the e-TIS website becomes operational and over three full months (January–March 2017). The study will start in January 2017 and end in July 2018. Data will be collected over 12 months. Recruitment will be via France's national health insurance fund's website Ameli: http://www.ameli-sante.fr. Subjects will log on to the Ameli website where they see a banner for the study. If they click on the banner, they will be taken to the website of the study and will be invited to participate. Here they will find an information sheet along with a section where they can give their informed consent. The consent form contains the inclusion questionnaire. If consent is given, a confirmation email will be sent to the person (link to click on). Once the volunteers have confirmed, they will be randomised, and a second email and a text message will be sent to them. These contain a password so that they can log on to the entry questionnaire (T0) for the study. And once this questionnaire is completed, the participants will be assigned to one of the study arms. Figure 1 shows the procedure. Given that the Ameli website has an average of 1.8 million single visits per month and the prevalence of smokers in the French adult population is above 30%,31 we could estimate that ∼600 000 smokers will be connected in a 3-month period. The inclusion period can be adapted to the actual number of people volunteering. Please note that during the first month of operation of e-TIS, 33 000 persons downloaded this application, which is an argument for the feasibility of the inclusion process.
Automated randomisation will be carried out following receipt of all necessary data, and consent by the subject to participate in the study. A minimisation software package will be used to reduce of the risk of unmatched groups and will be applied to stratify participants according to sex and age using the following parameters: two treatment arms, e-TIS (E) and Ameli.fr (A) allocated 50/50; stratified by sex (M/F) and by age (±45 years old); drawn for the first 30 subjects, 5% drawn, 0.96 randomisation factor.
Intervention arm: participants will be assigned to one of two arms before the treatment begins. Those participants assigned to the intervention arm will be exposed to the e-TIS intervention. In keeping with the precepts of the relapse prevention model, the treatment will be individually tailored to each smoker throughout, based on feedback collected along the way. The support process draws on the efficacy criteria of online programmes (frequency and intensity of contacts, short messages, interactivity, appeal, personalisation, credibility of content, share functions) and various theoretical models used in withdrawal treatments.
The intervention will primarily involve personalised interactive (push) contacts via mobile phone, website platform and tablet. These contacts are questionnaires, advice, activities and text messages. The intervention comprises 16 different activities and eight position questionnaires with different purposes. The position questionnaires are designed to help smokers to progress: A questionnaire to guide participants through the modules; a questionnaire about smoker status; a customisation questionnaire (presence of other smokers, e-cigarette use, cannabis consumption, contraceptive methods, pregnancy, just gave birth, cardiovascular or respiratory diseases, previous quit attempts); a dependency questionnaire; a questionnaire about support preferences; a questionnaire about withdrawal symptoms; a questionnaire about self-efficacy; a questionnaire about craving.
The purposes of the 16 activities are:
AC1—Decisional balance: to define and prioritise the pros and cons of quitting.
AC2—Fears and obstacles: to identify fears and obstacles associated with quitting and to obtain some information or reassurance about smoking cessation.
AC3—The cigarette log: to report daily cigarette consumption and define the cigarettes really appreciated and important and furthermore difficult to leave.
AC4—Cost of smoking: to be aware of the cost of smoking (modules 1 and 2) and the savings to be made if one quits (module 3).
AC5—Quit date choice: to help the smoker choose the best time to attempt quitting, and to enroll the support of others who should be aware of the quit date.
AC6—My motivations: to review the smoker's motivation to take the decision to stop smoking (module 1), strengthen this (module 2), to reiterate the decision to quit and provide encouragement through the cessation process (module 3).
AC7—Nicotine Replacement Therapy (NRT): to facilitate the use of NRT, improve knowledge about them.
AC8—Social support: to use friends' videos as a way to gain the support of the smoker's entourage.
AC9—Craving: to obtain ideas of occupations, through videos, to manage craving; to play games, to receive practical advice and information about stress management techniques, use of NRTs and so on.
AC10—Progress and benefits: to track progress in smoking cessation and visualise it since the beginning.
AC11—Stress management: to provide various stress and emotion management techniques
AC12—Question and answer: to send questions to a smoking cessation specialist at the TIS platform.
AC13—Telephone directory: to find a smoking cessation specialist.
AC14—Click to call: to call a smoking cessation specialist at the TIS platform
AC15—Weight management: tips on weight management.
AC16—Quit checklist: once the quit date has been set, the smoker receives advice to make a plan to quit. He/she can refer to it and check off the tasks completed.
There is also a set of email or push-app text messages/notifications (roughly 170) with various purposes: welcome messages for each module; messages promoting activities and questionnaires, reminders and follow-up messages, unidirectional messages (personalised or not) to provide advice and encouragement to use the application; personalised messages relating to the answers at the different questionnaires; messages about the quitting date.
In addition, all contacts are tailored to the answers from the eight position questionnaires in the application, and on the smoker's progress through the four of the application's modules:
Module 1—Participants are not yet ready to quit smoking (they have yet to set a quit date). This module is intended to increase the participants' resolve/resoluteness/resolution to quit and help them set a stopping date. Participants only leave this module once they have set a quitting date. Tailoring: text messaging is not intense at this stage and activities mainly designed to enhance motivation, report pros and cons, reach a balanced decision and so on.
Module 2—Participants are ready to quit (they have set a date). This module aims to provide the best possible conditions to help participants prepare in the run-up to their quitting date. Participants leave this module on the morning of their quitting date unless they choose to cancel, in which case they return to module 1. Tailoring: text messaging will be intensive the day before the quit date and activities are mainly aimed at providing social support, pharmacological support, at setting challenges and so on.
Module 3: Participants have stopped smoking. In this module they are given support and advice in detecting and avoiding possible relapses. Tailoring: text messaging will be highly intense. Activities are focused on reassurance, social comparison, social support and information about relapses and so on.
Module 4—Participants have relapsed. This is a short-term module whose purpose is to help willing participants to manage their relapse and return to either module 1, 2 or 3. They can leave module 4 once they have completed a questionnaire designed to ascertain which module they should reintegrate. Tailoring: activities and text messaging aim to reassure and remotivate the smoker.
Participants start with the module adapted to their stage with regard to tobacco consumption (ie, module 1: participants are not yet ready to quit smoking; module 2: participants are ready to quit; module 3: participants have stopped smoking; module 4: participants have relapsed.)
This process is presented in table 1.
Participants assigned to the control arm are exposed to an information page which lists smoking cessation resources readily available in France and recommended by HAS.32 This is the common practice pathway. Participants are given a link to access the page and there are four tabs:
The effects of smoking: this section provides information about how tobacco affects morbidity, mortality and quality of life.
The benefits of a smoke-free life: this section provides information about the short, medium and long-term benefits of smoking cessation and how quality of life is likely to improve.
Your current situation: this section involves conducting a small survey about the participants' smoking habits to assess their levels of consumption, dependency and motivation to quit.
How to quit smoking: this section informs smokers about the various cessation methods recommended by HAS and how to apply for them.
For the main analysis, the primary end point is minimum 7-day point abstinence at 6 months. To define the 6-month follow-up, we follow the recommendations of the Cochrane review on internet-based intervention and mobile interventions11 ,12 and of the European Medicines Agency.33 Point prevalence abstinence (PPA) is considered the most appropriate measure for intervention evaluation studies.34 The National Interagency Council on Smoking and Health recommends PPA for a minimum 24 hours at 3 months, 7-day abstinence at 6 months and 30 days at 12 months.35 Biochemical validation will not be used; for most situations, and particularly in community-based interventions (vs clinical interventions) and with an adult population,35 the misreporting rates are relatively low, typically near zero and seldom exceeding 5%. In such settings biochemical validation of the study is not necessary given its cost and its lack of acceptance.35
continuous abstinence at 6 months
continuous abstinence at 12 months
minimum 24-hour point abstinence at 3 months
minimum 30-day point abstinence at 12 months
number and duration of quit attempts
progress through the four modules in the intervention (module changes and length of stay in each).
Other data will be collected in order to characterise consumption, dependency, determinants of abstinence and the process. This will allow us to explain the results obtained and to achieve our secondary objectives. Table 2 sets out these data:
Primary and secondary outcomes collection
The measures in both arms will be internet-based. Data will be collected via self-reporting questionnaires at set times (T+3, 6 and 12 months).
Other data collection
The measures in both arms will be internet-based except for data relating to e-TIS components which only concerns the intervention arm (E).
Data will be collected from four sources: an inclusion questionnaire (technical variables), an initial self-reporting questionnaire at T0, three follow-up self-reporting questionnaires (T+3, 6 and 12 months) and routine collection via the internet platform of e-TIS. In the T0 questionnaire, the data collected will be differentiated according to the entry point into the intervention (1–4). In the follow-up questionnaire, the data collected will be differentiated according the participant's status: has stopped smoking or not. Table 3 describes how each measure will be recorded.
At each follow-up point, an email and text message will be sent twice as a reminder. Throughout the study, there will be routine and ongoing data collection via the system for the intervention arm only (E).
The efficacy will be analysed using blind analysis by comparison at 3, 6, 12 months in both arms using the primary and secondary endpoints. In the main analysis, data will be analysed by intention to treat and then by per protocol analyses. For the main analysis, those participants lost to follow-up (those who don't answer the questionnaires) will be considered smokers as recommended.12 ,33 ,41 For the secondary analysis, we will only consider those who will not be lost to follow-up. The efficacy analysis will be blinded to the randomisation group, but the processes and mechanisms by their nature will be analysed openly. The proportion of quitters in each arm will be estimated, as well as an OR and its 95% CI by logistic univariate regression. We will also conduct an analysis on efficacy in subgroups using the following predefined variables: socioprofessional classification, sex, age, point of entry onto the intervention. Multiple imputation methodologies will be used to limit the amount of possible missing data.
To assess the processes, we will clarify the intervention components (the BCTs used in e-TIS) and the environmental components (beneficial and adverse factors for cessation) to which the subjects have been exposed. We will also look into how e-TIS has been used (frequency and duration of use, the activities performed). To conduct this analysis, we will proceed in three stages:
Stage 1: characterise the intervention theory
This involves attributing one or several BCTs to each contact, such as a message, an activity and a questionnaire, between the user and the e-TIS intervention, which will establish the generic intervention theory of the said intervention (components).42 ,43 This will be carried out by a multidisciplinary committee. It will take three iterative steps: (1) two groups of researchers will attribute BCTs to contacts, (2) both groups will compare their results and draw a consensus and (3) researchers will present their results to the committee which will in turn draw a consensus. All components of e-TIS will be identified as universal BCTs of the taxonomy.
Each user will go through the intervention in his/her own way and this intervention theory will come across differently according to a combination of contextual factors including the pathway taken and the use of the website. This all leads to different intervention doses (number and type of BCTs to which the user is exposed) and to different response doses (module changes, end of platform use, smoking cessation, relapse and so on).44
Stage 2: describe the pathway of users in the intervention arm
In this stage we will describe the user pathways within the e-TIS intervention, looking at the combinations of BCTs to which users are exposed (number, type, associations), the types of environmental and social factors encountered (social support, substitutes, life events and so on) and the use of the e-TIS platform. From this we will be able to identify the most common pathway used through the intervention. To identify cluster of participants following similar pathway we will use the SAS Proc Traj.45 This procedure is a specialised application of finite mixture modelling designed to identify clusters of individuals following similar progressions of an outcome over time (or trajectory). Outcome variable will be smoking status (ie, abstinence, quit attempts); time-varying dependent covariables will be BCTs used, progress through the modules and other factors measured during follow-up.
Stage 3: analyse the influence of user characteristics, processes, context and exposure to BCTs on the outcome
The clusters developed stage 2 will be used as dependent variables in a model designed to analyse the influence of users' characteristics (eg, sociodemographic, dependency, motivation, quit attempts or experiences, added support, contextual factors) on the trajectory. For that we will use a multivariate, multilevel (ie, participants, entry module and identified pathway) statistical analysis using the SAS Proc Mixed.46 The purpose of this analysis is to clarify how the generic theory best applies to the different users going through the intervention. It will therefore enable us to assess the mechanisms and conditions of the theory's efficacy, in relation to options for the degree of intervention, exposure to context and to the different dose responses.
Ethical considerations and dissemination
Participants must give their informed consent to participate in the study. They will be informed that they can refuse and drop out at any time. Subjects in the control arm will be asked to register to the e-TIS website once they have been deemed suitable for treatment via an initial evaluation. The data collected and processed in this study will be performed so in compliance with the Act of 6 January 1978 on Data Processing, Data Files and Individual Liberties, as amended by the Act 2014–801 of 6 August 2004. The CNAMTS has a compliance undertaking with the Commission Nationale Informatique et Libertés (CNIL) (national body for data protection) as set out by Decree no. 2012–1249 of 9 November 2012 in the Conseil d'Etat (Council of State) which authorises public health insurance funds (CNAMTS) to implement healthcare prevention and support programmes for their beneficiaries.
The study protocol was reviewed by the ethical and deontological institutional review board of the Institut National de Veille Sanitaire (INVS) on 18 April 2016. All the proposals and recommendations put forward by the ethics committee have been followed and integrated into the amended version of the protocol.
Behavioural change interventions are complex, with outcomes depending as much on the intervention itself as on participant characteristics and the context of intervention delivery.23 ,26 ,47 In the case, this variability is borne out in the literature—the demonstrated effects are very heterogeneous due to the influence of the population characteristics, the way the intervention is used by participants, and the context in which it is used. This is further compounded by the fact that the intervention is dematerialised and that each participant has a unique experience of it.
In view of the above, participant compliance should be improved and the support provided within the intervention should be fully tailored to the circumstances of each participants. For this to happen, we will need to work on two levels: intervention design and evaluation design. Consequently the intervention has been based on data from literature and from the most used theoretical models used for helping people to quit. We have developed an evaluation protocol that no only allows us to conduct a thorough assessment of the intervention's efficacy via the Randomized Control Trial (RCT) and seeks to clarify the conditions of its efficacy. These conditions relate to the participants; the different components of the TIS used by the participants; the psychological, social and environmental factors possibly affecting the participants during the study. To guide us, we use the references currently in use for evaluating complex interventions.
In this respect we hope both to contribute to better demonstrating the efficacy of online and mobile phone interventions, and to influence prevention strategies through an understanding of compliance and change phenomena.
The authors wish to thank Jocelyn Courtois (CNAMTS), Eliane Albuisson, Marc Borie, Geoffroy Cagninacci (CHU de Nancy) and Viêt Nguyen-Thanh (Santé Publique France).
Contributors LC and FA deal with the scientific coordination of the whole study; PB, IV, AP, Anne Laurence Le Faou ( ALLF), BL, TD and PA designed the e-TIS intervention; LC prepared the first draft; all authors reviewed and contributed to the article.
Funding This study is funded by the CNAMTS for the period 2016–2018.
Competing interests ALF reports grants from Pfizer, non-financial support from J&J, outside the submitted work; DT reports personal fees from Pfizer, personal fees from Novartis, personal fees from Pierre Fabre Santé, outside the submitted work.
Provenance and peer review Not commissioned; externally peer reviewed.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.