Article Text
PDF
Abstract
Introduction The development of emotional competences may be a protective factor for mental health problems, promoting well-being at such a complex age as adolescence. Technologies may be used to carry out this empowerment because adolescents are attracted to them. The purpose of the study is to design a serious game based on the Mayer et al’s emotional intelligence ability model and analyse the effectiveness of the emoTIC programme to develop emotional competences, well-being, mental health, and personal strengths immediately after completion and at 12 months.
Methods and analysis The new version of emoTIC will be designed following the suggestions of the adolescents who participated in the pilot study and the results obtained from the statistical analysis. The participants will be 385 adolescents aged 11–16 years who will be randomly assigned to the control group and the experimental group. The experimental group will complete the emoTIC programme. The primary outcomes include emotional competences and subjective well-being. The secondary outcomes are self-esteem; general self-efficacy; personality; social and personal responsibility; school social climate; somatic complaints; depression, anxiety and stress symptoms; emotional and behavioural difficulties; suicidal behaviour; and subjective happiness. Data will be collected at three moments: baseline (T1), immediately post-intervention (T2) and 12-month follow-up (T3). The effectiveness of the programme will be analysed using different statistical packages.
Ethics and dissemination The study has been approved by the Ethics Commission of the University of Valencia (H152865096049), and the standards of the Declaration of Helsinki to collect the data will be followed. Results will be disseminated across the scientific community.
Trial registration number ClinicalTrials.gov Registry (NCT04414449).
Trial sponsor University of Valencia. Principal investigator: Inmaculada Montoya-Castilla.
- mental health
- community child health
- child & adolescent psychiatry
- depression & mood disorders
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
A strength of this project is to provide a serious game to promote emotional competences and well-being adapted to the needs of adolescents.
The emoTIC programme will be available from any device (e.g., laptops, smartphones, tablets or computers) making it accessible to the majority of adolescents.
The emoTIC programme is based on a solid theoretical model previously used in other programmes for the development of emotional competences which have shown positive outcomes.
Family is not included in the intervention, which can be seen as a limitation of the programme.
Introduction
According to the World Health Organization (WHO), over 17 million adolescents, between 10 and 19 years, experience mental health problems such as depression, anxiety or behavioural disorders1; and suicide is the second leading cause of death among young people worldwide.2 3 Thus, a high number of adolescents suffer from emotional problems and will need pharmacological or psychological treatment. This is a public health problem whose prevention and treatment should be considered a priority.
The role of emotional intelligence
Intervening in emotions during adolescence is essential because it is a turning point in life with the development of new psychosocial and cognitive possibilities that have a neurobiological substrate.4 An adequate emotional development at this age would contribute to subjective well-being, fostering adjustment and preventing externalising and internalising problems,5 6 as well as improving social relationships in different contexts (peers, family, school, etc.).7 8 Emotional intelligence is a buffer against the negative effects of stress9 and it is considered a protective factor for suicidal behaviour.10
Empirical evidence suggests that emotional education programmes are effective and may provide several benefits to adolescents.11 For example, adolescents increased their intrapersonal and interpersonal emotional intelligence, and improve their stress management and general mood with a programme based on Bar-On’s model12; and emotional programmes based on Mayer and Salovey’s model improved adolescents’ ability to perceive and manage emotions and satisfaction with life, while cyberaggression was reduced.8 Therefore, a web-based application such as emoTIC, which permits to follow a full intervention promoting emotional competences, may help to enhance adolescents’ mental health.
The role of technology
One of the fundamental challenges with adolescents is to get them involved in the therapeutic process and motivated to carry out prevention and intervention programmes.13 Promoting learning and well-being through technologies could improve the motivation of adolescents to engage in socioemotional programmes.14 The use of digital interventions for promoting mental health and preventing mood disorders in adolescents has promising results.1 In addition to technology, games can facilitate learning and promote motivation.15 In recent years, digital educational interventions have been implemented to prevent suicide16 or decrease depression and anxiety,17 but fewer focus on the development of emotional competences. Among the programmes designed to promote emotional competences, the following may be highlighted: the MoodGYM programme18 was designed to prevent symptoms of anxiety and depression in adolescents (12–17 years); the Think, Feel, Do programme19 was developed to improve mental health and prevent emotional and behavioural problems in healthy adolescents (10–12 years) and adolescents with emotional health problems (moderate anxiety or low mood) (10–16 years); the Bite Back programme20 was designed to improve adolescent well-being and mental health (12–18 years); the CopeSmart programme21 22 was focused on developing mental health through emotional self-monitoring and the promotion of positive coping strategies (15–18 years); the video game Happy23 was designed to train emotional competences in situations both in everyday life and peer conflict at school, as well as to recognise and regulate emotions and learn adaptive and assertive responses (8–16 years); the multimedia programme Developing Emotional Intelligence24 and the video game Spock6 were focused on developing the four Mayer and Salovey’s competences of emotional intelligence in adolescents (8–14 years and 17–18 years, respectively); the video game Aislados25 was designed to improve the social competence and socioemotional well-being in adolescence (12–17 years); finally, the online video game REThink is one of the most rigorously investigated video games aimed to promote emotional resilience, prevent mental health and develop emotional skills.26–29 REThink is based on positive preventive programmes derived from rational emotive behavioural therapy and education, and it is addressed to adolescents aged 10–16 years. This kind of programmes showed effectiveness to promote emotional competences and mental health. However, to our knowledge, there are few serious games focused on emotional competences based on Mayer and Salovey’s model and other related variables implemented through mobile devices that have proven their effectiveness in healthy Spanish adolescents aged 11–16 years, neither rigorously tested using a sample equally distributed by gender and a control group.
The current study
The development of emotional competences may be a protective factor for mental health problems, promoting adolescents’ well-being. Technologies may be used in a positive way to carry out this empowerment because adolescents are used and attracted to them. Thus, the aims of the research are to design a serious game intended to prevent mental health problems and promote well-being in healthy Spanish adolescents between 11 and 16 years old; and to analyse its effectiveness to develop emotional competences and personal strengths immediately after completion of the programme and up to 12 months. The study hypotheses are: (1) adolescents in the emotional ability programme will show an improvement in emotional competences, personal strengths and well-being, and less mental health difficulties than adolescents in the control group; and (2) improvements will be maintained up to 12 months.
Methods and analysis
Following the Standard Protocol Items: Recommendations for Interventional Trials statement,30 the current study protocol describes the details of the study rationale, proposed methods, organisation and ethical considerations.
Study design and setting
A pilot study with a preliminary version of emoTIC was carried out in 2019, showing benefits in adolescents’ self-esteem, hedonic balance and emotional symptoms.31 Participants informed that they have learnt emotional competences, social skills, and personal strengths; and suggested modifications to the duration, content, game mechanics, and design of the programme.32 These suggestions were incorporated into this new version of emoTIC. On the technical side, the programme has been transformed into a self-applicable tool and the graphics have been refined. On the content side, competences such as stress coping strategies, assertiveness or self-efficacy were added. This protocol describes an interventional quasi-experimental study, randomised clinical trial.
Participant timeline
The overall study was initiated in 2018 and the design of the platform was carried out during that year. In 2019, participants were recruited for a pilot study in order to test the platform and improve the programme. The main study is planned to take place from January 2021 until March 2022 (table 1). The main objectives of the phase I are the selection of targeted high schools, the request for informed consent and the initial assessment. Contact will be first with high school principals who have already manifested their interest and then will be extended to other centres in Spain. After the meetings with the principals, we will request informed consent from the families and adolescents who will participate in the programme. Prior to the implementation, adolescents will be requested to complete a battery of questionnaires. The main objective of the phase II is the implementation of the programme. Students will access the programme’s website (www.emoticspace.com) and fulfil the activities of the programme in a maximum period of 3 months. Tutors will be involved to motivate the adolescents, as well as to monitor their progress. The main objective of the phase III is to analyse the effectiveness of the emoTIC programme. Once it has been completed, the variables assessed before the implementation will be reassessed. Also, a follow-up assessment will be carried out up to 12 months later. The principal investigator will make the final decision to terminate the trial.
Time schedule for the study
Participants and eligibility criteria
Participants will be recruited from Spanish high schools. To participate in the project, adolescents between 11 and 16 years old will be requested to voluntarily accept to participate in the study. They and their legal guardians will have to sign the informed consent for participation (inclusion criteria). Exclusion criteria will be having a high rate of school absenteeism, not understanding the Spanish language and a diagnosis of psychological disorder.
Patient and public involvement
Participants were involved in the design of the research in the pilot study. Adolescents provided suggestions to improve the final version of the programme.
Interventions
The emoTIC programme aims to promote the four emotional competences of the emotional intelligence model of Mayer and Salovey.33 34 In addition, other competences and strengths proposed by Collaborative for Academic, Social, and Emotional Learning35 are considered, intending to promote intrapersonal abilities (self-awareness and self-management), as well as interpersonal (social awareness and relationship skills) and cognitive (responsible decision-making) competences. The emoTIC programme consists of four modules, each one including eight activities and taking place in a different area of a planet called E-MOOD, following four general objectives: (1) emotional perception, valuing emotions and opening to the emotional world; (2) facilitation and emotional understanding; (3) stress management and conflict resolution; and (4) emotional regulation and self-motivation (table 2). The programme is available on a web-based platform that can be accessed from any device (e.g., laptops, smartphones, tablets or computers, among others). The mechanics of emoTIC as a serious game is a space adventure. The player has crashed on E-MOOD planet and the main objective of the game is to return to Earth, for which the player will have to obtain pieces to build a spaceship, as well as oxygen, fuel and crew members. The advance in the programme offers a positive reinforcement by obtaining the resources needed to return to Earth every time the player successfully passes an activity and moves to a new zone of the planet, as well as gaining points that can be exchanged for: (a) access to play minigames specifically designed with the same atmosphere as emoTIC which can be downloaded and played in mobile devices, and (b) funny elements to design and build a city on E-MOOD. The dynamics of the game are self-paced and self-instructive, facilitating the motivation and engagement of adolescents. Participants who do not complete 75% of the activities will be excluded from the study.
Activity contents and emotional competences
Sample size
According to the National Statistics Institute,36 the population of adolescents (10–19 years) in Spain is 4 912 519. By choosing a 95% confidence level and a 5% margin of error, the representative sample size would be 385 participants. Participants will be randomly assigned to the control group and the experimental group using a computer-generated random numbers. The allocation sequence will be computer generated using a purpose-built application.
Outcomes
The assessment of adolescents will involve emotional, personal, social, psychopathological and well-being areas. All instruments will be completed by the participants in baseline (T1), post-treatment (T2) and follow-up (T3).
Primary outcomes
Emotional competences will be assessed by two instruments. First, the Spanish version of the Trait Meta-Mood Scale-2437 38 has 24 items divided into three factors (attention, clarity and emotional repair) with a 5-point Likert scale. The psychometric properties of the instrument were adequate in Spanish adolescent samples (α=0.83 in the three dimensions).39 Second, the Emotional Skills and Competence Questionnaire40 41 consists of 21 items divided into three scales (perception/understanding; labelling/expression; management/regulation), answered on a 6-point Likert scale. The questionnaire has shown good reliability in Spanish adolescent samples (α=(0.78 to 0.91)).41
Subjective well-being will be assessed by two indicators. First, the Satisfaction With Life Scale42 43 assesses the cognitive dimension of well-being, that is, how satisfied people are with their lives, and is composed of five items with a 5-point Likert scale. Its internal consistency with Spanish adolescents was adequate (McDonald’s Ω =0.85).43 Second, the Scale of Positive and Negative Experiences44 45 assesses the emotional dimension of well-being by the frequency of positive and negative feelings during the past 4 weeks. It consists of 12 items divided into two scales (positive and negative feelings) with a 7-point Likert scale, and it has shown good reliability in Spanish adolescent samples (α=(0.84 to 0.92)).45
Secondary outcomes
Self-esteem. The Rosenberg Self-Esteem Scale46 assesses the global attitude that adolescents have about themselves. It consists of 10 items scored with a 4-point Likert scale and has shown adequate psychometric properties with Spanish adolescents (α=0.87).47
General self-efficacy. General Self-Efficacy Scale48 49 assesses a stable feeling of personal competence to deal with a wide range of stressful situations. It is composed of 10 items answered on a 10-point Likert scale. The reliability in Spanish adolescent samples has shown adequate (α=0.89).49
Personality. The Mini-IPIP Scale positively worded Spanish version50 51 consists of 20 items answered on a 5-point scale and five dimensions: extraversion, agreeableness, conscientiousness, neuroticism and openness. The reliability of the factors in Spanish samples has shown adequate (composite reliability=(0.87 to 0.94)).50
Social and personal responsibility. The Spanish version of the Personal and Social Responsibility Questionnaire52 53 is composed of 14 items divided into two factors (social and personal responsibility), answered on a 6-point Likert scale, with adequate psychometric properties (α=(0.79 to 0.80)).53
School social climate. School Social Climate Questionnaire54 55 consists of 14 items with a 5-point Likert scale grouped in two factors (social climate relative to the school and relative to the teaching staff). The reliability of the factors in Spanish adolescent population has shown adequate (α=(0.72 to 0.77)).54
Somatic complaints. The Somatic Complaint List7 56 is comprised of 11 items, answered using a 3-point Likert scale, and has shown adequate psychometric properties (α=0.80).57
Depression, anxiety and stress. The Depression, Anxiety, and Stress Scale58 59 assesses the affective symptoms during the previous week and is composed of 21 items divided into three scales (depression, anxiety and stress) with a 4-point Likert scale. Previous studies indicated adequate psychometric properties in Spanish samples (α=(0.73 to 0.81)).60
Emotional and behavioural difficulties. The Strengths and Difficulties Questionnaire61 62 is composed of 25 items distributed on five subscales (emotional symptoms, behaviour problems, peer problems, hyperactivity and prosocial behaviour) with a 3-point Likert scale and has adequate psychometric properties in Spanish adolescents (α=(0.72 to 0.87)).47
Suicidal behaviour. The Adolescent Suicidal Behavior Assessment Scale63 consists of 16 dichotomic items, 3 subscales (ideation, communication and act/planning) and a general factor. The reliability of the scale was adequate in Spanish adolescent samples (Ω coefficient=(0.84 to 0.94)).63
Subjective happiness. The Spanish version of Subjective Happiness Scale64 65 is a 4-item Likert-type scale that requests the participant to self-rate or compare with others, and has shown an adequate reliability (α=0.81).64
Data analysis
Several statistical analyses will be used in order to determine the effectiveness of emoTIC. First, multivariate analysis of variance will be carried out to identify possible differences at T1 between the experimental group and the control group; and multivariate analysis of covariance will be performed to identify changes at T2, controlling for T1 scores (covariable). Second, the impact of the intervention programme will be analysed using multiple hierarchical regression analyses. The dependent variables will be the change between T1 and T2 in the outcome variables. Third, the reliable change index and Χ2 tests will be calculated. Fourth, the moderating effects of demographic variables will be tested. The experimental condition will be the independent variable and the changes from T1 to T2 will be the dependent variables. Fifth, structural equation models will be explored in order to analyse complex relations between variables. Finally, qualitative comparative analysis (QCA) will be used in order to complete the results obtained by the linear models. The statistical analysis will be done by means of the statistical packages SPSS (V.23), the PROCESS Macro for SPSS, Mplus (V.6.12) and Fs/QCA (V.3.0). All data will be entered electronically. Participant files will be stored in a secure and accessible manner for a period of 10 years after completion of the study.
Ethics and dissemination
The study has been approved by the Ethics Commission of the University of Valencia (H152865096049) and will comply with the data protection law (Organic Law 15/1999 on the Protection of Personal Data). A purpose-built application will generate random codes for each student. Since adolescents under 18 years will participate, informed consent will be requested from them and their parents or legal guardians. The data will be analysed in order to determine the effectiveness of the programme and the results will be disseminated across the scientific community in different high-impact, peer-reviewed scientific journals. The results obtained in this study will be used for research and scientific publication purposes only, will be stored in databases and may be shared with other research groups, but will not be sold to third parties under any circumstances. Important protocol modifications will be reported to relevant parties (investigators, trial participants, trial registries, journals).
Discussion
The present project aims to design a serious game called emoTIC and analyse its effectiveness to develop emotional competences, well-being, mental health and personal strengths. Triangulation of the data will be performed using multivariate analysis of variance, multiple regression analysis and reliable change index to determine the effectiveness of emoTIC. The anticipated results of this study imply to provide a motivational tool that positively impacts adolescents’ mental health and well-being. Using technology in the implementation of socioemotional programmes could be the first step towards developing and promoting interest in emotional education in adolescents. Despite the strengths of the study, it will have limitations. First, family is not included in the intervention. Second, incidental school sampling could make it difficult to generalise the results of the programme.
Conclusion
Working on emotional competences and personal strengths may contribute to enhance mental health and well-being in adolescence. This project will provide relevant knowledge for both the theoretical and the practical fields. On a theoretical level, the data collected will help to expand knowledge in the field of emotional education, specifically in the development of effective programmes and the related variables that can improve emotional intelligence. On a practical level, it will offer a tool for learning emotional competences that may be applied in the academic, family or social environment.
Ethics statements
Patient consent for publication
References
Footnotes
Contributors UDlB—conceptualisation, methodology and writing (original draft). SP-Z—conceptualisation and writing (original draft). EM—conceptualisation and writing (review and editing). J-AG-G—funding acquisition, project administration and writing (review and editing). IM-C—funding acquisition, project administration and writing (review and editing).
Funding This research was supported by grants from the Spanish Ministry of Science, Innovation and Universities (PSI2017-84005-R), the State Agency of Research and the European Regional Development Fund (FEDER) from the European Union; as well as a research fellowship granted by the Regional Government of Valencia and the European Social Fund (ACIF/2018/033).
Disclaimer The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript.
Competing interests None declared.
Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.
Provenance and peer review Not commissioned; externally peer reviewed.