Article Text

Download PDFPDF

First incidence, age of onset outcomes and risk factors of onset of DSM-5 oppositional defiant disorder: a cohort study of Spanish children from ages 3 to 9
  1. Lourdes Ezpeleta1,
  2. J Blas Navarro2,
  3. Nuria de la Osa1,
  4. Eva Penelo2,
  5. Josep Maria Domènech2
  1. 1 Unitat d’Epidemiologia i de Diagnòstic en Psicopatologia del Desenvolupament, Departament de Psicologia Clínica i de la Salut, Universitat Autònoma de Barcelona, Bellaterra, Barcelona, Catalunya, Spain
  2. 2 Unitat d’Epidemiologia i de Diagnòstic en Psicopatologia del Desenvolupament, Departament de Psicobiologia i Metodologia de les Ciències de la Salut, Universitat Autònoma de Barcelona, Bellaterra, Barcelona, Catalunya, Spain
  1. Correspondence to Dr Lourdes Ezpeleta; Lourdes.Ezpeleta{at}uab.cat

Abstract

Objective To examine the 1-year first incidence and prevalence of oppositional defiant disorder (ODD), the outcomes on psychopathology and functioning by age of onset and the risk factors of onset of ODD from ages 3 to 9 in children from the Spanish general population.

Design Longitudinal with seven follow-ups and double cohort (ODD and non-ODD children).

Setting General population of preschool and elementary school children in Barcelona (Spain).

Participants On a first phase, the parent-rated Strengths and Difficulties Questionnaire conduct problems scale plus ODD Diagnostic and Statistical Manual of Mental Disorders, fourth version, symptoms were used to screen for behavioural problems. The second phase sample size contained 622 cases at age 3 and, at age 9, 418 remained in the study.

Results The probability of the onset of ODD showed increasing values at ages 4 (R=2.7%) and 5 years (R=4.4%). These values decreased until age 7 (R=1.9%) and increased again until age 9 (R=3.6%). Up to 9 years old, the cumulative risk of new cases of ODD was 21.9%. Early onset was associated with a higher risk of depression comorbidity and later onset with higher functional impairment and symptomatology. Subthreshold ODD, high scores in irritability and headstrong dimensions, attention deficit/hyperactivity disorder and other comorbidity, negative affectivity until age 7, difficulties in inhibit and emotional control, punitive parenting and maternal internalising problems were risk factors of a first episode of ODD during this 7-year period.

Conclusions The risk of new cases of ODD in the general population at preschool age and during childhood is high. Preschool age is a target period for preventive interventions. Identified risk factors are objectives for targeted and indicated interventions.

  • childhood
  • incidence
  • oppositional defiant disorder
  • preschool
  • risk factors

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of the study

  • The length of the follow-up period (7 years) including two different developmental stages, preschool and childhood.

  • The information on risk factors and outcomes obtained from parents and teachers.

  • The consideration of risk factors in Cox regression models as time-dependent covariates instead of fixed covariates.

  • The lower participation of low socioeconomic status families and the non-random attrition for some outcomes may have led to bias in the estimates.

  • The low incidence of oppositional defiant disorder (ODD) made necessary to cluster ages (3–5 and 6–9) for the analysis of the influence of ODD age of onset on psychopathology and functioning.

Introduction   

According to epidemiological studies, the proportion of children and adolescents with mental health problems is 13.4%.1 These disorders are stable and continue into later life with adverse adults outcomes.2 Therefore, childhood is a target period for the early identification and prevention of mental disorders.

Oppositional defiant disorder (ODD), a pattern of negativistic, defiant, disobedient and hostile behaviour, is one of the most prevalent disorders from preschool age to adulthood.3 4 The pooled prevalence is 3.6% up to age 18.1 ODD is accompanied by various concurrent disorders (attention deficit/hyperactivity disorder [ADHD]), successive comorbidity (conduct disorder, anxiety, depression, substance use)5 6 and functional impairment.7 8 Symptomatology is stable and sufferers have difficulties in the transition to adulthood.9 The amount of children and families affected and the severe consequences that compromise healthy mental development underscore the need to know when the first onset occurs and the factors that predict this onset in order to plan appropriate preventive strategies.

Currently, we know how many children in the population are affected by ODD at a given point in time, that is, the prevalence, a measure of the status of the disease. We do not know, however, how many new cases appear at different developmental stages, that is, incidence, a measure of newly occurring cases of the disease during a specific developmental period.10 Because there is often a low number of incident cases, incidence studies require cohort designs with large size samples. Literature shows that there is a dearth of studies about the incidence of psychiatric disorders in childhood and adolescence. The available data on ODD mostly focus on adolescents and youths. Roberts11 reported that the risk of new cases of ODD for adolescents in a 12-month period was 1.56%, and Benjet12 found a 5% 8-year incidence for 19- to 26-year-old youth. There are no studies on the incidence of ODD during preschool and childhood. Neither do we know the differential consequences of the disorder according to age of onset. Literature on general mental disorders has reported that early onset is associated with greater severity, persistence and lack of response to treatment.13 Age of onset is an important data to advise on mental health policies.14

Several risk factors have been reported in the literature on ODD. Child risk factors include genetic influences,15 difficult temperament,16 difficulties in processing social information,17 sex18 and ADHD.19 The contextual factors reported include socioeconomic status (SES), parenting practices, parental psychopathology, family conflict and poor attachment.15 20 Incidence figures, which report on new cases of disease, are more useful for identifying risk factors than prevalence studies, which include both chronic and new cases.21 No previous studies have examined the risk factors of ODD by considering new cases. Only Roberts11 adopted this approach in adolescents, reporting that a younger age, poor family satisfaction, passive coping and low mastery, school and economic stress and poor relations with parents were predictors of incident cases of ODD.

Furthermore, ODD is a continuous disorder that starts early in life and persists into adulthood.9 It is therefore imperative to know for prevention purposes how the early manifestations of ODD symptomatology affect the definite appearance of the full disorder. Several dimensions of ODD have been identified to explain its underlying structure: irritable (including loses temper, angry and touchy); headstrong (argues, defies, annoys, blames) and hurtful (spiteful-vindictive).22 Rowe20 showed how ODD dimensions predict full ODD diagnosis. Moreover, the literature has shown that subthreshold conditions are risk factors for developing similar (homotypic) or different (heterotypic) full syndrome23 and that they constitute a major public mental health burden.24

The objective was to study annually the proportion of incident cases of ODD from ages 3 to 9 (preschool through childhood), to ascertain the differential outcomes by age of onset and to test if previously reported risk factors associated with ODD are prospective risk factors of incident cases at these developmental stages.

Method

Participants

The initial sample consisted of 2283 children randomly selected from early childhood schools in Barcelona (Spain).25 A two-phase design was employed. In the first phase of sampling, 1341 families (58.7%) agreed to participate (33.6% high SES, 43.1% middle and 23.3% low; 50.9% boys). To ensure that children with possible behavioural problems participated, the parent-rated Strengths and Difficulties Questionnaire (SDQ3-4) conduct problems scale26 plus ODD Diagnostic and Statistical Manual of Mental Disorders, fourth version (DSM-IV) symptoms were used to screen. Two groups were considered: screen positive (all children with SDQ scores ≥4, percentile 90, or with a positive response to any of the eight DSM-IV ODD symptoms) and screen-negative (a random group comprising 28% of children who did not reach the positive threshold). The sample size was determined for detecting OR ≥1.8 between psychopathology and risk factors, using a test of hypothesis for risk α=0.05 and power of 0.80. As the planned follow-up was 12 years long, the sample size was increased 50% for losses.

The final sample for the follow-ups (second phase) included 622 children (figure 1) comprising all the children from the screen-positive group whose families accepted to participate (n=417; 49.4% boys) and a random sample from the screen-negative group (n=205; 51.2% boys). To select participants from screen-negative group, children of each classroom were alphabetically numbered without including the name of the child nor the school. Then they were randomly permutated using SPSS random number generator, and the first 30% was selected. The percentage of dropouts at annual follow-up from ages 4 to 9 was similar in the two screen groups (χ2 = 0.72, p=0.798 at age 4; χ2=0.31, p=0.575 at age 5; χ2=1.36, p=0.244 at age 6; χ2=0.02, p=0.877 at age 7; χ2=0.49 and p=0.484 at age 8; χ2=0.20 and p=0.652 at age 9). No differences in sex (χ2 =0.07; p=0.793) or type of school (χ2 =0.72; p=0.396) were found on comparing completers and dropouts during the 7 years of annual follow-ups. However, the SES of those leaving the study until age 9 was lower (χ2 =20.89; p<0.001). Finally, to assess randomness of attrition, the outcome scores at age 3 between cases and dropouts at age 9 were compared. For 6 out of the 16 outcomes, scores at age 3 were higher for dropouts than for completers at age 9.

Figure 1

Design of the study. DSM-IV, Diagnostic and Statistical Manual of Mental Disorders, fourth version; ODD, oppositional defiant disorder; SDQ, Strengths and Difficulties Questionnaire.

From the initial 622 children, 65 who presented an ODD diagnosis at the start of the study (age 3) and 18 who left the study at the second follow-up (age 4) were excluded for the analysis of risk factors because of lack of information (n=539). Decrements in sample size at successive follow-ups were either due to attrition or to the exclusion of children who had already presented a first ODD diagnosis. Demographic characteristics are shown in table 1.

Table 1

Demographic characteristics of the sample at age 3 (n=622)

Measures

Diagnostic interview of children and adolescents for parents of preschool children

The diagnostic interview of children and adolescents for parents of preschool children27 is a computerised semistructured interview which generates diagnoses through algorithms following DSM-V. The diagnosis of ODD was obtained annually. The interviews in the first assessment gathered data from the first 3 years of life. ADHD, major depression, any anxiety disorders (separation, generalised, social anxiety or specific phobias) and comorbidity (ADHD, conduct disorder, major depression or any anxiety plus ODD) were obtained at each age from 3 to 9 years old. Subthreshold ODD was defined as cases that did not meet the threshold criteria of four symptoms for the diagnosis but presented impairment or distress. Rowe’s20 ODD dimensions were used (irritable and headstrong). Interinterviewer agreement in the diagnoses ranged from kappa coefficients from 0.83 to 1 (mean kappa 0.92; being 0.84 for ODD), indicating a good to excellent agreement between interviewers.

SDQ26 assesses emotional and behavioural problems with 25 items with three response options organised in five scales. It was answered by the parents and teachers. Cronbach’s alpha for parents range from 0.55 (conduct) to 0.85 (hyperactivity) and for teachers from 0.69 (conduct) to 0.88 (total).

The Children’s Global Assessment Scale28 is a global measure of functional impairment rated by the interviewer. Scale scores range from 1 (maximum impairment) to 100 (normal functioning). Scores above 70 indicate normal adaptation.

Children’s Behaviour Questionnaire Short Form and Very Short Form29 measure reactive and self-regulative temperament with 94 and 36 items, respectively, on a seven-point Likert-type scale. These were answered by the parents when the children were 3, 4 and 5 years old (short form) and 7 years old (very short form). The broad dimensions negative affectivity and effortful control were considered. Cronbach’s alpha in the sample ranged from 0.71 for effortful control at age 7 to 0.85 for negative affectivity at age 5.

The Behaviour Rating Inventory of Executive Function preschool version,30 answered by teachers when children were 3 years old, assesses behaviours reflecting the executive functions in daily life. The broad dimension that combine inhibit (control of impulses and behaviour) and emotional control (appropriate modulation of emotional responses) (Inhibitory Self-Control Index; ISCI) was used (Cronbach’s alpha: 0.94).

The Alabama Parenting Questionnaire-Preschool (APQ-Pr)31 measures parental practices in three dimensions (24 items): positive discipline techniques, inconsistent parenting and punitive parenting.32 They were obtained at ages 3 and 6. Cronbach’s alpha for the three dimensions was 0.75, 0.62 and 0.42 at age 3 and 0.74, 0.66 and 0.52 at age 6, respectively.

The Adult Self-Report33 assesses dimensional psychopathology (126 items) in adults. The mothers answered the questionnaire when the children were 3 and 8 years old. Internalising and externalising scale scores were analysed (Cronbach’s alpha 0.85 and 0.80, respectively, at the last follow-up).

Patient and public involvement statement

ODD is a social problem and families and schools complain about how to manage disruptive behaviour disorders at home and in school. We wanted to investigate about the development of this problem to know the best developmental moments and their risk factors to help the families and the teachers to prevent oppositionality. Families and schools were freely and actively involved in the study. Families and schools were informed yearly of the results of the previous follow-up and were oriented about what to do to improve the behaviour when necessary. Every 3 years, they received a written report about the evolution and development of the child. Teachers received a 15-hour course about How to manage disruptive behaviour disorder at the school-room at the beginning of different school levels (preschool: age 3, elementary:ages 6 and 9).

Procedure

Families were recruited in schools and gave written consent. The families who agreed to participate and met the screening criteria were contacted each year and interviewed in school. Interviewers were trained and were blind to the screening group. All the interviews were audiorecorded and supervised. The data were collected between November 2009 and July 2016.

Statistical analysis

The data were analysed with Stata V.15 for Windows. Since all the data were collected using a double-phase screening design, all analyses were weighted by assigning each child a value that was inverse to the probability of random selection in the second phase of sampling. Cases with missing data were excluded separately for each analysis (pairwise deletion). The incidence proportion was calculated for 1 year time periods beginning at 4 years old by dividing the number of new cases of first ODD diagnosis (incident cases) by the number of children at risk, that is, the number of cases at the beginning of the period excluding those who had previous diagnoses of ODD. This ratio is also called Risk (R) and it estimates the ‘probability of an event during a specified period of time’.10 Cumulative risk estimates the risk of ODD from 0 years old to each time period; because of the lost cases across the study, cumulative risk was computed by the Kaplan-Meier product-limit estimation34 using the weighted annual risk.

The analysis of differences in psychopathology and functioning by age of onset of ODD was made by analysis of variance for raw scores of quantitative outcomes and logistic regression for binary outcomes. Age of onset was grouped into preschool (ages 3-5) and school (ages 6-9) periods. The group without ODD was also considered and post hoc comparisons corrected by Bonferroni for multiple comparisons were estimated. Treatment for ODD at any time, current ODD diagnosis and number of years with an ODD diagnosis were introduced as covariates to adjust for confounding effects.

To analyse the predictors of the risk of an ODD diagnosis, several Cox proportional hazard regression models were estimated, grouping predictors (risk factors) by the measurement instrument and adjusting estimates by sex and SES. Predictors were considered as time dependent between ages 3 and 8 to benefit from the most recent available information. As a consequence and because of the multiple-record structure of the data matrix (each child had one data record for each follow-up period), the robust variance estimator35 was used. No competitive events were considered due to the high specificity of an ODD diagnosis and to the characteristics of the sample, with neither deaths nor physical comorbidities that prevented an ODD diagnosis. Proportional hazard assumption was verified by calculating the significance value of the interaction between predictors and time. In the presence of significant interaction, the HR for the involved predictor was obtained separately for each year of follow-up, corresponding to ages 3 to 8. For each Cox regression model, Harrell’s C index36 was calculated to evaluate the adequacy of the predictions (values ≥0.70 are considered good).

Results

Prevalence of ODD from 3 to 9 years old

Table 2 presents the number of children in the study, the number of ODD diagnoses and the prevalence for each age. Prevalence oscillated between 6.0% (age 3) and 8.8% (age 9).

Table 2

DSM-V ODD prevalence from 3 to 9 years old

First incidence and cumulative risk of ODD from 4 to 9 years old

The first three columns in table 3 show the cases at risk (without an ODD diagnosis) at the beginning of each year period, the number of new cases diagnosed with ODD during that year and the incidence. The probability of the appearance of ODD showed a cubic shape, with risk increasing from age 4 to age 5 (R=2.7% to 4.4%), followed by a decrease until age 7 (R=1.9%) and a new increase at ages 8 and 9 (R=2.9%, 3.6%). The last column in table 3 shows the cumulative risk of having a first ODD diagnosis up to 9 years old, which reached 21.9%. Figure 2 shows prevalence of ODD and incidence of first ODD diagnosis by age.

Figure 2

Prevalence and first incidence (risk) of oppositional defiant disorder diagnosed from 3 to 9 years old.

Table 3

ODD 1-year first incidence and cumulative risk from 0 to 9 years old

Outcomes of age of onset of ODD

Table 4 shows the scores and percentages of psychopathology and functioning for children with onset of ODD at 3–5 and 6–9 years old and for those without ODD, as well as the multiple comparisons between the three groups with the mean difference (MD) or the OR and their 95% CI. Controlling by current ODD diagnosis, the number of years of duration of ODD and treatment received, children with onset at 3–5 years old scored lower on functional impairment, which indicates worse functioning (MD=−7.17), and presented higher comorbidity with major depression (OR=5.76) in comparison to children without ODD. Children with onset of ODD at 6–9 years old scored higher on all the scales of parent’s SDQ except prosocial (MD between 0.63 for conduct and 1.68 for hyperactivity) and on total (MD=3.95), and presented worse functioning (MD=−13.06) in comparison with children without ODD. There were differences in the total SDQ score (MD=2.99) and in peer problems (MD=0.66) between preschooler and late ODD onset, the latter showing higher scores. Moreover, children with onset of ODD at 6–9 years old presented higher functional impairment than those with onset at 3–5 years old (MD=−5.89).

Table 4

Outcome of age of onset on psychopathology and functioning (n=461)

Risk factors of incident ODD diagnosis from 3 to 9 years old

HR for each risk factor with the 95% CI, its p value and Harrell’s C for each model were calculated (see online supplementary table 1). The hazard of having an ODD diagnosis was increased by subthreshold ODD symptomatology (HR=6. 27, 95% CI 3.85 to 10.21), high scores on ODD dimensions of irritability (HR=1.56, 95% CI 1.13 to 2.12) and headstrong (HR=2.33, 95% CI 1.84 to 2.96), comorbidity (HR=2.21, 95% CI 1.13 to 3.53), specifically of ADHD (HR=2.64, 95% CI 1.42 to 4.93), higher negative affectivity (HR=3.73, 95% CI 2.21 to 6.29 at age three to HR=1.68, 95% CI 1.27 to 2.23 at age 7), difficulties in inhibition and emotional control (HR=1.04, 95% CI 1.02 to 1.07), higher scores in punitive parenting (HR=1.22, 95% CI 1.08 to 1.38) and mother’s internalising problems (HR=1.06, 95% CI 1.02 to 1.10).

Supplemental material

The capability to predict new ODD first-incident cases from the subsets of risk factors was low in general. Only the first model with ‘being an ODD subthreshold’ as predictor, and the second model with ‘ODD Irritability and Headstrong’ scores as predictors showed Harrell’s C ≥ 0.70.

Discussion

To our knowledge, this is the first study reporting on not only the 1-year incidence of ODD in a 7-year follow-up design covering ages 3 to 9 and the effects of different age ranges of onset, but also their risk factors and the DSM-V prevalence. We found that the probability of the appearance of ODD shows a cubic shape with higher values for the preschool period, a decrease at the start of childhood (ages 6 and 7) and another increase when approaching puberty (ages 8 and 9). Prevalence was around 6%–7% between ages 3 and 8, increasing to 8.8% by age 9. An early onset of ODD is more closely associated with the presence of depressive comorbidity, but the functional impairment of those with later onset is most marked and their parents report higher symptomatology. Risk factors of incidence were identified.

Throughout development, prevalence was high and very stable (6%–7%), with the highest value at 9 years old. These percentages indicate the need to allocate resources such as services and training to the parents, teachers and professionals involved with the children in these age ranges that have already developed the disorder.

2.7 and 4.4 out of 100 preschoolers aged 4 and 5, respectively, and between 1.9 and 3.6 out of 100 children aged 6 to 9 will develop a first episode of ODD in 1 year. It is remarkable that at the end of the follow-ups, the cumulative risk was high, indicating that up to 9 years old, the risk of presenting ODD is 21.9%. This risk is highest in the preschool period, which cumulates 12.6% of the risk, the remaining 9.3% occurring in childhood. These values are noteworthy in terms of public mental health indicators if one considers the short-term impact ODD has on the lives of children, families, teachers and schools,8 as well as the long-term effects until adulthood.9 Specifically, these results point to the need to pay attention to the preschool period if the goal is to prevent ODD. On the one hand, preschool age is when the child is acquiring important skills related to ODD, such as self-regulation and executive functioning, and when parents adjust their parenting practices.37 It is important to intervene in this period when the early signs of dysfunction become apparent. On the other hand, programmes that have been shown to effectively treat ODD38–40 and prevent it41 42 are currently available.

An early age of onset has typically been associated with worse mental health outcomes.13 This is also true for ODD regarding comorbidity. Specifically, the risk of depression in children who debut ODD at preschool age multiplies by 5.76 compared with children without ODD. Comparing early versus later onset after strict control by confounding variables, later onset increases the risk of higher symptomatology (general and in peer problems) and difficulties in functioning. One of the contributions of studying age of onset is to have available information for targeting prevention that focuses on early intervention in incipient mental disorders and on primary prevention of secondary disorders.13 Thus, our results once again suggest the need to intervene at early ages. This implication is also supported by the finding that for those starting later (ages 6–9), the impairment in functioning and in symptomatology is more severe. Therefore, paying attention to prodromal indicators and risk factors to prevent the full development of ODD is crucial.

Regarding risk factors, our goal was to confirm the risk of first onset of ODD using some of the main risk factors reported previously in the literature. No previous studies have been carried out with incident cases. The strength of the association for some of the predictors is remarkable. We found that premorbid forms of ODD (subthreshold, high scores in the ODD dimensions irritability and headstrong) were the strongest predictor of onset of full ODD. Identifying premorbid cases is of great value for the indicated prevention of ODD, given that the group at risk presents objective markers (ODD symptoms). Similarly, children with other psychopathology, and specifically ADHD, and individual characteristics, such as difficulties in inhibit-emotional control are also at risk of onset of ODD. Also, our results indicate that difficulties regulating negative emotions are at a higher risk of ODD onset, especially from very early ages, while the risk diminishes with age. Last, unsupportive environments, such as punitive parenting practices and maternal internalising problems, predicted the emergence of an ODD diagnosis, which is also in line with previous literature.15 43 Predictive capability assessed by Harrell’s C was generally low to moderate, indicating that to predict first-incident ODD cases, other predictors are needed in addition to the clinical risk factor considered. However, it is necessary to consider the low number of predictors included in each model.

Strengths of the study are that the diagnostic information was obtained via semistructured interviews based on DSM-V criteria, the length of the follow-up period (7 years), the inclusion of two different developmental stages, preschool and childhood, and the fact that the estimates of incidence were not overestimated, given that previous diagnoses until age 3 were also made. Age of onset studies have been carried out mostly through retrospective design, which is a limitation. We studied age of onset through a prospective design. Furthermore, the information on risk factors was obtained from parents and teachers. However, some limitations must be considered when interpreting the results. The diagnostic information, based on data from just one source, the parents and the lower participation of low SES families may have led to bias in the estimates. A second limitation refers to the non-randomness of attrition in 6 out of the 16 outcomes analysed as risk factors of first ODD diagnose. However, as shown in several populations, attrition is associated with adverse psychosocial variables and high levels of psychological distress.44 45 Also, some of the scales of the APQ-Pr presented low internal consistency and the results should thus be interpreted with caution. Finally, as the number of incident cases diminished with age, the statistical power may be limited.

Synthesising, oppositional defiant disorder is one of the most prevalent disorders in our society. It has important consequences in the development of the child and in the functioning of the family. It starts very early in life but we do not know how many new cases appear every year, nor the consequences it has depending on the age of onset. Our study reports that the probability of appearance of oppositional defiant disorders is highest by age 5 and, afterwards, by age 9, when approaching to puberty. Most of the new cases of oppositional disorder appeared in preschool age (12.6%). By age 9, there is a cumulative risk of new onset of 21.9%. Early onset at preschool age is associated with comorbidity with depression and functional impairment; childhood onset is associated with higher symptomatology and functional impairment. These results indicate the burden of oppositional disorder for public health and point to the need of focusing in preschool age for preventive purposes. To allocate resources in this developmental period and paying attention to prodromal indicators and risk factors to prevent the full development of ODD is crucial. Our results are generalisable to Spanish children mostly from mean and high-mean socioeconomic levels until age 9.

Acknowledgments

We would like to thank the participating schools and families.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.

Footnotes

  • Contributors LE designed the study and wrote the paper with JBN. JBN analysed data. JMD contributed to data analysis. NdlO and EP collaborated in the writing and editing of the manuscript. All the authors contributed to reviewing the final version of the manuscript.

  • Funding This work was supported by the Spanish Ministry of Economy and Competitiveness [grants PSI2012-32695 and PSI2015-63965-R (MINECO/FEDER)] and the Secretaria d’Universitats i Recerca, Departament d’Economia i Coneixement of the Generalitat de Catalunya [grant 2014 SGR 312].

  • Competing interests None declared.

  • Ethics approval The authors assert that all procedures contributing to this work comply with the ethical standards of the relevant national and institutional committees on human experimentation and with the Helsinki Declaration of 1975, as revised in 2008, and by the Ethics Committee for Human and Animal Experimentation of the Universitat Autònoma de Barcelona.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement Data cannot be publicly available due to ethical restrictions protecting the confidentiality of the families involved. Data are available to interested researchers after signing a consent of confidentiality form as the authors had previously signed to obtain the data from the families of the sample. Researchers must be working in clinical child psychology in a public-funded project. To request the anonymous data, please contact the corresponding author.

  • Patient consent for publication Parental/guardian consent obtained.