Article Text

Download PDFPDF

Original research
Comparison of different severe obesity definitions in predicting future cardiometabolic risk in a longitudinal cohort of children
  1. Lisa Kakinami1,2,
  2. Anna Smyrnova2,
  3. Gilles Paradis3,
  4. Angelo Tremblay4,
  5. Melanie Henderson5,6
  1. 1PERFORM Centre, Concordia University, Montreal, Québec, Canada
  2. 2Department of Mathematics and Statistics, Concordia University, Montreal, Québec, Canada
  3. 3Department of Epidemiology, Biostatistics and Occupational Health, McGill University, Montreal, Québec, Canada
  4. 4Département de kinésiologie, Université Laval, Quebec City, Quebec, Canada
  5. 5Department of Pediatrics, Université de Montréal, Montreal, Quebec, Canada
  6. 6Research Center of CHU Sainte Justine, Université de Montréal, Montreal, Quebec, Canada
  1. Correspondence to Dr Lisa Kakinami; lisa.kakinami{at}concordia.ca

Abstract

Objectives Severe obesity (SO) prevalence varies between reference curve-based definitions (WHO: ≥99th percentile, Centers for Disease Control and Prevention (CDC): >1.2×95th percentile). Whether SO definitions differentially predict cardiometabolic disease risk is critical for proper clinical care and management but is unknown.

Design Prospective cohort study

Setting SO definitions were applied at baseline (2005–2008, Mage=9.6 years, n=548), and outcomes (fasting lipids, glucose, homoeostatic model assessment (HOMA-IR) and blood pressure) were assessed at first follow-up (F1: 2008–2011, Mage=11.6 years) and second follow-up (2015–2017, Mage=16.8 years) of the Quebec Adipose and Lifestyle Investigation in Youth cohort in Montreal, Quebec.

Participants Respondents were youth who had at least one biological parent with obesity.

Primary outcome measures Unfavourable cardiometabolic levels of fasting blood glucose (≥6.1 mmol/L), insulin resistance (HOMA-IR index ≥2.0), high-density lipoprotein <1.03 mmol/L, low-density lipoprotein ≥2.6 mmol/L and triglycerides >1.24 mmol/L. Unfavourable blood pressure was defined as ≥90th percentile for age-adjusted, sex-adjusted and height-adjusted systolic or diastolic blood pressure.

Analysis Area under the receiver operating characteristic curve (AUC) and McFadden psuedo R2 for predicting F1 or F2 unfavourable cardiometabolic levels from baseline SO definitions were calculated. Agreement was assessed with kappas.

Results Baseline SO prevalence differed (WHO: 18%, CDC: 6.7%). AUCs ranged from 0.52 to 0.77, with fair agreement (kappa=37%–55%). WHO-SO AUCs for detecting unfavourable HOMA-IR (AUC>0.67) and high-density lipoprotein (AUC>0.59) at F1 were statistically superior than CDC-SO (AUC>0.59 and 0.53, respectively; p<0.05). Only HOMA-IR and the presence of more than three risk factors had acceptable model fit. WHO-SO was not more predictive than WHO-obesity, but CDC-SO was statistically inferior to CDC-obesity.

Conclusion WHO-SO is statistically superior at predicting cardiometabolic risk than CDC-SO. However, as most AUCs were generally uninformative, and obesity definitions were the same if not better than SO, the improvement may not be clinically meaningful.

  • paediatrics
  • epidemiology
  • public health
  • statistics & research methods
  • community child health

Data availability statement

Data are available upon reasonable request. All data that support the findings of this study are available from the QUALITY research team upon reasonable request (www.etudequalitystudy.ca).

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • This is the first study to assess how well the Centers for Disease Control and Prevention or the WHO definitions of severe obesity could predict future cardiometabolic risk in youth.

  • Participants were from a large cohort sample of youth with baseline and two follow-up measures of fasting lipids and cardiometabolic data available.

  • The study used a non-random convenience cohort sample and may not be generalisable to all youth.

Introduction

Approximately 4%–6% of youth have severe obesity (SO).1 Youth with SO are at greater future cardiometabolic risk compared with those with overweight and obesity,2 3 and may thus be a distinctive sub-class of youth from those with obesity. In 2005, the American Medical Association, Health Resources and Service Administration, and the Centers for Disease Control and Prevention (CDC) convened an expert committee comprised 15 professional organisations to update recommendations for detecting and treating obesity during childhood and adolescence. Part of these updates included defining SO as ≥99th percentile for the CDC growth curves.4 However, the method used for developing the CDC growth curve only allows for the calculation of percentiles between the 3rd and 97th percentiles. Values outside of this are extrapolated. Thus the definition of SO has since been modified to 1.2 times the 95th percentile5; ≥99th percentile is no longer recommended.1 6 7

In contrast, the WHO growth curve does not limit extrapolations above the 97th percentile.8 Hence, the Canadian Paediatric Society (in collaboration with the Dietitians of Canada, the College of Family Physicians of Canada and Community Health Nurses of Canada) recommends defining SO as ≥99th percentile (as a rounded percentile of the 99.9th) using the WHO growth curves.9 However, the empirical evidence for these different recommendations is lacking. To the best of our knowledge, only a single study investigated the utility of these different SO definitions in identifying current cardiometabolic risk. This previous study concluded that the 1.2×95th percentile of either curve was superior in identifying children with cardiometabolic risk than using their respective ≥99th percentile definitions, and there were limited discriminatory differences between the CDC and WHO curves 1.2×95th percentile definitions.10 However, the prediction of future risk was not possible in this cross-sectional sample.10

Thus although growth curves are designed to track growth and health risks, the discriminatory power of the SO definitions to detect future diabetes and cardiovascular disease risk is largely unknown. Improving our understanding of the predictive utility of SO definitions is critical for clinical care and management, as well as proper interpretation of research studies as there is no consensus on SO definition. Therefore the objective of this research was to determine whether the WHO or CDC growth curves SO definitions differ from one another in predicting diabetes and cardiovascular disease risks 2 years later. A secondary objective assessed prediction 7 years later, and assessed whether SO definitions were more predictive than obesity definitions.

Materials and methods

Participants

Participants for this study were from the QUALITY cohort (Quebec Adipose and Lifestyle Investigation in Youth), an ongoing longitudinal investigation of the natural history of obesity and cardiovascular risk in Quebec youth. A detailed description of the study design and methods is available.11 Briefly, youth with at least one biological parent with obesity were eligible to participate. Data were collected at baseline (2005–2008: n=630), follow-up 1 (2008–2011, n=564) and follow-up 2 (2015–2017, n=377). For this study, the primary analyses were focused on baseline and follow-up 1 measurements (n=548). Secondary analyses were restricted to those with complete follow-up 1 and 2 data (n=356). Study participants or the public were not involved in the design, or conduct, or reporting, or dissemination plans of our research.

Measures

Cardiometabolic

All cardiometabolic measures were assessed at baseline, follow-up 1 and follow-up 2. Participants fasted (no food or drink 12 hours prior to the visit). Trained nurses collected venous blood samples according to standardised protocols. Samples were immediately stored on ice. All samples were centrifuged, aliquotted and stored at −80°C until analysis. Fasting cardiometabolic measures included blood glucose, insulin, high-density lipoprotein (HDL) cholesterol, low-density lipoprotein (LDL) cholesterol and triglycerides. Insulin levels were measured using an electrochemiluminescence immunoassay method (Synchron LXi 725, Beckman Coulter). Homoeostatic model assessment (HOMA-IR) was calculated as (fasting insulin (pmol/L)/7.175×fasting glucose (mmol/L))/22.5.12 Systolic and diastolic blood pressures were measured after a 5 min rest and at least 30 min after a meal using an oscillometric instrument (Dinamap XL, model CR9340, Critikon Company, Florida, USA).13 Five consecutive readings at 1 min intervals were obtained. The mean of the last three measures were used in the analyses. The biochemical analyses were performed at the Department of Clinical Biochemistry at Centre Hospitalier Universitaire Sainte-Justine in accordance to the standardised guidelines of the International Federation of Clinical Chemistry.14 15

The cardiometabolic measures were categorised into normal and unfavourable, based on guidelines or as recommended in the literature.16 17 Unfavourable glucose homeostasis was defined as fasting blood glucose ≥6.1 mmol/L, and insulin resistance was defined as HOMA-IR index ≥2.0.18 19 Unfavourable lipid levels were defined as HDL cholesterol <1.03 mmol/L, LDL cholesterol ≥2.6 mmol/L and triglycerides >1.24 mmol/L.16 Unfavourable blood pressure was defined as ≥90th percentile for age-adjusted, sex-adjusted and height-adjusted systolic or diastolic blood pressure.20

Anthropometric

Height and weight were measured using a stadiometer (height) and electronic scale (weight), with light indoor clothing and no shoes. Measurements were taken two times; a third measurement was taken when differences between the two initial measures were 0.1 cm (height) or 0.1 kg (weight) or more. The analysis used the average of the two closest measurements. Body mass index (BMI) was calculated (kg/m2) and compared with age-specific and sex-specific CDC and WHO reference curves to calculate BMI centile and BMI z-score.21 22 SO with the CDC reference curves was defined as BMI ≥1.2×95th percentile.5 SO with the WHO reference curves was defined as ≥99th percentile.9 For ease of readability, the SO definitions of ≥99th percentile (WHO) and 1.2×95th percentile (CDC) will be referred to as WHO-SO, and CDC-SO, respectively throughout the rest of this manuscript.

Other

Direct observation by trained nurses assessed sexual maturation (Tanner stages).23 24 Youth were classified as pre-pubertal (Tanner stage 1) or pubertal (Tanner stages 2–5).23 24 Relevant questionnaire data from parental report included the highest education obtained (by either parent), and the previous year’s annual household income.

Statistical analysis

All analyses were performed separately for boys and girls. The primary objective was assessed with WHO-SO and CDC-SO definitions at baseline with cardiometabolic risk factors at follow-up 1. Statistical comparisons between boys and girls were conducted with χ2 for categorical variables and t-test for continuous variables. Publicly available SAS macros were used to calculate the BMI-for-age z-scores and percentiles in accordance to the CDC and WHO growth curves. Observations with missing data were excluded from analyses. All descriptive and statistical analyses were performed with SAS V.9.4 (SAS Institute).

The areas under the receiver operator characteristic (ROC) curves (AUC) for each definition of SO (WHO-SO, CDC-SO) and cardiometabolic risk factor of interest were calculated. The AUC represents the probability that a SO definition will detect an unfavourable level of cardiometabolic risk. An AUC of 0.50 is considered uninformative and detects cardiometabolic risk no better than chance; an AUC greater than 0.80 is considered to be good.25 Statistical comparison between AUCs26–28 used a macro available online (http://www.medicine.mcgill.ca/epidemiology/hanley/software/delong_sas.html). Although ROC curves combine sensitivity (in our context, detecting cardiometabolic risk among those with SO) and specificity (no cardiometabolic risk among those without SO) into a single measure, these values were also separately calculated.

McFadden pseudo R2 assessed the goodness of fit (0–0.2: poor, 0.2–0.4 good, 0.4+ excellent model fit).29 30 Better model fit was assessed with the Akaike Information Criterion (AIC), with AIC at least two units lower deemed as statistically superior model fit. Kappa coefficients determined agreement between the curves (kappa of 81%–100%: high agreement, 61%–80%: substantial agreement, 41%–60%: moderate agreement, 21%–40%: fair, and 0%–20%: slight agreement).31 32 Additionally, we assessed the ability of these definitions to detect any single, or multiple (two, and at least three) unfavourable risk factor clusters. Because there were too few cases of unfavourable blood glucose, systolic and diastolic blood pressure in the cohort, these risk factors were excluded from the risk factor clusters.

A sensitivity analysis calculated AUCs, sensitivity and specificity for each SO definition at follow-up 1 with cardiometabolic risk factors at follow-up 2. The AUCs and kappa were also calculated for obesity (CDC: BMI≥95th percentile, WHO: BMI≥97.7th percentile) as a point of reference. Comparisons between SO and obesity definitions, as well as between WHO-obesity and CDC-obesity definitions were conducted.

Patient and public involvement

Study participants or the public were not involved in the design, or conduct, or reporting, or dissemination plans of our research.

Results

There were no significant differences in age, sex or BMI between those in the analytic sample (n=548) and those excluded due to missing data (n=82, data not shown). In the analytic sample of 548 participants, 55% were boys, mean age at baseline was 9.6 years (SD: 0.9) and 11.6 years (SD: 0.9) at follow-up 1 (table 1). Girls and boys significantly differed in pubertal stage at baseline and follow-up 1. Descriptive characteristics of cardiometabolic risk factors at baseline and follow-up among those meeting a SO definition are presented (table 2). At baseline, 99 and 37 youth were identified with SO using the WHO-SO or the CDC-SO criteria, respectively. Compared with baseline, more cases of SO were detected with the CDC-SO definition at follow-up (n=37 at baseline and n=44 at follow-up), but less were detected with the WHO-SO definition (n=99 at baseline and n=95 at follow-up). Although the overall prevalence of at least one cardiometabolic abnormality at follow-up 1 was 44% in the full sample, among those with SO based on the WHO-SO, or CDC-SO, the prevalence was 85% and 92%, respectively.

Table 1

Demographic and health characteristics for Quebec Adipose and Lifestyle Investigation in Youth participants at baseline and first follow-up (n=548)

Table 2

Cross-sectional detection of cardiometabolic risk factors of Quebec Adipose and Lifestyle Investigation in Youth participants among those with severe obesity at baseline or first follow-up

The diagnostic performance of SO definitions in predicting cardiometabolic risk at the first follow-up, as well as their agreement with one another is provided (table 3). Sensitivity of CDC-SO at baseline was lower than the WHO classification for all risk factors at the first follow-up (table 3). Based on kappas, agreement between the WHO-SO and CDC-SO was moderate (37%–55%). The AUCs from the SO definitions were largely uninformative for detecting cardiometabolic abnormalities. Similarly, good model fit was detected only for HOMA-IR and having more than three risk factors based on McFadden pseudo R2s greater than 0.20; all others had poor model fit. Results comparing follow-up 1 as a prediction of follow-up 2 were consistent with those from baseline and follow-up 1, although nearly all comparisons were not statistically significantly different (data not shown).

Table 3

Sensitivity, AUC and kappa of CDC-defined and WHO-defined categories of severe obesity at baseline for predicting cardiometabolic risk at first follow-up for Quebec Adipose and Lifestyle Investigation in Youth participants (n=548), by sex

In contrast, the CDC and WHO obesity definitions had good agreement, with kappas all at least 83% (table 4). Notably, while the CDC-SO definitions demonstrated a significantly poorer AUC in comparison to the CDC obesity definition, the WHO-SO definition had approximately the same AUCs as the WHO obesity definition.

Table 4

Comparison of AUC of CDC-defined and WHO-defined categories of obesity and severe obesity at baseline for predicting cardiometabolic risk at first follow-up for Quebec Adipose and Lifestyle Investigation in Youth participants (n=548), by sex

Discussion

In this large cohort of youth, CDC-SO AUCs were generally inferior in comparison to the WHO-SO definition for detecting cardiometabolic abnormalities. However, as all SO definitions had relatively uninformative AUCs, it is unlikely that the statistical superiority of the WHO-SO and the CDC-SO definitions found in this study are of clinical importance.

To the best of our knowledge, only one previous cross-sectional study assessed the utility of SO definitions.10 Notably, in a sample (n=3340, mean age: 11.2) comprised exclusively of children with overweight/obesity. SO AUCs10 were similarly uninformative, emphasising the difference between clinical and statistical significance. Despite our study’s relatively low prevalence of cardiometabolic markers, results were largely consistent with that of Valerio et al.10 Indeed the prevalence of obesity in our study is likely more consistent with most populations than the SO prevalence of >50% in Valerio et al study.10

Although accurately classifying youth with SO has been recommended,33 the necessity of doing so for the purposes of identifying cardiometabolic risks during childhood and adolescence is unclear. In fact, the AUCs from SO definitions in this study were similar to those from obesity definitions. Thus there is limited evidence that there is a discriminatory advantage of SO definitions over obesity definitions for identifying cardiometabolic risk in youth.

This study is not without limitations. Participants were not a representative sample and results may not be generalised to all youth. Although unmeasured confounding is possible, as this is a study comparing methodological definitions each participant served as their own comparator. Thus the growth curves are likely to perform similarly in another sample population in which prevalence of SO is approximately 5%–20%. Given that this study’s sample size was relatively small, the prevalence of individual and clusters of cardiometabolic risk factors (1, 2, 3+) were assessed. Interpreting clusters is less straight-forward than the individual risk factors. However, as there were very few with high blood pressure or glucose, the majority of the risk factor clustering occurred with the lipids (HDL, LDL, triglycerides) and HOMA-IR.

Although this is the first cohort study to assess prediction of SO definitions of future cardiometabolic risk, there were only two follow-up visits (approximately 2 years and 5 years after baseline, respectively). Due to study attrition, identification of cardiometabolic risk at the second follow-up was likely underpowered. A repeated measures analysis may have more efficiently retained statistical power. However, as we were interested in determining whether the prediction models strengthened or worsened at the specific study visits, we analysed the data with separate models at the two follow-up visits. As an increase in HOMA-IR index is expected as youth enter puberty, the study should be reassessed in a sample in which adolescents have completed puberty.

ROCs may be less informative when datasets are imbalanced between diseased and non-diseased,34 thus the McFadden pseudo R2 were also calculated. Nevertheless, McFadden pseudo R2 model fit and ROCs statistical comparisons indicated that WHO-SO performed better than CDC-SO. As this study was focused on the methodological and statistical differences between SO definitions, models were unadjusted.

Finally, the 99th percentile is a recommended rounded percentile of the 99.9th for defining SO in both research and clinical care. Using the exact percentile of 99.9th would decrease the number of SO youth in this cohort by two-thirds (from 95 to 28 youth) and would result in incalculable statistical comparisons due to insufficient sample sizes. However, as the AUCs for SO were largely uninformative, an increase in statistical precision is unlikely to be clinically useful.

Conclusion

In this large cohort sample of youth, the WHO definition of SO was consistently superior in detecting diabetes and cardiovascular disease risks at follow-up in comparison to the CDC definition of SO. From a clinical standpoint, the calculation of the WHO-SO is also simpler than the CDC-SO. Nevertheless, as the AUCs for SO using either CDC or WHO definition were generally uninformative, the improvement in sensitivity may not be clinically meaningful and should be used with caution.

Data availability statement

Data are available upon reasonable request. All data that support the findings of this study are available from the QUALITY research team upon reasonable request (www.etudequalitystudy.ca).

Ethics statements

Patient consent for publication

Ethics approval

The study was conducted ethically in accordance with the Tri Council policy statement on the ethical conduct for research involving humans. Ethics review boards of Centre Hospitalier Universitaire Sainte-Justine and the Quebec Heart and Lung Institute approved the study protocol (#MP-21-2005-79, 2040). The secondary data analysis for this project was approved by the Concordia University ethics board (#30016473). All parents provided informed consent, and study participants provided assent.

Acknowledgments

Dr Marie Lambert (July 1952–February 2012), paediatric geneticist and researcher, initiated the QUALITY cohort. Her leadership and devotion to QUALITY will always be remembered and appreciated. The cohort integrates members of TEAM PRODIGY, an inter-university research team including Université de Montréal, Concordia University, INRS-Institute-Armand Frappier, Université Laval, and McGill University. The research team is grateful to all the youth and their families who took part in this study, as well as the technicians, research assistants and coordinators involved in the QUALITY cohort project. Portions of these data were presented in a poster at the Canadian Society for Epidemiology and Biostatistics 2019 National Conference, Ottawa, Ontario, 13–15 May 2019.

References

Footnotes

  • Contributors MH, GP and AT conceptualised and designed the study, coordinated and supervised data collection, and critically reviewed the manuscript for important intellectual content. LK conceptualised and designed the study, drafted the initial manuscript, and reviewed and revised the manuscript. AS conceptualised and designed the study, carried out the initial analyses, and reviewed and revised the manuscript. All authors approved the final manuscript as submitted and agree to be accountable for all aspects of the work. LK is the guarantor.

  • Funding The QUALITY cohort is funded by the Canadian Institutes of Health Research (#OHF-69442, #NMD-94067, #MOP-97853, #MOP-119512), the Heart and Stroke Foundation of Canada (#PG-040291) and the Fonds de la Recherche du Québec - Santé. Mélanie Henderson holds a Diabetes Junior Investigator Award from the Canadian Society of Endocrinology and Metabolism - AstraZeneca and a Fonds de Recherche du Québec - Santé Junior 2 salary awards and Lisa Kakinami holds a Junior 1 salary award from the latter institution.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.