Article Text

PDF

Validity of self-reported age at menarche in computer-assisted interview among Chinese schoolgirls: a cross-sectional study
  1. Yanyan Mao1,2,
  2. Qiguo Lian1,2,
  3. Xiayun Zuo2,
  4. Yan Zhang1,2,
  5. Shan Luo3,
  6. Shucheng Zhang4,
  7. Xiaowen Tu2,
  8. Chaohua Lou2,
  9. Weijin Zhou2
  1. 1 School of Public Health, Fudan University, Shanghai, China
  2. 2 Key Laboratory of Reproduction Regulation of NPFPC, SIPPR, IRD, Fudan University, Shanghai, China
  3. 3 West China Second University Hospital, Sichuan University, Chengdu, China
  4. 4 Reproductive Physiology Laboratory, National Research Institute for Family Planning, Beijing, China
  1. Correspondence to Professor Weijin Zhou; zhouweijin{at}sippr.org.cn

Abstract

Objective The attitudes of girls regarding menarche vary according to their cultural backgrounds. Asian girls may hesitate to discuss menarche. Computer-assisted self-administered interviewing (CASI) is considered a valid and effective tool for investigating the timing of menarche; however, the validity of self-reported menarche data from CASI in Chinese culture is currently unknown. We aimed to validate the status and age of menarche attainment by comparing CASI with face-to-face interviewing (FFI).

Methods Based on a cross-sectional study, we collected information regarding the status and age of menarche attainment using CASI and FFI among Chinese schoolgirls. We explored the tools of standard epidemiological indices, including sensitivity, specificity, predictive values and accuracy to examine the capacity of CASI for correctly classifying the status of menarche. Both Pearson and Spearman correlations were calculated for the correlation of age at menarche using CASI with FFI. A Bland-Altman plot was drawn to measure the agreement between the two interview techniques.

Results In this study, CASI and FFI were conducted in 3478 schoolgirls with an average age (SD) of 14.3 years (2.46). Menarche attainment was reported in 2496 (71.2%) and 2538 (73.0%) girls using CASI and FFI, respectively. Compared with FFI, the sensitivity, specificity, positive predictive value (PPV), negative predictive value and the accuracy of CASI were 0.97, 0.80, 0.96 and 0.92, respectively. The correlation of age at menarche between CASI and FFI was 0.728. Approximately >95% and 76.3% of the difference in the age at menarche was within 12 months and 3 months, respectively, between the two interview methods. Among primary schoolgirls in grade 5, the sensitivity, specificity, PPV, accuracy and the correlation (0.335) of CASI was lower than those in other subgroups.

Conclusions Overall, the timing of menarche investigated using CASI was valid among all Chinese schoolgirls, except for those in grade 5 or lower.

  • age at menarche
  • validity
  • the computer assisted self-administered interviewing

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Strengths and limitations of this study

  • We validated the self-reported age at menarche using computer-assisted self-administered interviewing (CASI), in comparison with face-to-face interviewing (FFI), in a large population of 3478 schoolgirls in six provinces in China nationwide.

  • The correlations in subgroups according to locations, grades, awareness in reproductive health and breast tanner stages were determined, and the correlation of the age at menarche reported using CASI with FFI was poorer among girls in lower grades or those with poor reproductive health knowledge.

  • The data collected using CASI and FFI were self-reported and not prospectively recorded in this study.

Introduction

Menarche, one of the milestones in pubertal development, is regarded as a unique maturation marker of transition from girls’ childhood to adulthood and is considered an essential public health target for sexual education. The age at menarche is related to mental disorders.1 Both early and late menarche were associated with an increased risk of vascular disease.2 3 Therefore, a valid assessment of menarcheal age is fundamentally needed for epidemiology studies that are conducted to evaluate the impact of timing of menarche. Self-reporting of menarcheal age by face-to-face interviewing (FFI) has been commonly used and considered valid and effective for evaluating the timing of menarche by short-term recall.4 5

Girls’ attitude to menarche has been found to vary according to their different cultural backgrounds.6 7 In Asian countries, girls are more sensitive and conservative regarding reproductive health issues. Therefore, Asian girls tend to feel ashamed when talking about menarche. Computer-assisted self-administered interviewing (CASI), in which respondents read the questions of a survey on a computer screen and then directly enter their responses into a computer, has been applied for investigating reproductive health to improve the quality and efficiency of self-reported data.8 In addition to cost-saving, a higher reporting of adolescent sexual behaviour, drug use and violence in surveys of risk behaviours were observed with CASI for school-aged children in comparison with FFI or paper-and-pencil self-administered interviews.9 10 This was because the CASI provides increased privacy of responses and the freedom for reporting behaviours that are widely believed to be risky or socially undesirable.11 12 However, FFI for assessing adverse experiences is generally regarded as superior to self-administered interviewing because FFI allows for probing and clarification of relevant details and minimises biases related to subjective responses.13 To our knowledge, there are currently no studies conducted to examine the validity and reliability of self-reported menarche data by CASI in Chinese culture.

The objective of the present cross-sectional study was to confirm the validity of the status and age of menarche attainment among schoolgirls in China obtained using CASI in comparison with FFI.

Method

Population and sample

This cross-sectional study was conducted in six provinces in China from November 2012 to April 2013. A total of 4290 girls from 26 sampled schools were recruited. These girls were sampled using the multistage cluster sampling strategy.14 There were 24 girls with missing records regarding menarche and 788 girls refused to undergo the physical examination (online supplementary table S). Finally, 3478 girls were interviewed by both CASI and FFI.

Supplementary file 1

Both parental permission and students’ consent were obtained for all participants before the survey.

Data collection

Sawtooth  Ci3,  V. 2.6.16 (Sawtooth software, Inc., Utah, USA) was used to compile the questionnaire that was administered using personal computers. During CASI, girls were interviewed with two main questions regarding their menarche. The first question was ‘do you have menstrual periods?’; if the answer was ‘yes’, they were asked ‘how old were you when you started your first period?’. Additional questions were asked as necessary to probe for a more accurate date of menarche attainment (eg, ‘what grade in school were you?’ and ‘what season was it?’). Girls were also tested for their awareness in reproductive health related to pubertal development, pregnancy and knowledge and perception of sexually transmitted diseases and acquired immune deficiency syndrome. The test contained 26 and 27 questions for girls in primary and middle schools, respectively. There were three research assistants in each room with 25~50 computers. One of these assistants issued unique codes and explained the background and objective of the survey, while the other two helped the participants log into the computers using the codes and provided guidance for completing the interview. The research staff uploaded and saved the data to the computer station at the end of the survey. The research staff did not interpret survey questions or observe the participants respond to specific survey questions.

We also conducted a physical examination and FFI for the girls who had completed CASI (n=3478). During FFI, the girls were also asked the same two main questions regarding their menarche. The trained clinicians first explained about menstrual periods to the girls and clarified that menarche was the first menstrual bleeding. The clinicians also asked necessary questions to help the participants recall their age at menarche (eg, ‘what grade in school were you?’ and ‘what season was it?’). Girls were additionally examined for their pubertal development (eg, inspection and palpation of breast), and their medical and surgical histories were obtained.

Statistics

FFI, conducted by the clinicians, was used as the reference for determining the age at menarche. The capacity of CASI to correctly classify the status of menarche (dichotomous data: yes/no) was verified by tools of standard epidemiological indices, including sensitivity, specificity, predictive values and accuracy.15 There were three options for the CASI method: yes, no and unclear. Sensitivity was defined as the proportion of girls truly having menarche who were correctly grouped as such by the CASI. Specificity represented the proportion of girls who truly had no menarche and were correctly grouped as such by CASI. The predictive values were calculated as positive predictive value (PPV) and negative predictive value (NPV). The PPV was the proportion of girls truly having menarche among girls categorised as such by CASI. The NPV was the proportion of girls who truly had no menarche among girls categorised as such by CASI. The accuracy rate was the proportion of agreement between the classification of menarche status between CASI and FFI.

Subgroup analysis was conducted according to location (urban and rural), grades (grades 5–6: primary school, grades 7–9: junior middle school and grades 10–12: senior middle school), awareness in reproductive health and Tanner stages of breast development. The awareness of reproductive health was categorised into three groups according to the proportion of questions that the girls answered correctly (<25%, 25%–50% and >50%); all the questions were assumed to be equally important for evaluating their awareness. Breast development was categorised as Tanner stages B1–B5, where stage 1 (B1) represented immaturity and stage 5 (B5) represented full maturity.16–18

A retrospective method was used to estimate the average age at menarche, and the means and percentiles (P5, P25, P50, P75 and P95) were calculated. Both Pearson and Spearman correlations were computed for determining the consistency of the age at menarche by CASI and FFI. The correlations between the difference in the age at menarche (CASI-FFI) and time interval between investigation and menarcheal onset were also calculated. Correlations were classified according to Cohen’s criteria whereby a correlation of 0.10, 0.30 and 0.50 indicated a small, medium and large effect size, respectively. A Bland-Altman plot was constructed to measure the agreement of the age at menarche between FFI and CASI.19 20 The age at investigation was computed according to the girls’ birthdate, as obtained by FFI, and the date of investigation.

Results

The mean age of the study participants was 14.3 years (SD: 2.46 years). Of the 3478 girls, 53.5% were from urban areas, 68.7% had a low awareness of reproductive health (<50% of correctly answered questions) and 24.1% answered <25% of the questions correctly. Almost 60% of the participants were categorised in the late Tanner breast stages (B1: 6.4%; B2: 10.5%; B3: 23.5%; B4: 28.1%; B5: 31.5%; table 1).

Table 1

The capacity of computer-assisted self-administered interviewing (CASI) to correctly classify menarcheal status using face-to-face interviewing (FFI) as a reference

After physical examination, 2538 (73.0%) and 2496 (71.2%) girls who underwent FFI and CASI, respectively, were found to have attained menarche. Two hundred and three (5.84%) girls were unclear about their status of menarche during CASI (table 1). Compared with FFI, the sensitivity, specificity, PPV, NPV and accuracy of CASI method were 0.97, 0.80, 0.99, 0.96 and 0.92, respectively. The PPVs increased, while the NPVs decreased, with increasing grade and later Tanner breast stages. Among girls in grade 5, the sensitivity, specificity, PPV and accuracy were <0.8. The specificity was lower among girls from rural area (specificity: 0.71) or those with a lower awareness of reproductive health (specificity: 0.71; table 1).

Among the 2458 girls who reported their menarcheal age, the average age at menarche was 12.5 years in both FFI and CASI. The Pearson and Spearman correlation coefficients for the age at menarche between CASI and FFI was 0.802 and 0.869, respectively. The partial correlation coefficient was 0.728 after adjusting for locations, grades and awareness of reproductive health. The Pearson, Spearman and partial correlation coefficients were increased with increasing grade and awareness in reproductive health. Among girls in grade 5, the Pearson, Spearman and partial correlation coefficients were 0.369, 0.678 and 0.335, respectively (table 2). The mean difference in the age at menarche between CASI and FFI was 0.05 years (SD: 0.82 years). Approximately >95% and 76.3% of the difference in the age at menarche between CASI and FFI ranged within 12 months and 3 months, respectively (figure 1). The time interval between the age at investigation and age at menarche had a small effect on this difference (correlation: 0.189) in the investigated population (figure 2).

Figure 1

Bland-Altman plot showing agreement of age at menarche between CASI and FFI.The line in the middle represents the mean difference in age at menarche between the two instruments (M=0.05), and the two other dotted lines represent the upper and lower limits of agreement (M±2 SD=−1.59, 1.69). CASI, computer-assisted self-administered interview; FFI, face-to-face interview.

Figure 2

Correlation between differences CASI and FFI across the time interval since menarche to investigation (partial correlation=0.189). CASI, computer- assisted self-administered interview; FFI, face-to-face interview.

Table 2

The correlations in menarcheal age between computer-assisted self-administered interviewing (CASI) and face-to-face interviewing (FFI) among girls who have attained menarche

Discussion

In the present study, we examined the capacity of CASI to correctly classify the status of menarche and validate the self-reported age at menarche compared with FFI, the reference method. We generally found that the validity of the status of menarche obtained by CASI was satisfactory due to higher scores obtained for the indices (ie, sensitivity, specificity, predictive values and accuracy). PPVs increased and NPVs decreased with increasing grades and Tanner breast stages. This negative correlation of PPV and NPV was probably attributed to the increased prevalence of menarche across the age groups.15 The Tanner stages of breast development and school grades generally increased with age.21 22

We also found that the menarcheal age reported in CASI closely agreed with that in FFI. The discrepancy in the age at menarche between these two interviews varied by an average of 0.6 month. The average age at menarche in CASI was 12.5 years, which was similar to that of FFI. Dorn et al 23 conducted a cross-sequential study in 253 girls categorised into four age cohorts to explore the reliability of age at menarche across time points and methods. They reported large discrepancies in the age at menarche between the phone interview and FFI across 12 time points.

Moreover, we found lower scores of sensitivity, specificity, PPV and accuracy and a medium correlation of the age at menarche between CASI and FFI among girls in grade 5. We also found a relatively low specificity in those living in rural areas and those with a low awareness in reproductive health. Such lower scores would be due to the low awareness in reproductive health.24 In our study, girls in grade 5 attended primary school and were aged 10.9 years on average. In China, most girls initially become informed regarding reproductive health, including menarche, in grade 5.25 Girls who were not knowledgeable about menarche would probably not fully understand the questions that were asked from them during the interviews, which can result in inaccurate answers.26 In our study, 603 (17.3%) girls did not know what menstruation was, and girls in grade 6 or lower had lower knowledge of menstruation than girls in grade 7 or higher. According to the subgroup analysis regarding the girls’ knowledge of reproductive health, including menstruation, the correlation in the age at menarche between CASI and FFI was poorer among girls with low knowledge. Girls living in rural areas of China may have less access to computers and poorer computer skills compared with those in urban areas, which could impact the ability of the girls from rural areas to respond accurately during the CASI. Furthermore, the accuracy of the timing of menarche can be influenced by recall bias from the study participants.5 27 In our study, the time from menarche to study participation had only a small effect on the difference between FFI and CASI. The correlations in the age at menarche between interview methods also showed similar results across time.26

In the present study, conducted in a large population of 3478 schoolgirls in six provinces of China nationwide, we validated the use of CASI for determining girls’ status and age of menarche attainment using FFI as a reference. FFI has been considered a valid and reliable method26 for measuring menarcheal age based on long-term28–31 and short-term recalls.5 32 33 However, our study was based on a cross-sectional study, and the data regarding menarche collected using both CASI and FFI were self-reported and not prospectively recorded.

Conclusions

The timing of menarche investigated in CASI was valid among all Chinese schoolgirls, except for those in grade 5 or lower, which suggested that the CASI method should be used with caution among Chinese primary school students.

Acknowledgments

We would like to thank the administrators of field education bureau and teachers of the field schools for their assistance with facilities and arranging the computer-assisted self-administered interviews and physical examinations for this study. We also thank Editage (http://www.editage.cn) for English language editing.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
View Abstract

Footnotes

  • Contributors WZ, CL, SZ and SL conceptualised and designed the study; YM, YZ and XZ collected and cleaned the data; YM, QL and XZ conducted statistical analysis and drafted the manuscript; XT, SL, YZ and QL interpreted the results; CL, WZ and SZ contributed to discussion; and all authors reviewed and approved the final manuscript.

  • Funding This study was funded by the National Key Technology Research and Development Program of China (Grant No. 2012BAI32B02) and the National Science and Technology Infrastructure Program of China (Grant No. 2013FY110500).

  • Competing interests None declared.

  • Patient consent Parental/guardian consent obtained.

  • Ethics approval The study was reviewed and approved by the institutional review board of Shanghai Institute of Planned Parenthood Research (2012-01).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement The authors are willing to share any of the data collected during validation process that are not in this published manuscript or the online supplementary material.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.