Article Text

Download PDFPDF

Assessment of mental health literacy using a multifaceted measure among a Chinese rural population
  1. Yu Yu1,
  2. Zi-wei Liu1,
  3. Mi Hu1,
  4. Xi-guang Liu1,
  5. Hui-ming Liu1,
  6. Joyce P Yang2,
  7. Liang Zhou1,
  8. Shui-yuan Xiao1
  1. 1Department of Social Medicine and Health Management, School of Public Health, Central South University, Changsha, Hunan, China
  2. 2Department of Psychology, University of Washington, Seattle, Washington, USA
  1. Correspondence to Professor Shui-yuan Xiao; xiaosy{at}live.com

Abstract

Objectives The present study aims to assess mental health literacy (MHL) using a standardised multifaceted 20-item instrument called Mental Health Knowledge Questionnaire (MHKQ) developed by the Chinese Ministry of Health, among a rural Chinese population.

Setting Four villages in Liuyang county of Hunan province, China.

Participants This was a cross-sectional study. A multistage cluster-sampling method was adopted, leading to a final sampling frame of 2377 residents aged 18–60 years from four villages of Liuyang county. Included in the study were residents aged 18–60 years living in their village for at least half a year; excluded were those not living in the areas during the research period, those with difficulty in communication due to serious physical or mental illness and those who were cognitively impaired or actively psychotic. Finally, 2052 participants completed the survey.

Primary and secondary outcome measures Primary outcome was correct response rate of the MHKQ; secondary outcome measures were association between sociodemographics and MHL, and association between MHL and health outcomes.

Results Correct response rates for the 20 MHKQ items ranged from 19% to 94%, with a mean rate of 58%. Younger age (r=−0.02, p<0.01), higher education (r: 1.38–2.69, p<0.01) and higher income (r=0.41, p<0.01), were independently associated with higher MHL. MHL was independently associated with self-rated general health (r=2.31, p<0.01), depression (r=−0.09, p<0.01) and anxiety (r=−0.07, p<0.05).

Conclusions MHL in the rural areas of Liuyang is lower than that reported in urban areas of China. There is much room for improvement with regard to MHL promotion in rural areas of China. Younger age, higher education and higher income are the three robust factors related to higher MHL, so cohort-specific educational intervention efforts may be indicated.

  • MENTAL HEALTH
  • PUBLIC HEALTH

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • Broadening the definition of mental health literacy (MHL) to include ‘illness literacy’ as well as ‘health literacy’.

  • Assessing population level MHL in rural China using a multifaceted measurement tool—the Mental Health Knowledge Questionnaire (MHKQ)—instead of vignettes based on Western cultural contexts.

  • Exploring the relationship between MHL and a range of health outcomes, which is a substantially underdeveloped area of research.

  • The cross-sectional study design makes causal relationships undeterminable.

  • Lack of comparison between MHKQ with other multifaceted scales intending to measure MHL as the MHKQ has not be utilised outside of China.

Introduction

Mental health literacy (MHL) refers to knowledge and beliefs about mental health disorders that aid in their recognition, management or prevention.1 First introduced in 1997 by Australian researchers Jorm et al, this definition has become a gold standard within research and practice on MHL.2 According to Jorm et al, MHL includes seven key components: (1) the ability to recognise specific disorders; (2) knowledge of how to seek mental health information; (3) knowledge of risk factors of mental illness; (4) knowledge of causes of mental illness; (5) knowledge of self-treatments; (6) knowledge of professional help available and (7) attitudes that promote recognition and appropriate help-seeking. Based on Jorm et al’s definition, O'Connor et al2 grouped the seven key components of MHL into recognition, knowledge of factors relating to mental health, and attitudes and beliefs about mental disorders. Of the various aspects of MHL, recognition of mental disorders is the most common attribute measured in MHL, as it is the first step towards MHL and forms a pre-requisite for measurement of other attributes.

Ever since the definition of MHL was first proposed, the concept has drawn extensive attention to the public's low level of MHL, with growing evidence showing low recognition rate of common mental disorders among various populations in developed and in developing countries. For example, the recognition rate of depression is <50% among adolescents3 and college students4 in the USA, and is only 11% among patients with cancer and 25% among lay people in Japan.5 One study among Portuguese youth reported the recognition rate of schizophrenia or psychosis as 42.17% and 22.21%, respectively,6 while another study among resettled Iraqi refugees found that only 14.2% of participants recognised post-traumatic stress disorder. Further investigation of the factors related to MHL has found that female gender,7–9 higher education,10 ,11 younger age10–12 and being employed11 are associated with higher MHL. The importance of MHL in help-seeking behaviour has also been studied, with evidence indicating that lack of MHL is a main challenge that patients and families face in seeking help,13 ,14 especially in Asian cultures, where utilisation of mental health services is lower across the board.15 There is also growing evidence showing that higher MHL is associated with better access to and utilisation of mental health services.16 ,17 Moreover, increasing MHL can improve help-seeking behaviour, the quality of mental health service and, as a result, patients’ symptoms.18 ,19

Despite the rich and abundant research on MHL all over the world, it is important to note that there are three major limitations in existing studies on MHL.

First, the most widely used definition of MHL by Jorm is problematically narrow in its scope. Based on the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV), Jorm's definition of MHL is illness-oriented, neglecting the fact that health-oriented literacy including self-regulation strategies and techniques to improve mental health should also be incorporated as an important component of MHL.20 Kusan21 and Wei et al22 have suggested a broader definition of MHL including knowledge to enhance and maintain good mental health, knowledge of mental disorders and their treatments, decreased stigma against mental disorders and enhanced help-seeking efficacy, however, this definition is rarely used in research related to MHL.

Second, existing assessment of MHL mainly relies on a vignette interview approach, which may not comprehensively reflect respondents’ understanding of mental health. In the vignette interview approach, a vignette is presented that describes an individual with a mental health difficulty and asks a series of questions related to participants’ understanding of what is ‘wrong’ with the individual in the vignette.1 ,23 The vignette interview approach usually targets one specific mental disorder without reflecting understanding of the multifaceted concept of MHL. It is especially lacking in assessment of people's health literacy, thus evaluation of MHL based on the vignette interview approach may be incomplete. Furthermore, the vignette interview approach does not provide for a total or subscale score to be generated, nor does it allow for subscales to be included, making it impossible to make individual-level comparisons on each specific attribute of the multifaceted MHL.2 Moreover, the questions of the vignette are not independent, with the answer to the first question forming the basis for the answers to the remaining questions, which may not reflect the respondent’s true knowledge of the aetiology and treatment of mental disorders.2

Third, most previous research has focused on the current situation of MHL and its association with demographics characteristics such as gender, age, education and employment, without noticing the potential impact of MHL on a series of health outcomes including physical, mental and social health. Although improved MHL has been proven to generate improved mental health at the individual level in two intervention studies,24 ,25 whether this could be translated into gains at the population level remains to be seen.26 Even less is known about the impact of improved MHL on other domains of health such as physical and social health.

In light of these gaps, in the current study, we administered a 20-item instrument developed by the Chinese Ministry of Health (MOH)—the Mental Health Knowledge Questionnaire (MHKQ)27—to assess MHL in a representative sample of rural adults living in Liuyang City of Hunan Province, China. Based on the broader definition of MHL laid out by Kusan21 and Wei et al,22 the MHKQ assesses both ‘disorder literacy’ and ‘health literacy’ of individuals. The MHKQ was used as a nationwide gold standard to assess the public's MHL, after the ‘2002–2010 China Mental Health Work Plan’28 was issued by the MOH, with the purpose of increasing the public's MHL to 50% by 2010. The present study aims to measure the current level of MHL in the rural areas of Liuyang county in Hunan province, and to explore its association with sociodemographics and a series of health outcomes including physical, mental and social health.

Methods

Participants

This was a cross-sectional study. The target population was residents aged 18–60 years who had lived in the rural areas of Liuyang county, Hunan province, for over 6 months. The survey was conducted from November 2010 to August 2011. A multistage cluster-sampling method was adopted to identify participants (figure 1). Two towns (Gaoping and Yong’an) were randomly selected from 33 towns of Liuyang county, and then two villages were randomly selected from each town, followed by two samples randomly selected from each village, leading to a total sampling frame of eight samples. Those who were not living in the areas during the research period, those with difficulty in communication due to serious physical or mental illness and those who were cognitively impaired or actively psychotic, were excluded, leading to a final sample of 2052 residents.

Figure 1

Flow chart of participant enrolment.

Interviewers visited each household and conducted face-to-face interview with each eligible respondent after obtaining written informed consent. Each interview took approximately 1 h, and each household was reimbursed with small gifts such as kitchen utensils ($2). Completed surveys were checked by a quality control person to ensure that there were no inconsistencies or missing items.

Instruments

MHKQ is a 20-item self-report questionnaire developed, in 2009, by the Chinese MOH, to assess public knowledge and awareness of mental health. Items 1–16 are statements about mental health that require respondents to choose ‘true’, ‘false’ or ‘unknown’; correct responses are ‘true’ for items 1, 3, 5, 7, 8, 11, 12, 15 and 16, and ‘false’ for items 2, 4, 6, 9, 10, 13 and 14. One point is given to each correct answer, with incorrect or unknown responses receiving 0 points. Items 17–20 ask about whether the respondents have heard of four mental health promotion days, with 1 or 0 points given to those answering ‘yes’ and ‘no’, respectively. Past psychometric testing of the scale has reported internal consistency of Cronbach's α coefficients ranging from 0.57 to 0.7310 ,11 ,29 and a 2-week test–retest reliability of 0.68 as measured by intra-class correlation coefficients.29 However, there has been inconsistency regarding subscales of the MHKQ, with four11 ,29 and five subscales10 being reported in various studies. In the present study, the MHKQ had a Cronbach's α coefficient of 0.61. An exploratory factor analysis yielded a three-factor solution, which covers three aspects of MHL, including knowledge of the characteristics of mental health and mental disorders (items 1, 2, 3, 5, 7, 8, 11, 12, 15 and 16), belief in the epidemiology of mental disorders (items 4, 6, 9, 10, 13 and 14), and awareness of mental health promotion activities (items 17–20), with Cronbach's α coefficients ranging from 0.62 to 0.67.

The Self-Rated Health Measurement Scale (SRHMS) is a 48-item scale developed and revised by Xu et al30 ,31 to assess self-rated health in hospitalised as well as general populations. It is a comprehensive scale measuring nine domains of health including physical symptoms and organ functions (B1), daily physical activities (B2), physical mobility (B3), psychological symptoms and negative emotions (M1), positive emotions (M2), cognitive function (M3), role activity and social adaptability (S1), social resource and social contact (S2), and social support (S3), which are grouped into three categories in the present study: physical health (BZT), mental health (MZT) and social health (SZT). Each item is rated on a 10-point scale from 1=‘extremely poor health’ to 10=‘extremely good health’. Items 4, 5, 7, 24, 25, 26, 27, 28, 29 and 30 are reverse scored and a cumulative score is obtained by adding individual scores. The SRHMS has widespread use in China30 ,32 ,33 and demonstrated good internal consistency in the current study, with a Cronbach's α coefficient of 0.91 for the total scale and 0.80–0.82 for its three subscales.

The Patient Health Questionnaire (PHQ-9) is one of the most widely used screening tools for depression in adults. The 9-item questionnaire is based on criteria for depressive disorders in the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV).34 Respondents are asked whether they have been bothered by nine symptoms in the past 2 weeks on a four-point Likert scale from 0=‘not at all’ to 3=‘nearly every day’, with higher scores indicating higher depression. A total score is calculated by adding the scores of each item and ranges from 0 to 27. The Chinese version of PHQ-9 has been well validated in multiple studies35–37 and showed good internal consistency in the current study, with a Cronbach's α coefficient of 0.81.

The Generalised Anxiety Disorder Scale (GAD-7) is a 7-item self-report scale developed by Spitzer et al38 to assess symptoms of and screen for generalised anxiety disorder in primary care settings. Respondents are asked to choose how often they have been bothered by anxiety symptoms, on a four-point Likert scale from 0=‘not at all’ to 3=‘nearly every day’. A total score is calculated by adding the scores of each item, and ranges from 0 to 21, with higher scores indicating higher anxiety. The GAD-7 has been widely used and well validated in psychiatric settings39 and in general populations,40 and demonstrated good internal consistency in the current study, with a Cronbach's α coefficient of 0.88.

Data analysis

Data were analysed using STATA software V.12.0. Sociodemographic characteristics of the sample were examined using descriptive statistics. analysis of variance and t tests were used to compare the MHL score of respondents by gender, age, ethnicity, education, employment, income, marriage and religion, followed by multiple linear regression, to identify the characteristics of respondents that were independently related to the assessed level of MHL. The association between MHL and each of the health outcomes including self-rated mental health, physical health, social health, depression and anxiety were analysed using separate multiple linear regression models adjusted for all demographics.

Results

Sample characteristics

A total of 2052 residents completed the questionnaires with a response rate of 95.1%, and their demographic characteristics are summarised in table 1. The median age of the sample was 42 years with a range of 18–59, with more female (55.80%) than male (44.20%) participants. Most of the sample were of Han ethnicity (99.5%), married (90.98%) and non-religious (90.01%), with low education (middle school and below: 84.75%); 61.11% of the sample were employed, and over two-thirds had a monthly income of lower than ¥300.

Table 1

Sociodemographics of the sample (N=2052)*

Correct response rate of the MHKQ

In this sample, the correct response rate of the 20 items ranged from 18.7% to 94.1%, with a mean correct response rate of 58.1%. The computed MHL score ranged from 0 to 20 and the mean (SD) value was 11.6 (2.9). Awareness rate of the four international mental health awareness days ranged from 18.7% to 56.8%, with ‘International Day Against Drug Abuse and Illicit Trafficking’ as the most widely recognised mental health promotion day (56.8%). Less than one-quarter of respondents had heard about World Sleep Day (20.3%), World Mental Health Day (24.5%) and World Suicide Prevention Day (18.7%). Of the 16 true–false questions, the items that were most likely to be answered correctly were item 11, ‘An optimistic attitude towards life, good inter-personal relationships and healthy living habits are helpful to maintain mental health (94.1%); item 5, ‘The main content of mental health includes normal intelligence, stable emotion, good mood and harmonious inter-personal relationships’ (87.9%) and item 1, ‘Is mental health an integral part of health?’ (87.2%). Items with the lowest correct response rates were item 2, ‘Mental illnesses are caused by ethically (or politically) incorrect thinking’ (23.59%); item 4, ‘All mental disorders are due to arousal of violent emotion’ (27.34%) and item 9, ‘Psychological/psychiatric disorders can never be prevented’ (41.81%). The correct response rate of each question is displayed in table 2.

Table 2

Correct response rate of Mental Health Knowledge Questionnaire (N=2052)

Association between sociodemographics and MHL

The mean total score of the sample was 11.63±2.9. Table 3 shows the mean MHKQ scores for different demographic groups of participants. There were statistically significant differences in the scores by age, education, employment, income and marital status. Univariate analyses showed that younger age, higher education, being employed, higher income and being single are associated with higher mental health knowledge. Subsequent multiple linear regressions controlling for all demographic factors showed that age, education and income were independently associated with MHL (table 4). Participants of younger age, with higher education and higher income had better MHL. When age increases by 1 year, the MHKQ score decreases by an inconsiderable 0.02 points. When education increases from primary school to middle school and college, MHKQ score increases by 1.38 and 2.69 points, respectively. When income increases from below ¥150 per month to above ¥300 per month, MHKQ score increases by 0.41 points.

Table 3

Univariate analysis of the Mental Health Knowledge Questionnaire score

Table 4

Multiple linear regression of Mental Health Knowledge Questionnaire scale scores

Association between MHL and health outcomes

To explore the association between MHL and health outcomes, we conducted multiple linear regression for SRHMS, PHQ and GAD independently, adjusting for all demographics. Our results are shown in table 5; MHL was independently positively associated with self-rated general health (r=2.31, p<0.01), including physical health (r=0.46, p<0.01), mental health (r=0.54, p<0.01) and social health (r=1.07, p<0.01), regardless of demographics. A one-point increase in MHL led to an increase of 2.31 points in self-rated general health. MHL was also independently negatively associated with depression (r=−0.09, p<0.01) and anxiety (r=−0.07, p<0.05), regardless of demographics. A one-point increase in MHL led to 0.09-point decrease in depression scores and 0.07-point decrease in anxiety scores.

Table 5

Association between mental health literacy (MHL) and each health outcome (Self-Rated Health Measurement Scale (SRHMS), Patient Health Questionnaire (PHQ) and Generalised Anxiety Disorder Scale (GAD)) using multiple linear regression models adjusted for demographics†

Discussion

This study was conducted to assess MHL in rural areas after the MOH issued the ‘2002–2010 China Mental Health Work Plan’,28 which aimed to increase public awareness rate of the characteristics and prevention of mental disorders to 50% by 2010. The current study in the rural areas of Liuyang is based on a protocol developed by the Chinese MOH, which produced data on community members’ MHL to provide guidance and a basis for future mental health advocacy and education. The mean overall correct response rate of MHL identified in this study is 58%, suggesting that the goal of ‘2002–2010 China Mental Health Work Plan’ was achieved in the rural areas of Liuyang. However, this rate is lower than those reported in urban areas of China such as Shanghai (72%),10 Guangzhou (60.2%),41 Changsha (68.5%)11 and Xi'an (70.3%).42 This may be explained by the less developed economy in rural areas of China. MHL in less developed rural areas is in need of improvement through population wide interventions and also through individual training programmes.26

Compared to the 57% awareness rate of the International Day Against Drug Abuse and Illicit Trafficking, the awareness rates of World Mental Health Day, World Suicide Prevention Day and World Sleep Day are much lower. The reason may be that the government has put much greater emphasis on drug abuse and trafficking, due to its greater potential to threaten and endanger social safety and stability compared to other mental health problems such as sleep disorders and suicide. Promotion efforts on the other 3 days need to be strengthened by the government to increase public awareness of these issues and popularise knowledge about them. Most people (over 70%) held misbeliefs about the aetiology of mental illness, trusting that ethically incorrect thinking or the arousal of violent emotions causes mental illnesses. These misattributions are consistent with reports in previous studies in China,10 ,11 implying that misattribution of mental illness is prevalent throughout the country. The misconception of the causes of mental illness may be an important antecedent for the pervasive negative attitudes towards mentally ill patients. Future targeted intervention may benefit by educating the public on accurate recognition of causes of mental illness.

Significant differences in the MHL score between different demographic groups of respondents were found in the current study. Multivariate linear regression indicated that younger age, higher education and higher income were the most robust factors associated with higher MHL. These results are consistent with previous studies.10–12 Higher education, as an indicator of higher health literacy, can be seen as an indirect indicator of MHL and thus is associated with higher MHL. Higher income, usually accompanied with higher education, is also related to higher MHL. Interestingly, being younger, rather than being older, is associated with higher MHL. The reason may be related to the different social political environments that different generations have experienced. During the Chinese Cultural Revolution (1966–1976), education was not valued by the Chinese government, leading to many people not receiving an education when they were young. It was not until 1986, when the government introduced the 9-year compulsory education policy, that education became available to all citizens in the nation. Since then, the educational level has increased throughout China. Hence, the negative correlation found between age and MHL may reflect China's political history.

The positive impact of high MHL on a series of health outcomes including physical, mental and social health, is established in the present study. The result that people with higher MHL also enjoy better physical and social health is a novel finding that has not been reported in the existing literature. The mechanism behind this association may be related to the improved help-seeking behaviour that has been widely documented among people with higher MHL,16–19 which may lead to increased general health outcomes including physical health and social health. The finding that increased MHL is associated with increased general health provides strong motivation to enhance population MHL through a series of educational campaigns.

One limitation of the present study is the unfavourable internal consistency of the 20-item MHKQ scale (Cronbach's α=0.61), which is in keeping with previous studies showing weak to acceptable internal consistency.10 ,11 ,29 However, this may be due to the fact that for knowledge scales measuring various factors of a construct, knowing the correct answer of one item does not necessarily lead to the right recognition of another item, thus a very high internal consistency may not be expected. Indeed, as a standardised government document developed by the Chinese MOH to assess the public knowledge and awareness of mental health, the MHKQ has been popularised as a national gold standard to compare MHL across the country. The purpose of the present study is not to test the psychometric properties of the MHKQ, but to compare the level of MHL in the rural areas of Liuyang with other parts of China. As a result, the psychometric properties of the MHKQ are not of primary importance, given that the scale is comparable across different studies.

Another limitation is the cross-sectional design of the study, which precludes evaluation of temporal sequence of MHL and health outcomes, and causal relationships cannot be determined. However, according to the scale's design, the SRHMS assesses self-rated health in the past 4 weeks,30 ,31 the PHQ34 and GAD38 measure depression and anxiety in the past 2 weeks, while the MHKQ measures an individual's lifetime knowledge and belief about mental health, which may take root in a person's early life. We could infer a potential causal relationship between MHL and health outcomes.

A third limitation is a lack of comparison between MHKQ and other multifaceted scales intending to measure MHL. The fact that MHKQ is developed and used only in China makes it difficult to compare the psychometric properties of the Chinese version of MHKQ with scales used in populations outside China, since psychometric testing is also sample dependent.43 Future research may benefit from applying the English version of the MHKQ together with other scales in the same study to compare its feasibility and psychometric properties.

In conclusion, MHL in the rural areas of Liuyang is lower than that reported in urban areas of China. More efforts are needed to increase public awareness of mental health promotion activities and more population-level intervention programmes are needed to educate the public about the correct attribution of mental disorders. Younger age, higher education and higher income are the three strongest factors related to higher MHL, so educational interventions may need to be cohort specific, with special attention paid to those who are older, poorer and less educated. Higher MHL is related to better general health including physical, mental and social health, suggesting that improvement of MHL may enhance overall population health, warranting future exploration.

Ethical statement

This study was approved by the Institutional Review Boards of the School of Public Health of Central South University, and was performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments. All participants in the present study gave their informed consent prior to their inclusion in the study. Details that might disclose the identity of the subjects under study were omitted and all data collected were unidentified.

Acknowledgments

The authors would like to thank the village cadres for guiding us to visit each household in the rural areas of Liuyang county, Hunan province, China.

References

Footnotes

  • Contributors SX and LZ conceived and designed the study. YY, ZL, MH, XL and JPY collected the data. YY and ZL analysed and interpreted the data. YY drafted the article, while SX, LZ, MH, ZL, XL and JPY critically revised it for intellectual content. All the authors gave final approval to the version submitted for publication.

  • Funding This study was funded by the National Science and Technology Support Program, China (Number 2009BAI77B01; Number 2009BAI77B08) and the Hunan Provincial Innovation Foundation for Postgraduate (number CX2015B058).

  • Competing interests None declared.

  • Patient consent Obtained.

  • Ethics approval Institutional Review Boards of the School of Public Health of Central South University.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement All data underlying the findings in our study are freely available on request; please contact YY at youxiang8864@163.com for the dataset and analysis commands.