Objectives This study aims to develop assessment indicators of health education and promotion for non-communicable disease (NCD) demonstration districts in China and to identify significant factors associated with NCD health education and promotion work.
Methods Three complementary techniques were used to conduct this study in Hunan Province, China, between late 2013 and 2015. The Delphi technique was used to develop weighted assessment indicators, followed by the rank sum ratio (RSR) to normalise the weights through rank conversion. Lastly, the technique for order of preference by similarity to ideal solution was conducted to assess five randomly selected NCD demonstration districts representing five different orientations in the province.
Results A total of 24 assessment indicators were constructed covering the following sections: organisational management, fund support, personnel supplies, health education and promotion, people’s awareness of NCDs, management and control of patients with NCD, satisfaction with health education and promotion and health literacy of residents. Five districts were selected as samples for evaluation (Furong District, Ziyang District, Shaodong County, Shuangfeng County and Luxi County). Performance varied among the sites, with Furong District greatly surpassing the other sites, especially in fund support, media promotion, technical support for publicity materials, community promotion and supportive environment supplies. The latter four factors were also much greater in the second-ranked Luxi County site than those in the other sites (except Furong District).
Conclusions There were gaps in health education and promotion work in NCD demonstration districts in Hunan Province. The districts that performed better had obvious advantages in fund support, media promotion, technical support, community promotion and supportive environment supplies. Our study provided both a methodological reference and an assessment indicator framework for similar future studies.
- public health
- preventive medicine
- statistics & research methods
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
Strengths and limitations of this study
To the best of the authors’ knowledge, this study is the first to build assessment indicators for health education and promotion in non-communicable disease (NCD) demonstration districts in China.
This study used three popular assessment tools (Delphi, rank sum ratio and technique for order of preference by similarity to ideal solution) that are both qualitative and quantitative and hence provide a methodological reference for similar future studies.
One limitation of this study was that fewer NCD demonstration districts were selected as evaluation samples and thus failed to fully reflect the whole situation in China.
Another limitation was the cross-sectional design and lack of control data from either the history of those districts or non-NCD demonstration districts.
China has undergone a swift health transition over the past two decades. Currently, the spectrum of people’s diseases is dominated by non-communicable diseases (NCDs) (also known as chronic diseases), such as cardiovascular diseases, lung cancer, chronic obstructive pulmonary disease and road injuries,1 instead of infectious diseases. This transition has resulted in a rapid increase in the incidence of these diseases and a heavy disease burden. Currently, approximately 260 million Chinese accounting for 19% of the nation’s population suffer from NCDs, which contribute to 85% of the mortality rate and 70% of the disease burden.2 Thus, China is facing great challenges from NCDs.
The National Health and Family Planning Commission of China (NHFPC, the former Ministry of Health) launched a nationwide NCD demonstration district (or county) programme in late 2010 that was similar to the widely known health cities that were designated in many countries in the late 1980s.3 The programme aimed to create an exemplary effect of NCD demonstration districts for other regions and to promote NCD control and prevention across the country. In the principle of voluntary, step-by-step declaration, areas that wanted to become national NCD demonstration districts had to obtain a recommendation from the provincial health administration department and then pass an assessment organised by the NHFPC. Similarly, the declaration of provincial NCD demonstration districts went through a city-level recommendation first and then a provincial assessment.
Health education is defined as a systematic social activity that helps people improve their health-related behaviours. For NCDs, health education often involves publicising a healthy lifestyle, such as non-smoking, a low-salt diet, a proper diet, adequate physical activities and mental health, using publicity materials, billboard, lectures and media promotion. Health promotion is the process of enabling people to increase control over and improve their health.4 The Ottawa Charter for health promotion action includes the following five policies4: building a healthy public policy (eg, raising the tobacco excise tax), creating supportive environments (eg, building a fitness trail), strengthening community actions, developing personal skills and reorienting health services. Integrated health education and promotion are the first priorities of the policy and the primary means of NCD control and prevention; thus, these policies play important roles in NCD demonstration district programmes. However, the work is relatively new in China, and only rare systematic assessments have been reported (ie, no assessment indicators are available). Thus, based on health education and promotion in the districts, this study was conducted to develop assessment indicators, compare the performances among districts and analyse important factors for health education and promotion to provide a framework or methodological reference for other health studies.
Three evaluation techniques were comprehensively followed in the study. Figure 1 shows the flow diagram. A modified Delphi method originally developed by Kathryn Fitch5 was used in the following steps (conducted between late 2013 and 2014):
Thirty-nine subsectional consultative items in seven sections were selected for the first Delphi round based on the work manuals of the NCD demonstration districts developed by the Chinese Centre for Disease Control and Prevention (China CDC) and our own work experiences (see online supplementary appendix table A1).
Experts nationwide were invited if they met the following demands: worked in NCD control and prevention, health education and promotion or other public health professions, worked for provincial or national institutions with 5 years or more of work experience and showed an interest in participating in the study.
A two-round Delphi process was conducted. In the first round, experts were asked to judge whether items should be included and were free to add items or make comments. The experts scored each item using a 9-point Likert scale (1–9: extremely unimportant to extremely important).6–8 The data were summarised, revised and sent to experts for a second round following the same format as the first round. Then, the assessment indicators were determined.
Supplementary file 1
Second, the rank sum ratio (RSR) method introduced by Tian9 was followed (conducted in 2015). The basic theory behind the method is that a dimensionless statistical indicator is calculated from an n×m matrix using rank conversion. The subjects’ statuses (worst/best) were evaluated using the RSR order. All items were first ranked as (i≤n, j≤m), with the higher quality items ranked in ascending order and the lower quality items ranked in descending order. Then, a weighted RSR was calculated with the equation
Finally, the technique for order of preference by similarity to ideal solution (TOPSIS)10–12 was employed to assess the sampled NCD demonstration districts (conducted in 2015). Prior to the technique, some NCD districts were chosen as evaluation samples. To ensure a balanced geographic distribution of the districts, we randomly selected five districts representing different orientations (south, north, east, west and middle) out of the total 28 districts in the province and generated the following districts as samples with a randomising function in Microsoft Excel 2010: Furong District, Ziyang District, Shaodong County, Shuangfeng County, and Luxi County. The assessment indicator data were collected between 2014 and 2015 from the above districts. TOPSIS was conducted using the following six steps:
The original values of items (Xij) were converted to the high-quality (X’ij) values. However, there was no need to convert the values here due to their natural high-quality features.
The mono-trended matrix was normalised as Yij and calculated using the equation .
Based on the weights introduced by RSR, the combined values of the normalised matrix were calculated as using the equation .
The ideal solution and negative ideal solution were determined.
The distance of each alternative to the ideal and negative ideal solutions and the relative similarities of an alternative to the ideal solution were calculated.
The alternatives were ranked based on . A larger indicated a greater alternative.
During the Delphi process, the assessment items were excluded unless they simultaneously reached expert agreement (%)≥70%,13–15 a median score ≥716–18 and a coefficient of variation (CV) <0.25.19 20 The internal consistency of the items was evaluated with Cronbach’s α coefficient test. A Cronbach’s α of 0.7 or greater was regarded as reasonable reliability, and a value of 0.8 or greater was regarded as good reliability.21–23
The data were analysed from 2014 to 2015. The variable mean, SD, CV and Cronbach’s α were analysed with SPSS V.17.0. Other related data obtained from the above methods were addressed using Microsoft Excel 2010.
In total, 19 experts (figure 2) from national or provincial public health institutions completed the Delphi process. Most of the experts (68.42%) came from the CDC. The experts had been working for a mean of 15.53±7.40 years, and approximately 90% of the experts had been awarded honours as senior doctors. All the experts had bachelor degrees in public health, and 63% of the experts had master’s degrees.
The two-round Delphi process (table 1) removed 15 items, including 14 in the first round and one in the second round. Twenty-four items remained as assessment indicators with scores defined as weights (see online supplementary appendix A2), which covered the following sections: organisational management, fund support, personnel supplies, health education and promotion, awareness of NCDs, satisfaction with health education and promotion and health literacy of residents.
The Cronbach’s α value in the first Delphi round was 0.90 with a 95% CI of 0.82 to 0.95, whereas the Cronbach’s α in the second round was 0.85 (95% CI 0.74 to 0.93). Thus, both rounds exhibited good internal consistency.
The RSR method was used to normalise the indicator weights provided by the modified Delphi method (table 2).
Prior to the TOPSIS technique, five NCD demonstration districts were randomly sampled as follows: one national level NCD demonstration district (Furong District) and four provincial level districts (Ziyang District, Shaodong County, Shuangfeng County and Luxi County). Then, the TOPSIS technique was used to normalise the real values of the assessment indicators in the sample districts and to calculate combined indicator values (table 2).
Finally, the five sample districts were ranked in order (from best to worst) as Furong District>Luxi County>Ziyang District>Shaodong County>Shuangfeng County, with Furong District greatly surpassing the other areas with the highest Ci (table 3).
Multiassessments should be comprehensively employed in health evaluations due to features such as objects, purposes and data types to compensate for the limitations of a single assessment. With features including anonymity, iteration, controlled feedback and statistical summarisation, the Delphi technique was chosen as a suitable method for obtaining collective expert opinions because this method was widely used in health-related research.15 24 25 TOPSIS, which was developed by Hwang and Yoon,26 was chosen as a family member of multiple-criteria decision-making.27–29 This method provides an optimal solution or alternative ranking30 without operational issues or limitations on data types31–33 but often fails to avoid the impact of abnormal values.34 The RSR method is based on a non-parameter analysis and has no data type restrictions. Moreover, RSR can eliminate the bias of abnormal values by reflecting the priority of the evaluated objects.35
The above methods were used in this study to construct assessment indicators and to evaluate the health education and promotion situations in the NCD demonstration districts. The results showed that the Furong District obviously surpassed the other districts, especially in fund support, media promotion, technical support for promotion materials, community promotion and supportive environment supplies and matched the national level nomination. As a central district in the capital city of Hunan Province, the main economic indicators of Furong were among the best of the counties/districts in the province.36 37 Local government supported much of the NCD control and prevention-related funds. Both the fees for NCD health education and promotion and proportion of NCD control expenditures in total business expenses in the local CDC were also advantages and provided a strong basis for conducting relevant work. Additionally, this district has been historically solid in health education and promotion, with the ‘Ten health projects’, such as total health mobilisation and a massive health auditorium. Furong was also leading in building a rich-themed NCD health education database among grass-level medical institutions and information sharing models, which greatly benefited the residents, whose awareness rates, satisfaction and health literacy levels for NCDs were all superior compared with the levels of the residents of the other districts.
Following Furong District, Luxi County ranked second with its own features. This county is regarded as one of the Wuling Mountain Areas Regional Development Key counties and is a national poverty-stricken county,38 with insufficient funds for NCD control and prevention supported by the local government. The other two fund guarantees were also dwarfed by the other districts. However, Luxi County was comprehensive in conducting methods and extensive in its NCD control and prevention themes despite having a simple external form, which highlighted its diverse and frequent media promotion strategies (particularly with television stations, with an annual 44 period showing for an average of 30 min per time). NCD education and promotion permeated into every village or community, featuring 100% coverage of fitness centres or rooms and numerous types of NCD promotion materials, gaining an advantage over other objects (except for Furong District).
The middle-ranking Ziyang District had the most assessment indicators at the middle level. In the last two ranked objects, the comprehensive performances of both Shaodong and Shuangfeng counties were lacking, which might have been a result of their late beginning and hasty NCD demonstration district processes during the study period as well as a historically unsolid work basis.
We built qualitative and quantitative assessment indicators of health education and promotion in NCD demonstration districts using a hybrid of multiassessment methods to provide a valid reference for future similar studies. There were gaps in health education and promotion work in the NCD demonstration districts in Hunan province. The districts that performed better had obvious advantages in fund support, media promotion, technical support, community promotion and supportive environment supplies. The variances were associated with local fund support and with the working basis within the district. Fund support did not always influence the variances because the limitation of inadequate fund support could be broken and even shifted into an advantage with a solid working quality.
We are grateful to all experts who participated in the Delphi process. We also thank the Furong District CDC, Ziyang District CDC, Shaodong County CDC, Shuangfeng County CDC and Luxi County CDC for their great work in assisting with the data collection and survey conduction.
Contributors QX contributed to the study design, conducted the study, analysed the data and wrote the manuscript. YH was the principal guarantor of the study and contributed to the study design. BC managed the study day-to-day and commented on manuscript writing. All authors have discussed the paper and approved the final version.
Funding This work was supported by China Hunan Provincial Science & Technology Department (No. 2013zk2054).
Competing interests None declared.
Patient consent Obtained.
Ethics approval This study was approved by the Ethics Committee of Hunan Provincial Centre for Disease Control and Prevention, China (HNCDC/JL31-044: 2013011).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement No additional data available.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.