Objective To evaluate the effect of the Danish Sun Safety Campaign 2007–2015 on the prevalence of sunbed use and to model future effects on the skin cancer incidences 2007–2040.
Design The study has a repeated, cross-sectional design.
Setting Exposure to ultraviolet radiation is the main risk factor for skin cancer. Denmark has the highest prevalence of sunbed use reported and one of the highest incidences of skin cancer worldwide.
Participants During 2007–2015, survey data were collected for 37 766 Danes, representative of the Danish population with regards to age, gender and region.
Interventions In 2007, an ongoing long-term antisunbed campaign was launched in Denmark.
Primary and secondary outcome measures Sunbed use was evaluated by annual cross-sectional surveys. Skin cancer incidence was modelled in the Prevent programme, using population projections, historic cancer incidence, sunbed use exposure and relative risk of sunbed use on melanoma.
Results The prevalence of recent sunbed use in Denmark was reduced from 32% and 18% to 13% and 8% for women and men, respectively. The campaigns results during 2007–2015 are estimated to reduce the number of skin cancer cases from more than 5000 (746malignant melanoma, 1562 SCC, 2673 BCC) totally during 2007–2040. Keeping the 2015 level of sunbed use constant by continued campaign pressure or introduction of structural interventions would potentially prevent more than 750 skin cancer cases annually in 2040 and 16 000 skin cancer cases in total during 2007–2040.
Conclusion We have shown the value of prevention and of long-term planning in prevention campaigning. Sunbed use was reduced significantly during 2007–2015 and further reductions are possible by structural interventions. Consequently, significantly fewer skin cancer cases are anticipated during 2007–2040. The Danish Parliament has population support to enforce structural interventions to avoid a large burden of this disease.
- skin cancer
- ultraviolet radiation
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
Long-term funding and planning secured the continuity in this study, comparability of data over time and the achievements of results.
High awareness created by the campaign could cause, for example, political correctness bias or selection bias.
Projection models can be influenced by changes in improved diagnostics, equipment, change in strength of the ultraviolet spectrum or output in sunbeds or other changes in population ultraviolet exposure.
Exposure to ultraviolet radiation (UVR) is the main modifiable risk factor for keratinocyte skin cancers, squamous cell carcinoma (SCC) and basal cell carcinoma (BCC) and malignant melanoma (MM) skin cancer.1 2 Intermittent exposure to UVR from the sun and sunbeds, and sunburn history, are important factors in the aetiology of skin cancer.3 4 In Denmark, the MM incidence (world standardised rate per 100 000) for men and women increased from 1.4 and 1.9 in 1949–1953 to 21.4 and 26.7 in 2010–2014, respectively.5 The development is or was similar in most Caucasian populations, including in Northern European countries.6 Similarly, keratinocyte skin cancer incidence increased manifold in the same period. Presumably because of improved primary and secondary prevention, improved diagnostics7 8 and change in sun exposure patterns including increased number of Danes travelling abroad since the 1960s and the introduction and spread of sunbed facilities in the 1980s. Half of the Danish population travels to sunny destinations each year;9 10 approximately 60% have ever used a sunbed11 and 40% were sunburnt annually.9 12
In 2009, the International Agency for Research on Cancer classified ultraviolet-emitting tanning devices as ‘carcinogenic to humans’ with respect to MM.4 13–17 The increased risk of MM was especially high among sunbed users younger than 30–35 years, and more than 75% of cases diagnosed in this young age were caused by sunbed use. Additionally, sunbed use has been shown to increase the risk of MM without the presence of sunburn.15 17 Boniol et al summarised the risk of MM from sunbed use in a systematic review to be 1.2 for ever-use of sunbed and 1.59 for sunbed use initiated before the age of 35 years. Furthermore, a dose-response relationship was established between frequency of sunbed use and MM with an increased risk of 2% for each extra annual session.18 The increased risk of developing basal cell carcinoma and squamous cell carcinoma from sunbed use was summarised by Wehner et al 19 to 1.29 and 1.67, respectively. Sunbed use is highly prevalent in Denmark, especially in younger age groups and more than half of those recalling their age of initiation of sunbed use reported to have started before age 18 years.20 21 Sunbed use was estimated to be responsible for 13% and 8% of MM cases in Denmark in women and men, respectively.18
In May 2007, an antisunbed campaign was launched, with young people aged 15–25 years as the primary target. The campaign was based mainly on social media and also on magazines and radio, the traditional youth-targeted media. The campaign was very successful, with viral dissemination of video clips, music videos and other materials that made links between sunbed use, negative cosmetic effects and skin damage, and educational programmes including a pocket movie competition in seventh graders making them ambassadors for antisunbed campaigning.
The public activities included lobbying at national and local government levels and a public campaign programme. The lobbying focused on legal prohibition of sunbed use for children under 18 years of age and the removal of sunbeds from, for example, local sports facilities and pools under local government administration. In the summer of 2009, politicians spoke out in favour of legal restriction of sunbed use by children under 18 years of age. During spring and summer of 2009, some local governments started removing sunbeds from public facilities, and in 2017 the majority of local governments have removed sunbeds from their buildings. Only 6 out of 98 local governments still have sunbeds in their buildings and in 2 of those, age restrictions (<18 years) have been implemented. However, the majority of sunbed operators in Denmark is commercial and not influenced by these restrictions. The campaign generated press coverage and political debate which raised public awareness of the health risks associated with sunbed use, and included more than 2700 press clips on sunbed topics during the period of the study.
We studied the development of sunbed use in Denmark after the start of a 10-year national sun protection campaign in March 2007. The aims of this study are: (1) To show the possible effects of the Danish Sun Safety Campaign on prevalence of sunbed use. (2) To estimate potential reductions in future skin cancer incidence by the campaign.
Materials and methods
We estimated the effect of the Danish Sun Safety Campaign during 2007–2015 in terms of annual reduction in the fraction of ever users of sunbed. We modelled projections of future cancer incidence, introducing the effects of the campaign and compared with the status quo using realistic estimates of relative risks in the intervention scenarios to obtain an indication of the long-term impact of the campaign interventions on cancer incidence.
Questionnaire and confounding
During 2007–2015, a question on frequency of sunbed use was included in the annual population-based questionnaire on exposure to UVR and behaviour and attitude towards UVR exposure. In total, 37 766 Danes answered the 75-item questionnaire. Data were collected by computer assisted web interview by Epinion (2007 and 2014–2015) and Userneeds (2008–2013). Data were collected as representative for the Danish population by gender, age, region and education. The education variable included 7–10 options during the period and it was condensed into the three categories as shown in table 1. For the initial measurements in 2007, there was no higher age limit and persons 65 years and older were categorised as missing to be able to compare with following measurements. Since 2009, a limited number of internet panels were available, which were able to provide the respondent structure requested. To avoid measuring only effect in the panel and not in the population, it was a requirement that maximum 25% of the participants were allowed to participate in the survey the following year, because answering a questionnaire could influence the behaviour. Detailed data sampling strategies are available in annual survey reports on skrunedforsolen.dk.22 Exposure to artificial UVR was determined by the question: ‘How often did you use a sunbed within the past 12 months?’: ‘More than once a week, Once a week, More than once a month, Once a month, Fewer than four times a year, Not within the past twelve months, Never’; The questionnaire also elicited information on behaviour with respect to exposure to natural UVR; these results will be reported separately. The question about sunbathing was included in the analysis to distinguish between intentional and non-intentional tanning.1 As data collection methods and demographic participant compositions in web panels have evolved during the data collection period this is reflected in data. Age was included in all analysis as 5-year or 10-year age groups. Teenagers were kept as ‘15–19 years’ as their behaviour was shown to differ from that of the adult population.23 24 Skin types were determined from self-assessed tan and sunburn reactions, according to Fitzpatrick skin type I (never tan, always burn) to skin type IV–VI (always tan, never burn).25
The accumulated sun hours and average temperatures of June and July were included in the regression analysis as Danes could be more prone to use sunbed when the weather conditions makes outdoor sunbathing impossible and significant variation in weather measures occurred during the period analysed.
The Danish Sun Safety Campaign has continuously used information from for example interviews and focus groups with patients, at-risk groups and lay people in an iterative set-up to improve campaign elements as well as annual evaluations of the campaign. Recruitment is described above and dissemination of results will be by scientific publication, national press as well as patient organisation newsletters from the Danish Cancer Society.
Answers to sunbed use were grouped into ‘recent users’ and ‘non-recent users’ and ‘ever users’ and ‘never users’, respectively. Recent use was defined as use within the past 12 months. Similarly, ever use of sunbed was defined as belonging to all categories except the ‘never’ category. Recent use was modelled to describe immediate changes in sunbed use according to aim 1 and ever use was modelled for use in the cancer projections for aim 2. The homogeneity of, respectively, recent and ever sunbed use over time of survey and demographic variables was examined. The outcome ‘sunbed use, yes ⁄ no’ was analysed using logistic regression. The factors included in the model as categorical variables were gender, age, education, skin type, having children below age 18 years in the household and region. Factors with a statistically significant different distribution were included as possible explanations. Adjusted ORs and 95% CIs were calculated. The P values from the logistic regression analysis refer to either tests for variation between the factor levels by time (year) or trend as stated for the relevant analysis. For all tests, P values <0.05 were considered statistically significant. The logistic procedure in SAS V.9.3 (SAS Institute, Cary, North Carolina, USA) was used for the analyses.
The Prevent model
Projection of future incidence was estimated using Prevent.26 27 This programme was adapted for the Eurocadet project to model future cancer incidence by implementation of lifestyle preventive strategies. Prevent calculated the percentages of potentially prevented cases under the scenario of interest as compared with the status quo scenario. If the scenario of interest is no exposure or exposure with minimum impact on risk, this percentage is interpretable as the population attributable fraction of sunbed use experience, respectively, on skin cancer (MM, SCC, BCC) incidence by the year 2040: they represent the numbers of cases that would be prevented had the population not used sunbed and therefore the fraction of MM, SCC and BCC cases attributable to these risk factors. Three types of data are needed to run the model: (1) Demographic data (current and projected population sizes by age and sex). (2) Risk factor-related data (prevalence, changes in prevalence as a result of interventions and risk estimates). (3) Disease incidence data (cancer rates and estimated annual percentage change (EAPC) to account for trends in disease incidence that are not associated with modelled risk factor data). The projected numbers of new cancer cases were computed based on the demographic data and under different scenarios of changes in the prevalence of risk factors. Results are projected rates and numbers with and without modelled interventions by risk factor prevalence. The model is summarised in figure 1.
Exposure: sunbed use
The prevalence of sunbed use was derived from sun behaviour questionnaires of the Danish Sun Safety Campaign as described above. The campaign was the only initiative in Denmark collecting data on UVR exposure continuously since 2007.9 11 12 28-30 In the Prevent model, sunbed use was included as ever/never use. The change in prevalence of sunburn applied in the population projections was from logistic regression analysis.
National incidence rates for melanoma and keratinocyte skin cancer (ICD-10 code: C43 and C44) by sex and 5-year age groups were retrieved from NORDCAN.5 The EAPC for men and women for the past 25 years, respectively, was 6.4% and 10.9% increase for SCC, 5.4% and 7.4% for BCC, and 4.4% and 4.5% for melanoma.5 We chose to use a uniform conservative 4% increase in all skin cancer rates for men and women for the modelling. EAPC was applied for the first 15 years after which it remained constant at this level. For sensitivity analysis, we applied an EAPC, respectively, of 0 years and 30 years. The registration of keratinocyte skin cancer C44 is probably more complete in Denmark than in most other countries. Since 2004 the cancer registration has been made by a linkage between the national hospital register, the pathology register, and the cause of death register. For both melanoma skin cancer (C43) and keratinocyte skin cancer (C44), divided into BCC and other keratinocyte skin cancers, mainly SCC, registrations are also included based on a registration in the pathology register alone from 2004 and on.
From Statistics Denmark we obtained the size of the population on 1 January of the corresponding period of the latest available incidence data by 1-year age category and sex as well as forecasted population sizes for each year up to 2040 by 5-year age categories and sex, using the medium national growth estimates.
Effect of sunbed use on the incidence of melanoma skin cancer
Relative risks for sunbed use on the risk of MM and keratinocyte cancers were derived from the largest meta-analysis on the subject, established by, respectively, Boniol et al and Wehner et al. MM: RR=1.2 for >35-year-old and RR=1.59 for <35-year-old and RR for SCC and BCC of 1.67 and 1.29, respectively.18 31 These finding s were used as the relative risks and risk functions in our modelling (figure 1). The relative risks and risk functions were assumed equal for all age groups within age bands included in the study, and across time. The effect of a risk factor exposure on cancer incidence has a latency time. Prevent accommodates this through two time lags: (1) The time that the risk remains unchanged after a decline in risk factor exposure (LAT) and (2) The period during which the changes in risk factor exposure gradually affect the risk of cancer, eventually reaching risk levels of the non-exposed (LAG).26 Thus, assuming that sunbed users who quit sunbed use following the campaign after a total of (LAT+LAG) years are no longer at increased risk of skin cancer. For this study, we used for sunbed use a LAT of 2 years and a LAG of 5 years for MM and, respectively, 2 years and 8 years for keratinocyte cancers. LAG was modelled as a linearly declining risk. LAT and LAG periods for sunbed use on risk of skin cancers has not been estimated precisely. Pil et al used an induction period of 20 years, however we chose shorter time periods for MM from the knowledge of intermittent exposure pathway1 and the experiences from Iceland32 and sunbed use in young people.14 In Iceland, both, a drastic increase and following decrease in melanoma incidence was observed within a 10-year period preceded by complimentary delayed increase and decrease, respectively, in the number of available sunbed salons. The MM incidence change was primarily driven by people below 50 years and trunk site melanomas, which are characteristic for intermittent/sunbed exposure.
We have modelled the development in future skin cancer Incidence in Denmark in three scenarios. We have used the reductions in sunbed use during 2007–2015 to model MM Incidence in 2007–2040.
Scenario 1: We assume the campaign is discontinued after 2015 and that the rate of sunbed use remains constant afterwards (irreversible campaign effect).
Scenario 2: Similar to scenario 1, except, we have modelled a conservative ‘spring effect’ where the prevalence of sunbed use returns to the precampaign level in the inverse rate as it was reduced for 2015–2023 (reversible campaign effect).
Scenario 3: The expected trend if prevalence of sunbed use is unchanged (trend/no campaign effect).
We have also applied sensitivity analyses to the conservative scenario 2. We have used the applied EAPC for 0, respectively, for 30 years instead of 15 years. We have applied a combined LAT+LAG time of either 0 or twice the time, of the main scenario.
Table 1 shows the distribution of demographic characteristics from annual data collections during 2007–2015. Answers were collected from more than 4000 persons/survey, except for 2012 and 2014 where 2000 persons/survey was settled for due to challenges with data collection of certain groups, especially young (15–19 years) men. For all included variables, we found significant variation over the years. Only 2007 data collections differed for gender, after which sampling methods were optimised. In 2007 there was no higher limit for age, however, in this analysis persons older than 65 years were excluded, which lead to differences in the distribution of age compared with 2008–2015. There were more people characterised with paler skin types in 2013–2015. Region and education was not used in the sampling for all years, which means that, for example, August 2007 data are over-represented by persons from the region capital. Education was differently distributed in panels and in panel characterisations of education between years. Persons who reported sunbathing, declined during the campaign period. Persons having children 18 years or younger staying at home also varied. Weather varied randomly for the variables mean temperature, mean monthly number of sun hours and mean monthly days with rain.
Online supplemental tables S1a,b show the detailed distribution of sunbed use, recent use and ever use, respectively. In all the annual surveys, there are differences for all included variables except having children. In general, more women used sunbed, and sunbed use decreased with age. More persons with dark skin types used sunbed and sunbed use was more prevalent in Northern Jutland and less prevalent in the regional capital. Fewer persons with more than 12 years of education used sunbed, while more persons who sunbathed also use sunbeds.
Supplementary file 1
Figure 2A,B shows the adjusted OR and 95% CI of the development in sunbed use (recent and ever use, respectively) adjusted for gender, age, education, region and skin type, with the March 2007 measurement as the reference point. The decrease in sunbed use was largest at the beginning of the campaign period and until about 2011/2012, where the decrease levelled. In 2015, the OR for sunbed use was approximately 0.3 compared with the precampaign measurement in March 2007.
Table 2 (ever use) and online supplemental table S2 (recent use) show the logistic regression analysis of the sunbed use in Denmark by demographic factors in the left part of the table and in the right part is shown the annual percentage change in sunbed use per year. Age and skin type are the variables most influential on sunbed use. We have shown the crude OR (95% CI) and a model adjusted for gender, age, skin type, region, education and having children below 18 years in the household. Due to the large differences in education in our analysis of the development of sunbed use, we also tried to exclude education, but that did not change the estimates significantly. In addition, we examined the influence by weather parameters in a model additionally adjusted for temperature, number of sun hours and days with rain. We found that increasing temperature, number of sun hours and number of days with rain was associated with increased sunbed use. In the right side of table 2 and supplemental table S2 is shown the crude reduction by annual measurement. Women reduced their recent sunbed use more than men and young persons more than older persons, especially the 15–29-year-olds. There were no significant differences in reduction by skin type, region, education, sunbathing or among people with or without children. Overall, the adjusted analysis for ever use of sunbed showed an annual reduction of more than 3% per year in the campaign period. For recent sunbed use the annual reduction was 4% per year.
The prevalence of sunbed use influence on future skin cancer incidence
In figure 3A–C, we have modelled the development of the number of future MM, SCC and BCC incident cases according to scenarios 1–3 in Denmark. The effect of the campaign results in a reduction of 103 MM, 271 SCC and 387 BCC skin cancer cases per year in 2040 and in total 2443 MM, 5383 SCC and 8437 BCC cases during 2007–2040, while if the effect of the campaign is reversed to the precampaign level there will be no change in the annual number of skin cancer cases in 2040 but a total reduction of 746 MM, 1562 SCC and 2673 BCC cases during 2007–2040. The results of the skin cancer reduction projections including relative reductions are summarised in table 3. The table also includes the projections for the sensitivity analysis for scenario 2 where EAPC and LAT+LAG were examined. There was a minimum and a maximum of 423 and 869 fewer MM cases, respectively, during 2007–2040. Minimum and maximum of all skin cancer types were 6208 and 11 972 fewer cases totally during 2007–2040. The relative decrease is larger for irreversible campaign effects compared with reversible. The sensitivity analysis variations of scenario 2 were robust to changes in cancer incidence and time to effect.
We have shown that the Danish Sun Safety Campaign reduced the recent sunbed use during 2007–2015, from 32% and 18% to 13% and 8% for women and men, respectively. The OR for recent sunbed use in 2015 compared with the precampaign level was 0.3. We have modelled these results with respect to future skin cancer incidences and expect more than 750 fewer cancer cases annually in 2040 and more than 16 000 fewer cases totally until 2040, as the campaign is still ongoing. Had the campaign been terminated after 2015, it may not have influenced the annual number of skin cancers in 2040, however during 2007–2040 more than 5000 skin cancer (MM, SCC and BCC) cases would still have been avoided.
Strengths and limitations
The unique strength of this study is the possibility of long-term planning, securing continuity in the campaign including comparable wordings in the questionnaires and personnel to secure comparable evaluations over the entire period. The high continuous campaign pressure has been made possible by the long-term funding.
There is a risk that the high awareness created by the campaign could have caused political correctness bias meaning that, for example, persons would have falsely stated no to sunbed use in questionnaires. Similarly selection bias may have occurred, for example, if sunbed users were less prone to participate in surveys of this subject.
A prognosis of the cancer incidence in absolute numbers is difficult to provide as there are unknown indicators, which we were not able to include in the model, like improved diagnostics, equipment, change in strength of the ultraviolet spectrum or output in sunbeds,7 33 or other changes in ultraviolet exposure. As we have used the difference between two cancer incidence rates, this has had minor influence on the results. The Prevent model primarily gives useful measures of the influence of change in use of sunbeds. The model accuracy is as good as the quality of the data input and dependent on the assumptions applied for the scenarios. Exact LAT and LAG times are not determined; however, varying LAT+LAG times were included in the sensitivity analysis and their relative estimates were within a reasonable range. Model-based results should be interpreted with caution and with mention of limitations.
The number of skin cancer cases in the years passed is different from the actual incidence development because it is influenced by factors not included. Around 2002–2004 the dermatoscope was introduced among dermatologists in Denmark, which probably increased the rate of detection7 for a while. In the following period a plateau is seen from around 2011.5 The decreasing incidence rate is likely to be a consequence of the earlier detection/treatment, an effect also seen in various screening programmes. While the increasing skin cancer incidences increased media awareness of the disease in the 1990s, in 2007, the multicomponent Intervention of the Danish Sun Safety Campaign raised this awareness manifold. The increased awareness may have led to an increase in mole check by the general physician, which could have increased the number of diagnoses; however we were not able to measure this.
Reduction in sunbed use
Denmark had one of the highest reported frequencies of sunbed use in the world before the Danish Sun Safety Campaign was launched. The largest reductions in sunbed use occurred among the youngest age groups and among women, which had the highest prevalence of sunbed use and were the main targets of the campaign. Even though large reductions in sunbed use occurred, the prevalence of sunbed use in Denmark is now just comparable to that of other European countries, for example 14% within the past year in Germany in 2012.34 Concerning campaign efficiency, there have been antisunbed campaigns in, for example, UK, Canada, USA and Australia, which have also shown reductions, however our baseline use is not similar and comparable. The past years' reduction in sunbed use has levelled off perhaps as a consequence of a changed focus of the Danish Sun Safety Campaign towards sunny holidays or perhaps the remaining sunbed users are less perceptible of risk communication.
Consequences and recommendations
Pil et al 35 have previously modelled the effect of various scenarios thought to prevent skin cancer. Our results are based on an actual intervention with measurable results of the exposure; therefore, our modelling results of the future cancer incidence are a realistic prognosis of the incidence change. Likewise, we have shown the importance of a continued campaign pressure to achieve these goals (difference between models 1 and 2).
WHO suggests countries ban sunbeds or alternatively restrict (staff supervision, age limit, high-risk individuals), manage (license, radiation output and time limits, staff training, tax) and inform (health risks, display warning, ban marketing) to protect their populations.36 In 2017, the majority of countries in Western Europe and the majority of US states have introduced age limits for sunbed use to protect children, and states with age limits succeeded in reducing the prevalence of sunbed use.37 Furthermore, Australia and Brazil have completely banned sunbed use to protect their populations against the detrimental effects of sunbed use on human health and to reduce government spending related to skin cancer diagnostics and treatment.38 Belgium is, to our knowledge, the first European country to recommend a ban against sunbed use,39 while Denmark is now one of few remaining Western European countries without an age limit to protect children.40
Emphasising the health potential of the achieved results, we hope to motivate government administration to implement structural interventions to reduce sunbed use in Denmark as well as in countries with similar problems as in Denmark. We specifically address the need for a revision of the Danish sunbed legislation adopted in 2014.
The Danish Sun Safety Campaign has significantly reduced sunbed use in Denmark since 2007. Several legislative restrictive measures exist which would be beneficial to introduce reduction of sunbed use further at the current stage and to avoid sunbed use increase again if campaigning is not available. Because of the campaign, we expect fewer skin cancer cases in Denmark in the future. Danish politicians have the opportunity, supported by the population, to reduce skin cancer incidences further and thereby to reduce the future costs of skin cancer.
The Danish Sun Safety Campaign acknowledges all the contributions, including from volunteers and members of the Danish Cancer Society as well as survey participants from Userneeds and Epinion, to optimize the campaign and campaign evaluation.
Contributors BK, MKHM, TM-LA, GE and PD have contributed to conceptualisation and design of the study, analysis and interpretation of data, critical revision of the manuscript and final approval of the manuscript. BK drafted the manuscript.
Funding This study was supported by TrygFonden.
Disclaimer The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests None declared.
Patient consent Not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement The full data set is available from the corresponding author.
Author note BK affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.