Article Text

PDF

Effects of culture-sensitive adaptation of patient information material on usefulness in migrants: a multicentre, blinded randomised controlled trial
  1. Lars P Hölzel1,
  2. Zivile Ries1,
  3. Levente Kriston2,
  4. Jörg Dirmaier2,
  5. Jördis M Zill2,
  6. Christine Rummel-Kluge3,4,
  7. Wilhelm Niebling5,
  8. Isaac Bermejo6,
  9. Martin Härter2
  1. 1Department of Psychiatry and Psychotherapy, Medical Center—University of Freiburg, Freiburg, Germany
  2. 2Department of Medical Psychology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
  3. 3Department of Psychiatry and Psychotherapy, University of Leipzig, Leipzig, Germany
  4. 4German Depression Foundation, Depression Research Center, Leipzig, Germany
  5. 5Department of General Practice, Medical Center—University of Freiburg, Freiburg, Germany
  6. 6Staff Unit Board of Directors, Medical Center—University of Freiburg, Freiburg, Germany
  1. Correspondence to Dr Lars P Hölzel; lars.hoelzel{at}uniklinik-freiburg.de

Abstract

Objectives To evaluate the usefulness of culture-sensitive patient information material compared with standard translated material.

Design Multicentre, double-blind randomised controlled trial.

Setting 37 primary care practices.

Participants 435 adult primary care patients with a migration background with unipolar depressive disorder or non-specific chronic low back pain were randomised. Patients who were unable to read in the language of their respective migration background were excluded. Sufficient data were obtained from 203 women and 106 men. The largest group was of Russian origin (202 patients), followed by those of Turkish (52), Polish (30) and Italian (25) origin.

Interventions Intervention group: provision of culture-sensitive adapted material. Control group: provision of standard translated material.

Main outcome measures Primary outcome: patient-rated usefulness (USE) assessed immediately after patients received the material. Secondary outcomes: patient-rated usefulness after 8 weeks and 6 months, symptoms of depression (PHQ-9), back pain (Back Pain Core Set) and quality of life (WHO-5) assessed at all time points.

Results Usefulness was found to be significantly higher (t=1.708, one-sided p=0.04) in the intervention group (USE-score=65.08, SE=1.43), compared with the control group (61.43, SE=1.63), immediately after patients received the material, in the intention-to-treat analysis, with a mean difference of 3.65 (one-sided 95% lower confidence limit=0.13). No significant differences were found for usefulness at follow-up (p=0.16, p=0.71). No significant effect was found for symptom severity in depression (p=0.95, p=0.66, p=0.58), back pain (p=0.40, p=0.45, p=0.32) or quality of life (p=0.76, p=0.86, p=0.21), either immediately after receiving the material, or at follow-up (8 weeks; 6 months). Patients with a lower level of dominant society immersion benefited substantially and significantly more from the intervention than patients with a high level of immersion (p=0.005).

Conclusion Cultural adaptation of patient information material provides benefits over high quality translations. Clinicians are encouraged to use culture-sensitive material in their consultations, particularly with low-acculturated patients.

Statistics from Altmetric.com

Strengths and limitations of this study

  • High internal and external validity of the study design.

  • Blinding of patients and general practitioners (GPs) with regard to study group allocation.

  • Blinding of statistician to ensure objectivity.

  • Questionnaire-based outcomes.

  • High clinical heterogeneity of the sample may have diluted intervention effects.

Background

Migration is an increasingly important global issue. A substantial and growing proportion (∼20% at present) of the German population has a migration background.1 Provision of a high quality of care regardless of cultural background is challenging both for physicians and policymakers.2 Currently, migrants often receive poorer care than the indigenous population.3–6 In Germany, migrants are frequently poorly informed and underuse preventive healthcare services.7

Therefore, evidence-based measures to improve care for migrants are urgently needed. However, high-quality studies on healthcare interventions for migrants are lacking.2

Patient engagement and empowerment are central issues in current debates on improving healthcare,8 especially for chronic illnesses and mental disorders.9 A fundamental strategy to promote patient engagement and empowerment is the improvement of health literacy.8 Written patient information materials (PIMs) are a useful adjunct to professional consultation and expert advice, in order to inform and educate patients and thus increase their engagement and empowerment.8 ,10

Language-appropriate PIMs for migrants are often ‘one of the first and most critical’ interventions to improve healthcare, as they can help to overcome language barriers.11 However, a simple translation may not sufficiently provide for cultural differences.12 An additional cultural adaptation may therefore be needed.

There is a growing body of evidence for the positive effects of culturally adapted interventions. Meta-analyses for culturally adapted psychotherapy and health-related training exist.13–15 A randomised controlled trial comparing standard and culture-sensitive PIMs for African-American adults found promising results in favour of culture-sensitive PIMs.16 However, there is a lack of randomised controlled trials with patients and physicians blinded for group allocation and comparing culture-sensitive PIM with high-quality translations. The aim of the present study was to address this in a multicentre randomised controlled trial.

Methods

Design

The effects of culture-sensitive PIMs, compared with standard translated PIMs, were investigated in a patient-blinded, physician-blinded and statistician-blinded randomised controlled multicentre trial. Participants were recruited from primary care, as general practitioners (GPs) usually serve as the first point of contact in healthcare. Patients in this setting often need initial information on their health problem and treatment options, which can be provided in PIMs. Academic training practices, practices in cooperating networks and publicly registered GPs in the areas of Freiburg, Hamburg, Oberhausen-Mülheim-Duisburg and Leipzig were invited to participate in the study.

Further information can be found in the published study protocol17 and the study registration at the German Register for Clinical Trials (DRKS00004241).

Inclusion and exclusion criteria

Adult primary care patients with a Turkish, Polish, Russian or Italian migration background, and with indications of unipolar depressive disorder (International Classification of Diseases (ICD-10): codes F32.xx, F33.xx, F34.1) or non-specific chronic low back pain (ICD-10 codes: M54.5, M54.8, M54.9), based on clinical diagnosis, were eligible for inclusion in our randomised trial. Migration background was defined according to the definition of the Federal Statistical Office of Germany as being of non-German nationality, having a first language other than German, being born in another country or having a parent who was born in a country other than Germany.1 ,18 To be eligible, patients had to identify themselves with their non-German origin. To ensure a high external validity of the study, exclusion criteria were kept to a minimum. Since our intervention was based on written PIMs, and required that patients complete written questionnaires, those who felt unable to read PIMs in the language of their respective migration background were excluded.

Intervention and comparator

The PIMs for both illnesses were based on German clinical practice guidelines.19 ,20 Information on prevalence, diagnoses and prognosis, treatment options and responsibilities of different healthcare providers was given. To exclude the influence of potentially confounding factors other than culture, we focused on developing high-quality materials that were suitable for migrants based on aspects other than culture (eg, comprehensibility, length and reading level). The final brochure consisted of 12 pages, and included figures, pictures and illustrative case examples. For the control group (CG), a high-quality translation of the German version of the PIMs was administered, using the forward–backward translation procedure.21 Patients in the intervention group (IG) received the culture-sensitive PIMs, which were based on the translated version and included adaptations for the respective migration background. The adaptations were based on the results of four separate focus groups, one for each migration background.17 In these focus groups, the cultural appropriateness of the translated materials was discussed. Focus group participants had to have one of the four relevant migration backgrounds and live in Germany. They also had to be able to read and write in German and in the language of the country of their origin. The group discussions were audio recorded, transcribed, analysed using qualitative methods and adapted based on the qualitative results. Cultural adaptations primarily focused on presentation; the core information remained unchanged and patients in both groups received evidence-based information in their native language (see tables 1 and 2). Detailed descriptions of the adaptation process and the focus group results are published in the study protocol17 or are being prepared for publication. The PIMs can be found at http://rg-hoelzel.uniklinik-freiburg.de/material.

Table 1

Culture-sensitive adaptations of patient information materials for depression

Table 2

Culture-sensitive adaptations of patient information materials for chronic low back pain

Administration

GPs of academic training practices, practices of the cooperating networks and GPs listed in public registers were invited to participate in the study. GPs consecutively assessed patients for eligibility and applied inclusion and exclusion criteria (for details, see ref. 17). Eligible patients were invited to participate by the GP and received information on the study after the consultation (−T1, enrolment). Written informed consent was obtained by the GP. To ensure comprehensibility of the information, translated consent forms were used. GPs then handed out a sealed envelope (T0, allocation) containing the PIM and a questionnaire. By using sealed envelopes, it was ensured that both GPs and patients were blind to the group allocation. The content of the envelopes (standard translated vs culturally adapted PIMs) was centrally randomised by a computer-based algorithm with a 1:1 allocation ratio, and stratified by physician, illness and migration background with varying block sizes. The random allocation sequence was generated by the trial statistician and prepared by the research team (whose members were not directly involved in patient recruitment). Concomitant care was not restricted in any way. After the consultation, patients were asked to read the PIMs and fill in the questionnaire containing all T1-measures (T1, after consultation) and return it by post (detailed information can be found in the published study protocol).17 At 8 weeks (T2) and 6 months (T3) after the consultation, patients were contacted by post and asked to fill in follow-up questionnaires. Patients were reminded by the leading study centre, by telephone after 2 weeks and by post after 3 weeks, if they had still not sent back the questionnaire. To ensure a sufficient response rate at each time point, patients received an unconditional reimbursement of €5 for filling in each questionnaire.22 GPs received an allowance of €40, and the receptionist €5, per patient recruited.

Measures

Age (years), sex, duration of residence in Germany (years), education (number of years) and level of acculturation (Stephenson Multigroup Acculturation Scale, SMAS)23 were assessed at T1. The SMAS has two scales: ‘ethnic society immersion’ (describing the level of identification with the native culture) and ‘dominant society immersion’ (describing the level of acculturation in the dominant society of habitation).23

According to current theories for the evaluation of the effectiveness of PIMs, and consistent with the concept of patient empowerment, the patient's judgement of usefulness is the final outcome in the process of reading, understanding and responding to PIMs.24 An instrument to assess this judgement is the Usefulness Scale for Patient Information Material (USE).25 Therefore, we chose this scale to assess the primary outcome, usefulness, after patients had consulted and read the material (T1). Usefulness is measured on a global scale over three subscales which assess cognitive, emotional and behavioural subdimensions. The global score ranges from 0 to 90, and each subscale score ranges from 0 to 30. High scores indicate high usefulness of the PIMs. The instrument showed excellent psychometric properties.25 Our primary hypothesis was that culturally adapted PIMs are perceived to be more useful than the standard translated materials.

Secondary outcomes were usefulness of PIMs (measured on the USE) assessed after 8 weeks (T2) and 6 months (T3); subdimensions of usefulness (also measured on the USE); symptoms of depression or back pain assessed by the Patient Health Questionnaire (PHQ-9) and Back Pain Core Set, respectively;26 ,27 and quality of life, assessed by the five-item WHO Well-Being Index (WHO-5)28 at all time points (T1, T2, T3).

Statistical analyses

We compared standard PIMs (the control group) with customised PIMs (as one group) in the main analyses. The common characteristics of the study participants were the migration background and suffering from a chronic disease. Although there was diversity in these variables (four different cultural backgrounds and two different illnesses), we assumed that the main effective component of the intervention (adaptation of information) functioned in a comparable way across all groups. Thus, we considered the groups to be functionally equivalent for the purpose of this study. However, since dealing with clinical heterogeneity is a frequently controversial issue,29 we performed a series of sensitivity analyses to test whether migration background, illness or both moderate the intervention effect.

The primary outcome was analysed by a statistician (blinded to group allocation) using a t-test to test the directed hypothesis that the culturally adapted PIM is superior to the standard PIM, as specified in the study protocol.17 According to the intention-to-treat principle, all randomised participants were included in this analysis. The required sample size for the primary outcome analysis was determined to be 280 patients (140 per group, with an expected Cohen's d of 0.3, a one-sided type I error of 0.05 and a power of 80%) with sufficiently complete data (ie, missing data ≤30%).17 At the scale level, missing data were handled by applying expectation-maximisation imputation. For the intention-to-treat analysis, missing data at the case level were handled using multiple imputation. We used an iterative Markov chain Monte Carlo (MCMC) method (fully conditional specification) with 20 imputations.30 Predictor variables for imputing missing values were study region, illness and migration background, as these were the only available data from patients not responding at T1. All secondary analyses were of an explorative nature and performed by fitting a repeated measures random-intercept mixed model with the three measurement time points clustered within participants (scaled identity covariance structure for repeated measures)31 and group allocation, time point and the group×time point interaction as explanatory variables. In additional analyses, moderation effects of study region, illness, migration background, symptom severity and level of acculturation23 were tested by amending the model with the respective variables and their interaction with the group variable. All analyses were performed using IBM SPSS Statistics V.21.0 (IBM Corporation, Armonk, New York, USA) and conducted in accordance with the study registration and study protocol.17

Results

From June 2013 to August 2014, 37 primary care practices invited 503 patients to participate in the study. Recruitment ended after the targeted statistical power was reached. Two patients did not identify themselves with their migration background and therefore did not meet the inclusion criteria. Two patients were excluded because written consent was not obtained. Sixty-four patients refused to participate for the following reasons: not interested in the study topic (34 patients), did not want to use written material (6 patients), were suspicious of scientific studies (4 patients), had problems with reading (3 patients), felt too ill to participate (2 patients), were unable to read the language of the PIMs (1 patient) or had other or undisclosed reasons (14 patients). We randomised 435 participants, of whom 317 responded at T1 (72.9%) and 309 (71.0%) were included in the analyses (missing data ≤30%; see figure 1). Data from 288 patients (64.7%, CG=136, IG=152) at T2 and 261 patients (58.7%, CG=125, IG=136) at T3 were analysed.

Figure 1

Patient flow diagram.

A dropout analysis using binary logistic regression indicated that group allocation, study region, illness, migration background and the two-way interaction terms between group allocation and all other variables were not significantly associated with dropping out between randomisation and T1 (Nagelkerke's R2=0.07, χ2 15 =21.4, p=0.13). Approximately 1.7% of the total data points were missing at the item level and imputed by expectation-maximisation. For the primary analysis, data for 126 of 435 randomised patients (29.0% missing) were imputed by multiple imputation.

Sample characteristics

Demographic and clinical characteristics are reported in table 3. More women than men participated in the study. Age distribution of participants was 15.7% between 18 and 40 years, 52% between 41 and 60 years and 32.4% older than 60. On average, participants had ∼10 years of education. The average duration of residency in Germany was ∼20 years, with 4.5% living in Germany for up to 5 years, 37.8% between 6 and 15 years, 36.4% between 16 and 25 years and 21.3% more than 26 years. More patients with chronic low back pain than patients with depression were recruited. The majority of patients were in the group with a Russian migration background, with the Turkish group as the second largest, followed by the Polish and Italian groups. The intervention and control groups were well balanced with respect to sample characteristics of patients.

Table 3

Sample characteristics

Primary outcome

Both groups reported high scores for the subjective usefulness of the PIMs after the consultation (T1). The IG group (227 patients) had a mean score of 65.08 (SE=1.43) and the CG group (208 patients) had a mean score of 61.43 (SE=1.63). Accordingly, the average rating in the IG group was ∼4 points higher than in the CG group (mean difference 3.65; one-sided 95% lower confidence limit=0.13). This difference reached statistical significance (one-sided t=1.708, p=0.04). The results correspond to a standardised mean difference (Cohen's d) of 0.18.

In a sensitivity analysis using a mixed models approach including all available data, we confirmed the results for the primary outcome (p=0.03) with a similar mean difference (4.41; one-sided 95% lower confidence limit=0.47).

Secondary outcomes

Regarding the usefulness of PIMs, the difference between the two groups decreased over time (see table 4). No statistically significant differences were found for total score after 8 weeks (T2) or 6 months (T3). The emotional subscale showed a statistically significant difference at T1 (p=0.020; mean difference=2.15; 95% CI 0.34 to 3.96), a tendency at T2 (p=0.07; mean difference=1.73; 95% CI −0.14 to 3.60) and no difference at T3 (p=0.54; mean difference=0.61; 95% CI −1.33 to 2.55). For the behavioural subscale, scores tended to be higher in the IG at T1. We found no significant statistical effect for the cognitive subscale, symptom severity of illness (depression or back pain) or quality of life.

Table 4

Secondary outcomes

Effect moderators

Study region, illness and symptom severity were not found to be associated with intervention effect regarding the primary outcome (p>0.10; see online supplementary materials for details). However, the difference between the IG and CG was 11.33 points smaller (95% CI −24.33 to 1.68; p=0.09) in patients with a Polish migration background than in those with a Russian background. Furthermore, the superiority of the adapted PIM over the standard PIM was substantially larger in patients with a low level of dominant society immersion (acculturation) than in high-acculturated patients. The intervention versus control difference in usefulness was 14.69 points, with one step decrease in acculturation on a four point scale (95% CI 4.46 to 24.91; p=0.005). Acculturation was also shown to be responsible for the aforementioned difference in effectiveness between Polish and Russian patients (the Polish patients were better acculturated than the Russian ones), turning the effect of migration background non-significant (p>0.10) when added to the model (see online supplementary materials for details).

Discussion

In this trial, we investigated the effects of cultural adaptation of high-quality translations of PIMs. While both versions were rated to be of high subjective usefulness, the adapted material was judged to be significantly more useful than the translated version after reading the PIM, which was handed out by the GP after the consultation. However, this difference decreased over time and was not statistically significant after 8 weeks or 6 months. The initial difference was mainly driven by differences on the emotional subscale. Further effects on clinical outcomes or quality of life were not found.

A central limitation of our study is that the USE had been developed and validated in German. The translations used in this study had been conducted using the forward–backward method and had been pilot tested by people with migration backgrounds using the think-aloud method. However, an investigation of the psychometric properties of the translated version is still lacking. Another limitation is that all outcomes were questionnaire-based and therefore subjective. However, given that GPs and patients were blinded with regard to study group, an expectation bias seems unlikely. Another limitation is the clinical heterogeneity of the sample. We decided to include patients from various migrant groups, with illness at various stages and with no restrictions relating to duration of residency in Germany. These differences may have diluted the intervention effects. Nevertheless, this heterogeneity improved the recruitment potential and is likely to have increased the external validity of the results. Similar limitations exist regarding the study intervention. Given the fact that we developed eight different versions of culture-adapted PIMs, which included versions for depression and chronic low back pain for four different migration backgrounds, the effects for some of the secondary outcomes may have been diluted. On the other hand, we used the same procedure to develop all culturally adapted materials.17 The level of comparison is therefore the effect of culturally adapted materials in patients with migration backgrounds living in Germany and suffering from a potentially chronic illness. Moderator analyses supported the assumption of functional equivalence of the intervention across migration backgrounds and illnesses, but also suggested that the superiority in usefulness of the adapted over the standard materials is likely to be substantially larger in patients with a low rather than a high level of acculturation.

The key strength of this study is the high internal and external validity. By applying a central randomisation procedure, using a computer-based algorithm with varying block sizes and by providing patients with the PIMs and questionnaire in sealed envelopes, allocation bias seems unlikely. The use of sealed envelopes, to blind patients and GPs with regard to study group allocation, was carried out to prevent performance bias. The statistician was also blind to patient group allocation when primary analysis was performed, to ensure objectivity. These measures ensured a high internal validity.

The involvement of a large number of primary care practices in four different regions of Germany, the evaluation of four migrant groups and two different illnesses, as well as the broad inclusion criteria, ensured a high external validity of the results. The dropout rate was lower than expected and a systematic dropout is unlikely. In consideration of the low rate of refusal to participate in the study and the low dropout rate, we conclude that acceptance of our intervention was high in our sample. However, we cannot conclusively determine the representativeness of our sample. The sample seems to be older and contain a higher proportion of women than the general population with a migration background.1 Since patients with chronic low back pain and depression are usually older and predominantly female, these differences may be caused by the illnesses investigated and the recruitment setting. The mean duration of residency (∼20 years) is not unusual for people with a migration background in Germany.

Our study adds new insight to the importance of cultural sensitivity in healthcare provision. To the best of our knowledge, this is the first trial to examine the effects of cultural adaptation of PIMs beyond high-quality translation. Although there is a growing literature on the effects of culture-sensitive interventions in general,32 ,33 studies have not usually been able to prevent performance bias (by blinding patients and GPs with regard to study group allocation). Moreover, language and other cultural aspects often confound interpretation. These two limitations did not apply to this trial.

Differences in usefulness of the PIMs found right after the consultation (T1) were largely consistent over different study regions, illness type, migration backgrounds and level of symptom severity, although the moderation analyses are likely to have been underpowered to a certain degree. Nevertheless, we were able to demonstrate a large and stable moderating effect of acculturation with potentially far-reaching implications. Even if the identified effect is on average rather small (Cohen's d of 0.18), the pragmatic nature of the trial and high heterogeneity of the sample and interventions should be taken into account. Under these conditions, an effect has to be quite robust to cause a detectable difference. Moreover, the comparator (ie, the high-quality translation) should be considered an active control, which may additionally limit the size of the effect detected. In addition, the migrant groups in our study had a long history of migration and cultural exchange. Indeed, most of the patients in our sample had been living in Germany for nearly two decades, which may also have limited the size of the effects observed. The superiority of culturally adapting patient information materials is very likely to be considerably larger in patients with a lower level of acculturation, as suggested by our moderator analyses. Differences in usefulness of the PIMs diminished over time (T2, T3), which is probably caused by a decrease in intervention effect over time. We did not detect any effect on symptom severity or quality of life. Written PIMs are a useful adjunct to physician consultation and advice, and translation of PIMs is often the first step towards achieving culture-sensitive healthcare.11 Our study has important practical implications, as we found reliable evidence that cultural adaptation of PIMs, compared with only high-quality translation, has additional benefits. The cost of adaptation, per PIM, was about €7500 in our study. Since PIMs can easily be reprinted and distributed, the costs of adaptation are marginal when produced in high print runs. Given the high potential to reach large numbers of patients at low cost, even a small effect may be clinically significant. Cultural adaptation should therefore be considered as a possible option to improve quality when developing PIMs for migrants, and clinicians should be encouraged to use them in their consultations, especially for migrants with low levels of acculturation.

Since we did not standardise the oral consultation, it seems highly likely that the effects of this face-to-face interaction masked the effect of the cultural adaptation. To detect effects of symptom severity or quality of life, a more standardised setting would probably be required. The provision of culturally adapted materials seems a promising way of improving PIMs for people with a migration background, particularly in the group of recent immigrants with low levels of acculturation.

Acknowledgments

The authors thank the physician network Qualitätsnetz Oberhausener Ärzte e.V. (Quali-Net O), namely Angela Brunöhler, Hans Kokorsch and Dr Peter Ramme, for their support in the recruitment process. Professor Caterina Lombardo, La Sapienza University of Rome, Italy; Professor Kaan Kora, Marmara University Medical School, Istanbul, Turkey; Professor Alexander Erichev, Medical Academy of Postgraduate Study Leading Researcher of the St. Petersburg Psychoneurological Research Institute, St. Petersburg, Russia; and Mgr. Marta Kollataj, Collegium Medicum of Jagiellonian University, University Hospital, Kraków, Poland supported us with their invaluable advice regarding cultural differences. The authors thank Julia Albicker for her help in the recruitment process and the data acquisition.

References

View Abstract

Footnotes

  • IB and MH are equal contributors.

  • Contributors LPH, ZR, LK, JD, JMZ, IB and MH made substantial contributions to the conception and design of the study. All authors were involved in acquisition of data. LK performed the statistical analyses. LPH drafted the first version of the manuscript with substantial contribution from LK. All authors contributed to the interpretation of data and revised the manuscript critically for important intellectual content. All authors gave final approval of the manuscript to be published.

  • Funding This study was funded by a grant from the German Ministry of Education and Research (01 GX 1031).

  • Competing interests All authors have completed the Unified Competing Interests form at http://www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author). LPH reports personal fees from AstraZeneca for a roundtable discussion on clinical guidelines outside the submitted work. CRK reports personal fees from Janssen Cilag and from Servier, outside the submitted work.

  • Ethics approval The trial was approved by the Institutional Review Board of the University Medical Center Freiburg (number 375/10) and the regional review boards responsible for local GPs (Ärztekammer Nordrhein, number 2012400; Sächsische Landesärztekammer, number EK-BR-74/12; Landesärztekammer Baden-Württemberg, number F-2012-065, and Ärztekammer Hamburg, number MC307/12).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.