Evaluation of readability and accuracy of information leaflets in general practice for patients with asthma
BMJ 1998; 317 doi: https://doi.org/10.1136/bmj.317.7153.264 (Published 25 July 1998) Cite this as: BMJ 1998;317:264
- Helen Smith, directora,
- Susan Gooding, research and development nursea,
- Richard Brown, general practitionerb,
- Anthony Frew, senior lecturerc
- aWessex Primary Care Research Network, Primary Medical Care, University of Southampton, Southampton SO16 5ST
- bWilton Health Centre, Wilton SP2 0HT
- cUniversity Medicine, Southampton General Hospital, Southampton SO16 6YD
Printed education materials are often used to augment healthcare professionals' verbal information to patients. Asthma is one of the commonest chronic diseases managed in general practice, and many leaflets have been produced on its diagnosis, prognosis, management, and treatment, but these have been subjected to little critical review.
Subjects, methods, and results
We evaluated the readability and accuracy of patient information leaflets available in general practice for asthmatic patients. We invited 70 general practices from the Wessex Research Network to send one copy of each of the leaflets they had on asthma: 168 different leaflets were received from 49 practices. We reviewed the leaflets for readability using the simple measure of gobbledegook (SMOG) formula, which estimates the level of education required to understand the text.1 AF reviewed the leaflets for congruency with current British Thoracic Society guidelines2> and accuracy in other areas.
The reading grade for these publications ranged from 5 to 12 (mode 8, mean 8.66 (SD 1.79)) (table), and 39 (23%) contained inaccuracies.
Readability of patient information leaflets about asthma
The British Thoracic Society guidelines were not applicable to 78 of the leaflets. Of the rest, 58 were fully congruent, 21 were >90% accurate, and 11 were inaccurate. Six inaccurate leaflets were produced by charities, the other five by drug companies. Seven of these leaflets contained therapeutic advice that was out of date. One recent publication ignored the effects of chronic exposure to cats. Another denied the presence of inflammation in mild disease. Three of the inaccurate leaflets had no publication date, and all but one of the rest were at least six years old; several practices sent a leaflet 13 years old.
Thirty four leaflets (20%) contained inaccurate or misleading statements about areas outside the society guidelines. These included unreasonable advice on the need to see a doctor, exaggerating the role of cola drinks as a trigger, inexact advice on avoiding house dust mite allergens, incorrect information on the efficacy of desensitising injections, wrong contact addresses and telephone numbers, and misinformation about obtaining a peak flow meter and not acknowledging the wide range of devices available.
Comment
Five and a half million people in Britain have reading difficulties,3 and considerably more (22% of the working population) have a low level of literacy.4 Text with SMOG scores under 5 will be understood by most people (information from Basic Skills Agency, 1992), and it is recommended that health literature should be written at a SMOG score <=5.5 To attain high levels of reader comprehension would require revision of 97% of the leaflets we reviewed. Rather than attempting wholesale revision, it is more realistic to match readers with existing materials and to strive for low readability scores in replacement leaflets.
Readability formulae have limitations; ideally, testing with patients should also be done as reading is a complex process and ability to comprehend a text is influenced by presentation (organisation, print, illustrations), situation (stress), and reader characteristics (motivation, maturity). Formulae based on word length disregard patients' familiarity with the vocabulary associated with their illness, thereby overestimating the difficulty of the text.
None of the inaccuracies highlighted posed a serious threat to patient wellbeing, but patients deserve to receive complete, current information about treatment and health education. Practices sent copies of every leaflet that they had, so this may have included leaflets not normally used. Less desirable leaflets may not be given to patients, but while these remain in the practice there is the potential that they may be used.
To ensure that patients receive good advice we recommend that healthcare professionals read leaflets before giving them to patients to ensure that the content is accurate and up to date; assess patients' reading abilities and select material to suit; and, perhaps most importantly, review stocks of leaflets regularly and discard those that are out of date or inaccurate to reduce the risk of misinforming patients.
Acknowledgments
We thank all the practices that took part in the study and the administrative and support staff of the Wessex Research Network---Joan Dunleavey, Christine Tresise, and Sylvia Craigie-Halkett.
Footnotes
-
Contributors HS initiated the study, designed the protocols, and participated in writing the paper. SG coordinated the collection of data, undertook the analysis of readability, and participated in writing the paper. RB participated in data interpretation and in writing the paper. AF provided expert review of the leaflets' accuracy and participated in writing the paper. HS is guarantor for the paper.
-
Funding Grant from Allen and Hanburys.
-
Conflict of interest None