Article Text


Presentation of respiratory symptoms prior to diagnosis in general practice: a case–control study examining free text and morbidity codes
  1. Richard A Hayward,
  2. Ying Chen,
  3. Peter Croft,
  4. Kelvin P Jordan
  1. Research Institute for Primary Care and Health Sciences, Keele University, Keele, Staffordshire, UK
  1. Correspondence to Dr R A Hayward; r.hayward{at}


Objective General practitioners can record patients’ presenting symptoms by using a code or free text. We compared breathlessness and wheeze symptom codes and free text recorded prior to diagnosis of ischaemic heart disease (IHD), chronic obstructive pulmonary disease (COPD) and asthma.

Design A case–control study.

Setting 11 general practices in North Staffordshire, UK, contributing to the Consultations in Primary Care Archive consultation database.

Participants Cases with an incident diagnosis of IHD, COPD or asthma in 2010 were matched to controls (four per case) with no such diagnosis. All prior consultations with codes for breathlessness or wheeze symptoms between 2004 and 2010 were identified. Free text of cases and controls were also searched for mention of these symptoms.

Results 592 cases were identified, 194 (33%) with IHD, 182 (31%) with COPD and 216 (37%) with asthma. 148 (25%) cases and 125 (5%) controls had a prior coded consultation for breathlessness. Prevalence of a prior coded symptom of breathlessness or wheeze was 30% in cases, 6% in controls. Median time from first coded symptom to diagnosis among cases was 57 weeks. After adding symptoms recorded in text, prevalence rose to 62% in cases and 25% in controls. Median time from first recorded symptom increased to 144 weeks. The associations between diagnosis of cases and prior symptom codes was strong IHD relative risk ratio (RRR) 3.21 (2.15 to 4.79); COPD RRR 9.56 (6.74 to 13.60); asthma RRR 10.30 (7.17 to 14.90).

Conclusions There is an association between IHD, COPD and asthma diagnosis and earlier consultation for respiratory symptoms. Symptoms are often noted in free text by GPs long before they are coded. Free text searching may aid investigation of early presentation of long-term conditions using GP databases, and may be an important direction for future research.

Statistics from

Strengths and limitations of this study

  • Previous studies have mainly focussed on the time taken between first recording of symptoms and diagnosis of several cancers. This novel study investigates the time taken from the recording of respiratory symptoms as code or as free text to diagnosis.

  • General practitioner (GP) database research typically focuses on coded information rather than consultation text. However, searching for symptom codes only identified less than half of those with a GP record of prior respiratory symptoms in patients newly diagnosed with ischaemic heart disease (IHD), chronic obstructive pulmonary disease (COPD) or asthma.

  • Time from first recorded symptom to date of diagnosis may be substantially shorter when the search of databases is restricted to symptom codes than when expanded to include text entries as well.

  • However, associations between previous respiratory symptoms and diagnosis were weaker when the analysis included text search as well as symptom codes.


Research into potential benefits and costs of early intervention in people with long-term conditions will be helped by identifying such patients as early as possible in the course of their condition. General practice typically provides the first point of access to non-emergency UK care; more than 95% of the population is registered with a general practitioner (GP) to provide such care, and this setting, therefore, provides an important arena for investigating prognosis and healthcare among patients who first consult in the early stages of long-term conditions. Recent examples of such studies have been provided by research into the early presenting symptoms of cancer.1 ,2

GPs, however, may not necessarily diagnose or label people with a long-term condition at these first consultations. First, because it may not be obvious that the illness represents the presenting symptom of a long-term condition rather than a short-term or self-limiting problem; second, because the presenting symptoms may represent a range of future possible long-term conditions; and third, because there may be no obvious advantage to diagnosis at this early stage and so the GP may prefer to label or record the problem initially as a symptom.

This range of options is reflected in the fact that GPs in the UK can record symptoms or diagnoses or both in the medical records, and can do so by using free text entries or by allocating codes or by doing both. There is evidence that GPs may choose to code symptoms, rather than to simply note them in the text, if there is only one presenting problem to record, or if the symptom is regarded as more serious or a higher priority than other presenting problems.1 ,2 For researchers using computerised general practice databases, coded symptoms and diagnoses are generally straightforward to identify, once the relevant codes have been determined. Information in the consultation free text is harder to extract, electronically or manually, but may represent the first recorded manifestation of a disease.

In this paper, we use the example of symptoms of breathlessness and wheeze recorded in primary care consultations to compare free text entries with coded symptom information as potential measures of early presentation of future long-term conditions, namely ischaemic heart disease (IHD), chronic obstructive pulmonary disease (COPD) and asthma.

Breathlessness and wheeze are common presentations in primary care. The symptoms are frequent early manifestations of COPD and asthma.3–10 However, these respiratory diseases may not be recognised or labelled as such.9–12 Breathlessness and wheeze are also presenting symptoms of heart failure.13 ,14 Men with breathlessness, for example, are at twofold higher risk of future major IHD events than men without breathlessness.15 ,16 Persons with both IHD and COPD have more breathlessness, sputum, wheeze and cough than those with COPD alone.16 Such symptoms may, however, also be manifestations of short-term or self-limiting illness such as upper respiratory tract infection. Hence, we have also investigated prior breathlessness and wheeze in matched controls who do not have IHD, COPD or asthma.

Methods and analysis

We performed a case–control study using the Consultations in Primary Care Archive (CiPCA), a database which contains all recorded consultation data from a subset of general practices in North Staffordshire, UK. We have previously published evidence of completeness of this information.17 CiPCA practices code morbidity using a standard dictionary of codes (Read codes). The Read code system is structured into symptom, diagnostic and process of care chapters. For example, diagnostic codes may be found in Chapter H representing ‘Respiratory System Diseases’. Symptoms when coded may be recorded under Chapter 1, ‘History/Symptoms’ or Chapter R, ‘Symptoms, signs and ill-defined conditions’. The code lists used for this study are available from (

Quality of morbidity coding by CiPCA practices is assessed annually within a feedback and training programme.17 Doctors and nurses are required to enter at least one code per consultation. CiPCA contains the first 220 characters of free text entered at the consultation; there are no standard requirements for free text use in CiPCA practices. Eleven practices continuously contributed to CiPCA from 2004 to 2010. The total registered practice populations in these practices was 94 565 in 2010.

Cases were defined as all patients aged 18 years and over who, in 2010, received a coded consultation for IHD, COPD or asthma, and had no prior consultation coded as such during 2004–2009, and who had been registered with their practice from at least 2004. Controls were selected from patients who had at least one consultation in 2010, but no coded consultations for IHD, COPD or asthma either in 2010 or from 2004 to 2009 inclusive, and who were registered with their practice throughout the period. For each case, potential controls were frequency matched by age, gender and practice, and a sample of four controls per case then randomly selected.

Exposure was defined as prior symptoms of breathlessness and/or wheeze recorded in free text and/or coded as symptoms in the consultation database. Regardless of the free text entry of the consultation, the GP can input a Read code for either a symptom or diagnosis. At least one code (symptom or diagnostic) is required to be recorded by the CiPCA doctors at each consultation. Multiple symptoms can be entered in the text with no corresponding code (symptom or diagnosis) necessarily relating to those text-noted symptoms.

To establish exposure status, the search for prior consultations relating to breathlessness and wheeze was conducted for both cases and controls in two phases:

  • Phase 1: identification of primary care consultations coded with the symptoms ‘breathlessness’ or ‘wheeze’ between 1 January 2004 and the date of diagnosis in 2010 (cases), or 31 December 2010 (controls) as shown in figure 1.

  • Phase 2: for the same time period, electronic searches of the free text of consultations to identify those entries which included words starting with ‘breathless*’, ‘wheez*’, ‘sob*’ (short of breath), ‘dyspn*’ (dyspnoea). Texts were excluded where these words were preceded by ‘no’ or ‘not’. A GP researcher (RAH) manually searched all identified texts plus additional texts which included words starting with ‘breath*’ to ensure they indicated breathlessness or wheeze symptoms. Another researcher (KPJ) double-checked all identified texts.


The main case–control analyses focused on associations between diagnosis and prior symptoms. Association between a prior coded symptom of breathlessness or wheeze (exposure status, from phase 1 and the outcome of later diagnosis (IHD, COPD or asthma) was assessed using multinomial multivariable logistic regression, adjusting for age and gender, and reported as relative risk ratios (RRR) with 95% CIs with the controls as the reference group. Symptoms identified through searching of text were then added (phase 2), and the analysis repeated to assess the association between at least one prior recorded symptom (coded or in text) and later diagnosis.

Restricting analysis to cases only, median times between first coded symptom and diagnosis, and between first recorded symptom (text or code, whichever came first) and diagnosis, were determined for each of the three diagnostic groups (IHD, COPD, asthma). Analysis used STATA V.12.


A total of 592 cases (194 with IHD, 182 COPD, 216 asthma) were identified and 2368 matched controls selected. Patients with asthma were younger than other cases (mean age 46.2, SD 17.20); IHD cases were the oldest (mean age 68.5, SD 12.95, table 1). Fewer women than men had IHD (41%), but more women had COPD and asthma (58% and 63%, respectively, table 1). The corresponding controls had similar characteristics reflecting the matched design. There were 224 cases (38%) and 1776 controls (75%) with no prior history of consultations about breathlessness or wheeze recorded as either symptom codes or text (table 2).

Table 1

Demographic characteristics (age and gender) of participants

Table 2

Identification of prior breathlessness and wheeze symptoms by (1) code alone or (2) by code or textual information

Using symptom codes alone, 178 cases (30%) had a previous record of breathlessness or wheeze (table 2) compared with 6% of controls. Adding text search to this symptom code extraction, there were 368 cases in total with a prior recorded breathlessness or wheeze symptom (62%) compared with 25% of controls.

In the multivariable analysis, a prior coded symptom of breathlessness or wheeze was associated with each of the three case groups when compared with controls, stronger for COPD and asthma (COPD RRR 9.56, 95% CI 6.74 to 13.60; asthma RRR 10.30, 95% CI 7.17 to 14.90) than for IHD (RRR 3.21, 95% CI 2.15 to 4.79) (table 3). The associations between prior symptoms and future diagnosis were weaker when symptoms recorded in the text were included (COPD RRR 6.32, 95% CI 4.54 to 8.80; asthma RRR 7.86, 95% CI 5.73 to 10.80; IHD RRR 2.78, 95% CI 2.05 to 3.78).

Table 3

Association of prior breathlessness or wheeze symptom with diagnosis of IHD, COPD and asthma

Among the 178 cases with prior symptom codes, the median times from first coded symptom to diagnosis were 44 weeks (COPD), 92 weeks (asthma) and 47 weeks (IHD) (table 4). When this group was expanded to include those with text symptoms (n=368), median time between first recorded breathlessness or wheeze symptom (text or code, whichever came first) and subsequent diagnosis, was 141–149 weeks.

Table 4

Time in weeks before diagnosis of first recorded breathless or wheeze symptom according to different searching scenarios (code alone vs code or text)

In order to investigate whether GPs select different types of patients for recording symptoms in text or by code, we analysed the subgroup of all cases with a record of prior symptoms of breathlessness or wheeze, both coded and recorded in text. Among COPD cases in this subgroup, median time to date of diagnosis from earliest mention of symptoms in either code or text was 185 weeks (table 4), and from first coded symptom only it was 61 weeks; corresponding median times for IHD were 208 and 62 weeks; and for asthma 240 and 164 weeks.


This case–control study of patients with IHD, COPD and asthma highlights the frequency of breathlessness or wheeze symptoms presented to primary care prior to diagnosis of a long-term condition and recorded as either Read codes or free text. GP database research typically focuses on coded information rather than the consultation text. In our study, searching for symptom codes identified less than half of those with a GP record of prior symptoms in a group of patients newly diagnosed with IHD, COPD or asthma. Median time from first recorded symptom to date of first diagnosis among cases was substantially shorter when the search was restricted to symptom codes than when expanded to include text entries as well. The differences were just as pronounced in the subgroup of patients who had both text entries and codes for symptoms recorded in their medical notes.

However, the associations between previous symptoms and diagnosis were weaker when the analysis included text search as well as symptom codes, indicating that proportionately fewer persons with initial symptoms recorded in the text went on to develop IHD, COPD or asthma compared with persons whose first symptom presentation was coded.

Comparison with existing literature

Our overall finding that symptom codes can predate diagnosis in IHD, COPD and asthma has also been found in studies of cancer.2 ,18 ,19 Neal found the time from symptom code to diagnosis varied widely between different cancers, from 26 weeks for breast cancer to 156 weeks for myeloma, while in ovarian cancer, Tate found that symptom codes were first recorded a median of 19 weeks prior to the first use of a diagnostic code.1 ,2

The finding that the prevalence of previous symptoms increases when text entries are included as well as symptom codes also reflects work in cancer. Koeling, analysing the same consultations for ovarian cancer in the General Practice Research Database as Tate, found that symptom codes alone identified 35–70% of symptoms in the 12 months preceding diagnosis, but this figure was 77–98% when the symptom code search was combined with a text search using an algorithm to extract strings of words or word fragments based on the words used in the symptom code.19 This compares with the increase from 30% to 62% in identification of cases when text searching for breathlessness or wheeze was added to symptom codes in the current study of respiratory and cardiac diseases reported here.

Computerised data extraction of information from free text has been used previously. These techniques include searching for keywords and for word fragments (such as ‘ovar’ or ‘ov’ for ovarian cancer), similar to the technique used in our study.18 ,20 Positive and negative symptoms are not differentiated by this type of computer search, for example, between ‘has’ or ‘has no’ breathlessness. Natural Language Processing (NLP) has been used to develop algorithms to deal with grammatical problems.19 ,21 Computerised extraction of data from free text is limited by the cost of obtaining anonymised data as well as dealing with negation around keywords, abbreviations, misspellings and acronyms.19 ,20 ,22 NLP has been developing for over 30 years, but the difficulties in developing a system that can recognise syntax, semantics and domain knowledge in free text are many and complex.23 Voorham extracted numeric clinical data concerning diabetes care embedded in general practice electronic health records as free text, and developed a computerised extraction system triggered by numerical values and incorporating nearby names and units which label the measurement.24

The example chosen for our study drew on the recognition that breathlessness and wheeze are common symptoms of COPD and asthma. Freeman in studying past and present smokers in UK primary care found that the best questions to differentiate persons with and without COPD were breathlessness on exertion and wheeze.25 Ohar, using self-report symptoms at a workplace-based assessment in the USA, found that 75% of those with a diagnosis of airways obstruction had prior breathlessness.26 This compares with the figures in our study, where breathlessness and wheeze were recorded (code or text) prior to diagnosis in 62% of patients with a future diagnosis of IHD, COPD or asthma.

Limitations of the study

This study was not designed to address the question of the best way to identify all earliest symptom consultations among patients who are subsequently diagnosed with IHD, COPD or asthma. There may be other early symptoms and presentations of these conditions, such as chest pain or cough. Our case–control design could not estimate the predictive value of symptoms of breathlessness for future diagnosis. Although controls had a much lower prevalence of prior symptoms than cases, people without IHD, COPD and asthma are more numerous in the general population than people with these diagnoses. A prevalence of 25% of controls who had symptoms when text and codes are both included indicates that the discrimination of who does and does not go on to a diagnosis based on symptoms alone is likely to be limited. Despite this, symptoms were associated with future diagnosis, often a long time later, and so there is potential for future prospective research to establish the prognostic usefulness of the initial presentation of these symptoms.

It is possible that the GP diagnosed the condition prior to the first coded mention in the records, and that interrogation of free text may indicate an earlier date of diagnosis.18 ,19 Nevertheless, this does further emphasise the importance of considering the use of free text in investigation of early presentation of long-term conditions using GP databases. Alternative definitions of morbidity than recorded diagnosis codes using relevant prescriptions and managements are possible, and further research could explore whether GPs were managing patients optimally despite a lack of formal recorded diagnosis.

All practices providing data to the CiPCA database use the Read code system, a widely used system by GPs in the UK. There may be variation in extent of symptom coding between practices and also between databases of healthcare information depending on coding system used (eg, Read codes or International Classification of Diseases codes) and guidance given on recording.27

One possible limitation was the localised nature of the CiPCA database. It has been used, for example, in studies of gout, dementia and frequent consulters, and provided comparable musculoskeletal prevalence figures to national UK and international databases.28–31 North Staffordshire is a deprived area, but the participating practices were socially and economically diverse. GPs in the practices undergo some training in morbidity recording, but while encouraged to use diagnostic codes, symptom codes may also be used.

Our study spanned 7 years, and patients may have had symptom or diagnostic codes before this. CiPCA allows only examination of the first 220 characters of the consultation text; however, mention of breathlessness or wheeze later in the consultation text would only increase the disparity between coded symptoms alone and consultations using coded or text-recorded symptoms.

Implications for practice and research

Our investigation has not addressed the question of whether it would be clinically useful to identify those who are going on to develop chronic lung or heart disease at the point when they first present with symptoms. The GP is likely to be working with a range of possible future trajectories when using symptoms and symptom codes because, as illustrated by the proportion of controls who have a history of breathlessness and wheeze, these symptoms do not necessarily presage future chronic lung or heart disease. Furthermore, the GPs may well be providing optimal care of patients with these symptoms in relation to the likelihood of different future outcomes. However, our study does highlight the opportunity provided by general practice and general practice databases for prognostic and intervention research into the effectiveness and usefulness of early intervention, given the strong associations we have observed between first symptoms and later diagnoses and the long-time intervals between them. Our study suggests that a combination of symptom codes and text records would provide the optimal sample for such studies by ensuring that the highest proportion possible of all those who present with such symptoms will be included. However, the weaker association of symptoms with a future diagnosis when including text-recorded symptoms suggests, it is possible that those with purely textual information have less serious symptoms.32 Other information from prospective studies will be needed to discriminate between those who will and will not develop long-term conditions.

Diagnostic and symptom codes in GP electronic health records form a ready source of data for research, but much useful information exists in the free text which is harder to extract. Studies of earliest presenting symptoms in national databases are challenging because manual free text searching on a large scale is difficult. However, this would improve if GPs were to code symptoms more readily when unable or not wishing to make a diagnosis. With expanding investment in research resources, technological barriers to textual analyses are likely to be solved.


This study shows that symptoms of breathlessness and wheeze in general practice patients were often recorded as free text or symptom codes by the GP 3 years before diagnosis of IHD, COPD or asthma was coded and recorded. Using only symptom codes as the source of this information identified fewer patients with symptoms, but who were closer in time to getting a chronic disease diagnosis, than was achieved by a search that included both text and codes. Primary care can provide an arena for research into the usefulness of early identification of long-term conditions such as COPD, including investigation of whether it can guide more effective healthcare, and improve long-term outcomes.


The Keele GP Research Partnership and the Informatics team at the Arthritis Research UK Primary Care Centre. The work in this paper was informed and supported by KJ's and PC's membership of the UK Medical Research Council's Prognosis Research (PROGRESS) partnership.


View Abstract


  • Contributors RAH, KPJ and PC were involved in the initial conception of the research question and wrote the paper. RAH was involved extensively with all the background research. YC extracted the data from the database and performed the statistical analysis.

  • Funding CiPCA was funded by the North Staffordshire Primary Care Research. Consortium and Keele University's Research Institute for Primary Care and Health Sciences.

  • Disclaimer RH is a NIHR Academic Clinical Lecturer in General Practice. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.

  • Competing interests None declared.

  • Ethics approval Ethical approval was obtained from the North Staffordshire Research Ethics Committee.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.