Statistics from Altmetric.com
Accurate identification of pathogens, rather than colonising bacteria, is a prerequisite for targeted antibiotic therapy to ensure optimal patient outcome in diabetic foot ulcers.
There is a lack of robust evidence to advise clinicians on the best technique to identify pathogens in diabetic foot ulcers.
The aim of this study was to assess the concordance between culture results from wound swabs and tissue samples in patients with infected diabetic foot ulcers.
This protocol details the design of the first prospective multicentre study to examine agreement between different wound sampling techniques in patients with diabetic foot ulcers.
Results from this study will be directly relevant to all clinicians treating patients with diabetic foot ulcers.
Strengths and limitations of this study
The sample size of 400 patients will provide 80% power for detecting a difference of 3% in the reported presence of organisms.
Recruiting patients from 25 sites across England increases the external validity of results.
The subset of samples processed using molecular (PCR) techniques will allow the largest comparison of this technology with the conventional plating techniques in diabetic foot ulcers. However, further work will still be required to fully evaluate the role of PCR techniques in the care of diabetic foot ulcers.
The global prevalence of diabetes is estimated to be 3% and predicted to double by 2030, largely due to the obesity epidemic.1 Among the complications of diabetes, those involving peripheral nerves and arteries predispose to foot complications. These include alterations in foot architecture and mechanics that lead to increased pressure on the plantar surfaces.2 ,3 These changes, combined with peripheral sensory and autonomic neuropathy, increase susceptibility to trauma and dry skin fissures.4 ,5 The additional presence of peripheral vascular disease impairs wound healing. Thus, it is not surprising that foot ulceration occurs in 15–25% of diabetic patients during the course of their disease.6 ,7
Diabetic foot ulcers can take many weeks or often months to heal and are known to have a negative impact on patients’ functional ability, quality of life, as well as a wider societal impact in terms of reduced work productivity, health costs and financial loss.8–11 The combination of immunological perturbations caused by diabetes and an open wound frequently results in clinically apparent infection. At presentation about half of recent onset diabetic foot ulcers are clinically infected.12 Diabetic foot infection is thought to be the most common cause of diabetes-related hospital admissions and precedes approximately 80% of non-traumatic lower-limb amputations.6 ,13 ,14
All chronic wounds have bacteria on their surface, which mostly originate from the normal skin flora, sometimes supplemented by opportunistic colonising bacteria. Thus, the presence of bacteria within a wound is not sufficient to diagnose infection. Infection is instead a clinical diagnosis based on signs and symptoms such as fever, pus, pain or tenderness, erythema, warmth and induration.15 These findings suggest a shift in balance in favour of the bacteria within the ulcer over the host's defences, with consequent destruction of host tissue.
When infection is diagnosed, antibiotic therapy is initiated which is usually empirically selected, based on the clinician's understanding of the likely causative organisms. To modify the empiric treatment, if needed, clinicians seek to identify the infective organisms within the wound and their antibiotic susceptibilities through microbiological evaluation.16 This may contribute to the clinical diagnosis of infection (by the isolation of virulent organisms likely to be pathogens, or a heavy bacterial load of less virulent organisms). Crucially, it also allows targeted treatment with the most appropriate antibiotic agent for specific organisms, thus reducing the overuse of broad spectrum antimicrobials, which is associated with increasing antibiotic resistance.15–17
Currently, culture and sensitivity results typically take several days before they are reported to clinicians, during which time the patient is often treated with broad spectrum antibiotic(s) so as to cover all potential pathogens. Furthermore, it is not clear as to whether clinically relevant changes in the wound flora occur between initial sample and test results being available at reassessment. Quicker techniques for microbiological analyses, such as those based on DNA fingerprinting techniques or the PCR assay, have been shown to be effective in rapidly detecting causative organisms and may help reduce this delay.18 In theory, this might lead to earlier tailoring of antimicrobial therapy to infecting organism(s).
The accuracy of the culture information is crucially dependent on an appropriate specimen, that is, one from the infected site that is not contaminated by surrounding normal flora, being sent to the laboratory. The specimen must also be quickly transported and inoculated on plates to avoid losing pathogens or allowing contaminants to proliferate. Failing to identify a true pathogen (poor test sensitivity) or identifying a coloniser as a pathogen (poor specificity) can each lead to incorrect antibiotic therapy and worse treatment outcomes. Thus, it is important that clinicians use a technique to obtain specimens that will give a valid account of the bacteria present and their number and sensitivity to antibiotics.
Need for a study
Swabs for taking a culture are almost universally available in healthcare settings and are quick and easy to use. But, they may be susceptible to collecting contaminants and to failing to grow some pathogens. In order to send a specimen from which pathogens are likely to grow, most published expert guidelines recommend obtaining a tissue specimen rather than a swab.19 ,20 Many cite the study by Pellizzer et al,21 which reported on 29 diabetic patients who were suspected of severe infection and were neither recently treated with antibiotics, nor hospitalised. The analysis of the study did not report agreement between swab and tissue sample, however, simply the number of bacterial colonies in each sample. Their conclusion that tissue samples are better than swabs can be traced to a comparison of the numbers of isolates in 21 people remaining in the study at 30 day. Furthermore, this selected population does not reflect many of the foot ulcer patients seen in foot clinics, who have often been treated with antibiotics. More recently, Slater et al22 reported the results from swabs and a deeper tissue sample (obtained via needle aspiration), but their study only contained 30 diabetic patients with foot ulcers (in a total sample of 60; other patients had deep abscesses, etc). They found that in 37 patients (62% of samples), there was a similar profile of organisms isolated from the swab and the deep tissue sample. In 12 patients (20% of samples), the swab identified more organisms and in 11 patients (18% of samples) the deeper tissue sample identified more organisms. These data were not stratified by the presence or absence of ulcer, or ulcer type (neuropathic/ischaemic) and it is not clear if the results were heterogeneous across tissue damage types or applied to tissue samples.
A systematic review of the diagnosis and management of infection in diabetic foot ulcers23 found only one study that evaluated sample acquisition and reported agreement in sufficient detail to allow full analysis. This study, by Bill et al,24 included patients with a variety of wounds: 18 pressure ulcers, 10 diabetic foot ulcers, 5 venous leg ulcers and 5 arterial ulcers. A punch biopsy was taken from the centre of the wound and compared with a wound swab with quantitative analysis. Swabs were not taken from wounds with a bacterial load of less than 105 colony-forming units bacteria per gram of tissue. The presence of infection was defined by bacterial load (one million bacteria per gram of tissue). The sensitivity for wound swabbing was reported as 79%, meaning that the swab failed to detect approximately one in five wound infections as defined by culture of tissue obtained by punch biopsy. The derived likelihood ratios suggested that the wound swab was not a useful method of identifying infection in chronic wounds. Interpretation of study findings is impeded by small size and heterogeneity in the ulcer population.
It may be that these data are not directly transferable to a clinical diabetic population with a diagnosis of foot ulcer infection (ie, clinical indication for a swab). In addition, there were potential sources of bias, such as the lack of a description of blind test verification and clarity as to whether the same clinical data were available when test results were interpreted as would be available when the test is used in practice. Furthermore, the research question addressed in this proposed study is not about ‘diagnosis of infection’ (ie, would both tissue sample and swab agree for an arbitrary bacterial load of >105 colony-forming units bacteria per gram of tissue for tissue biopsy and >105 colony-forming units bacteria/cm2 for swab cultures) as the diagnosis of infection (present or absent) is a clinical decision. People with a bacterial load of <105 colony-forming units bacteria per gram of tissue did not have a wound swab, and it is not clear, therefore, if the swab provides additional information, as suggested by Pellizzer et al.21 Thus, the study by Bill et al24 cannot conclude that swabs of clinically infected diabetic ulcers do not provide similar information as tissue samples obtained through tissue samples.
The primary objective of this study was to evaluate concordance (agreement) between culture results from wound swabs and tissue samples from the same patient. The coprimary endpoints for the study are agreement between the two techniques for three microbiological parameters.
Reported presence of isolates likely to be pathogens, as identified by the UK Health Protection Agency (HPA).
The presence of resistance to antibiotics to which the isolates are usually sensitive among likely isolates as reported by standard techniques.
The number of bacterial isolates reported per specimen (swab/tissue sample).
Secondary objectives are to
Compare the proportions of patients for whom empirical antibiotic therapy was ‘appropriate’, based on culture and sensitivity results of swab or tissue samples, assessed by a blinded clinical panel review (with record of antimicrobial therapy prescribed).
Compare the number of isolates, reported in both the swab and tissue samples by conventional plating and culture, against molecular techniques (ie, PCR) that identify the nucleic acids of bacteria in the wound.
Compare rates of adverse effects with the two techniques.
Compare costs of sampling with the two techniques.
Methods and analysis
This is a multicentre, cross-sectional study involving 400 patients with diabetes presenting with a foot ulcer suspected of being infected who are thought by their clinicians to require antibiotic therapy (see figure 1). Consenting patients will have both a swab and tissue sample taken from their foot ulcer for conventional plating and culture. In addition, 20 patients will be included in a substudy in which a second-swab sample and half of the tissue sample will be processed using molecular (PCR) techniques for comparison with the conventional plating techniques.
All patients at least 18 years of age with a diabetic foot ulcer that the clinician suspects is infected, either acutely or as a chronic infection, will be screened for enrolment and must meet the eligibility criteria below. A diabetic foot ulcer will be considered to be any open wound on the foot (below the malleoli/ankle) in a patient with a diagnosis of diabetes mellitus. Each participant will undergo an eligibility screen prior to entry and an anonymised log will capture patient demographics along with reasons for not entering the study.
The patient has a diagnosis of diabetes (type 1 or type 2).
The patient is at least 18 years of age at the time of signing the consent form.
The patient has a suspected ulcer infection with or without bone infection, based on clinical signs and symptoms using Infectious Diseases Society of America/International Working Group on the Diabetic Foot criteria and the judgement of the investigator.
The clinical plan is to treat the patient with antibiotics for their infected ulcer.
The clinician deems it inappropriate to take a tissue sample or a swab sample for any reason.
The patient has previously been recruited to the study.
Recruitment and registration
Centres will be required to have obtained local ethical and management approvals and undertake a site initiation meeting with the Clinical Coordinator prior to the start of recruitment into the study.
Both inpatients and outpatients will be recruited from multidisciplinary primary and secondary care-based foot ulcer/diabetic clinics and hospital wards. Potential patients will be provided with a patient information leaflet outlining all aspects of the study, given the chance to read it and ask any questions they may have about the study. Written informed consent will be documented by the patient and member of the local team. Informed written consent will be obtained from all patients prior to entering the study. Patients will be registered via a 24 h automated telephone registration system that will automatically send confirmation of successful registration through to the site.
Clinicians at all centres will be trained to collect samples using the HPA standards25 ,26 as a minimum requirement. In the first instance training will be delivered during the site initiation visit but staff will also be able to access an e-learning package containing a video at any time throughout the study. It is not anticipated that this will substantially alter current swabbing practice as this is a routine procedure with established patterns of practice from the HPA.
After wound cleansing (using sterile saline and gauze) and debridement (removal of necrotic tissue, foreign material, callus, undermining of the wound edge), a physician, nurse or podiatrist will obtain specimens for aerobic and anaerobic cultures by
First, using a cotton-tipped swab rubbed over the wound surface to sample superficial wound fluid and tissue debris. The swab will be pressed with sufficient pressure on the wound bed to capture expressed wound fluid, and will be positioned deep in the ulcer to collect from likely infected areas. For the substudy in 20 patients of culturing versus molecular techniques, a wound swab will be collected for conventional techniques and another for molecular analysis.
Immediately after the cotton swab has been collected, a tissue sample will be removed from the same area of the ulcer bed. This procedure will be done using sterile equipment (forceps, scalpel and scissors) and aseptic technique. It will involve the removal of a small piece of wound tissue at the base of the wound by scraping or scooping using a dermal curette or sterile scalpel blade.
Training of swab and sampling techniques
Clinicians in the participating sites will participate in a study information session to update their technique for acquiring wound samples. Clinicians will also view an e-learning package that will be developed and issued to all sites, detailing study procedures. This will include video footage of correct methods of obtaining both types of samples.
Both samples will be placed in transport medium suitable for sustaining both aerobic and anaerobic organisms and promptly delivered to the local medical microbiology laboratory, in accordance with standard practice. A national standard method will be used for collecting and processing samples.25 ,26 Both samples will be processed in the same laboratory.
Sample transport for PCR substudy
For the 20 patients included in the substudy, one swab sample and half of the tissue sample will be sent for molecular analysis, via first class post at ambient temperature to a specialist laboratory. Upon receipt, samples will be stored at –70°C and batches will be defrosted before being processed.
In addition to patient demographics, clinicians will obtain a medical history including information on the patients’ diabetes. A detailed foot health history will capture information regarding foot ulcers, including current or proposed antibiotic treatment and dressings. Foot wounds will be categorised and scored by both the PEDIS27 and Wagner28 ulcer classification systems, along with the Clinical Signs and Symptoms Classification for Infection29 to record details of the index ulcer.
A panel will judge the appropriateness of empirical antibiotic therapy against results of both swab and tissue sample findings. The panel will be blind to the source of sample (tissue sample or swab) and to eliminate bias samples will be unpaired and mixed up for judging purposes. Panel members will be asked to comment on the appropriateness of antibiotic selections.
The sample size is based on the outcome reported ‘presence or absence of isolate’ for the whole sample overall. To be confident that swabs adequately sample wound flora we will assume that the chance corrected agreement between swabs and tissue samples needs to be at least ‘good’: usually defined as a κ>0.6.30
A sample size of 399 patients will provide 80% power for detecting a difference of 3% in the reported presence of any given organism, assuming an overall prevalence for the organism of 10%, a discordance between the swab and tissue samples of 5%, and a two-sided test at the 5% level of significance. This amount of agreement would provide a κ of ∼0.7. This calculation is based on less prevalent organisms, such as Pseudomonas (present in 10% of samples in ref. 21). Based on these analyses we plan to recruit a total of 400 patients.
The κ alone does not convey the distribution of disagreement between swabs and tissue samples and that good overall agreement, with balanced disagreement around the central axis of a table of distributions, would be clinically important if tests were to be regarded as interchangeable. Thus, the total sample size has been based on good agreement between the sample types and reasonably balanced discordance (ie, a small difference due to similar proportions of isolates missed by both swab and tissue sample culture), for clinically important and less prevalent organisms.
The substudy (culture vs molecular techniques) will collect samples from 20 patients to allow an evaluation of the level of agreement and inform a powered, definitive study.
All tests of statistical significance will be two sided with p values and 95% CIs provided, as appropriate. The results will be reported in line with the STARD guidelines.31
All patients registered will be included in the full analysis set. This analysis population will consist of all patients registered to take part in the study, regardless of their adherence to the study protocol or any subsequent discovery of ineligibility. The full analysis set will be used for summarising the patient baseline characteristics.
The evaluable population will consist of all patients with both evaluable swab and tissue samples. Patients for whom either the swab or tissue samples were not successfully collected or were lost, or for whom the sample results were lost will not be included in this patient population. The evaluable population will be used for the summaries and analyses of all endpoints.
A per-protocol population will be considered if there are a considerable number of protocol violations. The per-protocol population will consist of all registered patients who were not defined protocol violators, which includes eligibility violators and protocol deviators. The per-protocol population will be used for the summaries and analyses of all endpoints.
The safety population will consist of the same patients in the full analysis set, and will be used for summarising adverse events (AEs).
Primary endpoint analysis
Reported presence of isolates
For each isolate reported, a cross-tabulation on the semiquantitative extent of growth (none, + to +++) will be generated for swab versus tissue samples, by type of diabetic foot ulcer (neuropathic, ischaemic) and overall and weighted κ will be reported for all tables. Categories + to +++ will be combined to record any reported presence of the isolate.
The corresponding 2×2 table will be created and several statistics will be reported: prevalence and bias-adjusted κ, unadjusted κ and overall percentage agreement.
McNemar's test will be used to test for a difference between swab and tissue sampling techniques in the proportion of samples with the reported isolate present, to further investigate the pattern of disagreement.
Summary of isolates reported
An overall summary of isolates reported will be generated.22 Each pair of results (swab and tissue sample) will be coded as follows: swab and tissue sample report all the same isolates; swab reports same isolates as tissue sample plus extra isolates; tissue sample reports same isolates as swab plus extra isolates; tissue sample and swab report different isolates (with or without overlap in some isolates found).
Multinomial logistic regression will model the proportions in each category on type of ulcer (predominantly neuropathic or ischaemic), grade of ulcer, previous antibiotic therapy, antimicrobial dressing, wound duration and centre, to determine whether agreement is influenced by any of the specified covariates. The reference category will be same isolates reported by both tests; estimates of ORs for each covariate will be presented along with 95% CIs.
Reported presence of antimicrobial resistance among likely isolates
Methicillin-resistant Staphylococcus aureus, methicillin-resistant coagulase-negative staphylococci and vancomycin-resistant Enterococcus species are the three antimicrobial-resistant isolates of most interest. For each of these resistant isolates, 2×2 tables will be created (presence or absence of resistant isolates) and the following statistics will be reported: prevalence and bias adjusted κ, unadjusted κ and overall percentage agreement.
McNemar's test will be used to test for a difference between swab and tissue sampling techniques in the proportion of samples in which the specified resistant isolate is reported.
For each resistant isolate the following codes will be created: resistant isolate reported by swab but not tissue sample, resistant isolate reported by tissue sample but not swab, swab and tissue sample results agree. Multinomial regression modelling will model these categories on type of ulcer (predominantly neuropathic or ischaemic), grade of ulcer, current antibiotic therapy, antimicrobial dressing, wound duration and centre to determine whether agreement is influenced by any of the specified covariates.
Number of isolates reported
Summaries (including cross-tabulations) on the number of isolates reported per specimen will be generated for swab versus tissue samples. Samples will be further coded as follows: tissue sample had two or more extra isolates reported, tissue sample had one extra isolate reported, tissue sample and swab had the same number of isolates reported, swab had one extra isolates reported or swab had two more extra isolates reported.
Ordinal logistic regression will model the number of isolates reported per specimen on type of ulcer (ie, predominantly neuropathic or ischaemic), grade of ulcer, previous antibiotic therapy, antimicrobial dressing, wound duration and centre, to determine whether agreement is influenced by any of the specified covariates. The reference category will be the same number of isolates reported by both tests; estimates of ORs for each covariate will be presented along with 95% CIs.
Secondary endpoint analysis
Appropriateness of empirical antibiotic therapy
Summaries (including cross-tabulations) will be generated for the codings: no change to therapy required, possible change of therapy following the review of clinical course of the patient, definite change of therapy required. The first two categories will be combined and the resultant 2×2 table analysed using McNemar's test to determine if one test identifies significantly more patients requiring a definite change in treatment.
Sample pairs will be further coded: results from the swab but not the tissue sample indicates change in therapy, results from the tissue sample but not the swab indicates a change in therapy, swab and tissue sample in agreement on change in therapy. Multinomial regression modelling will model these categories on type of ulcer (predominantly neuropathic or ischaemic), grade of ulcer, previous antibiotic therapy, antimicrobial dressing, wound duration and centre to determine whether agreement is influenced by any of the specified covariates.
Number and presence of isolates reported using molecular or culture techniques
Summaries (including cross-tabulations) on the number of isolates per specimen reported will be generated.
An overall summary of isolates reported using culture and molecular techniques will be generated for both the swab and tissue samples. Each pair of results (from molecular and culture techniques) will be coded as follows: molecular and culture report the same isolates; molecular reports same isolates as culture plus extra isolates; culture reports same isolates as molecular plus extra isolates; the culture and molecular report different isolates (with or without overlap in isolates found).
Safety analyses will summarise all AEs, serious AEs and related unexpected serious AEs. The number of events and number of patients with events will be summarised.
Sampling costs will be summarised for each technique.
Diabetic foot ulcers are highly prevalent and cause considerable morbidity at both the individual and population level.1 ,8 ,10 The combination of a chronic wound and impaired immune defences that may occur in diabetes frequently results in infection; although the sequelae of these complications range in severity, diabetic foot infection precedes 80% of non-traumatic lower limb amputations.6 ,13 ,14 Part of the effective treatment of these infections is providing targeted antibiotic therapy to improve patient outcome and reduce resistance to broad spectrum antibiotics.15–17 Despite this, there is a lack of robust evidence to advise clinicians on the best technique to identify pathogens in diabetic foot ulcers.
Concordance in diabetic foot ulcer infection (CODIFI) will generate robust data to evaluate and compare the two most commonly used wound sampling techniques. This holds immediate relevance for all clinicians working with diabetic foot ulcers.
CODIFI has received ethical approval from the Sheffield NRES Committee (Ref: 11/YH/0078) and all sites have obtained local approvals prior to commencing recruitment. The study is listed on the UKCRN portfolio (UKCRN ID: 10440) and International Standard Randomised Controlled Trial Number Register (ISRCTN: 52608451). Recruitment opened ahead of schedule in November 2011 and is due to be completed by the end of March 2013.
We thank members of the study steering committee (Professor J Deeks, Professor R Cooper, Professor R Gadsby, Dr AM Keenan and C Thomas) and the study management group (Professor C Dowson, Professor B Lipsky, Dr E Jude and T Dickie, Dr C Amery, G Sykes, Professor P Vowden, Professor M Edmonds).
Contributors The study was initiated by EAN, who drafted the original study protocol, commented on the draft paper and acts as the chief investigator and guarantor. MRB, MSB, AWH, JN, SB, BL and JG contributed to the study methodology and MRB, MSB, AWH, JN and SB to daily management. MRB drafted the manuscript which all authors commented on and approved the final version. SB was involved in drafting the study protocol and has input into the statistical analysis plan. AWH has drafted and input into the statistical analysis plan.
Funding This project was funded by the NIHR Health Technology Assessment programme (project number 09/75/01) and will be published in full in Health Technology Assessment. The views and opinions expressed herein are those of the authors and do not necessarily reflect those of the HTA programme, NIHR, NHS or the Department of Health.
Competing interests None.
Ethics approval Sheffield NRES Committee (Ref: 11/YH/0078).
Provenance and peer review Not commissioned; externally peer reviewed.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.