Article Text

Download PDFPDF

A study protocol for an observational cohort investigating COGnitive outcomes and WELLness in survivors of critical illness: the COGWELL study
  1. M Elizabeth Wilcox1,
  2. Andrew S Lim2,
  3. Mary P McAndrews3,
  4. Richard A Wennberg4,
  5. Ruxandra L Pinto5,
  6. Sandra E Black2,
  7. Karolina D Walczak1,
  8. Jan O Friedrich6,
  9. Michael S Taglione1,
  10. Gordon D Rubenfeld5
  1. 1 Department of Medicine (Critical Care Medicine), University of Toronto, University Health Network, Toronto, Canada
  2. 2 Department of Medicine (Neurology), University of Toronto, Sunnybrook Health Sciences Centre, Toronto, Canada
  3. 3 Department of Psychology, University of Toronto, University Health Network, Toronto, Canada
  4. 4 Department of Medicine (Neurology), University of Toronto, University Health Network, Toronto, Canada
  5. 5 Department of Medicine (Critical Care Medicine), University of Toronto, Sunnybrook Health Sciences Centre, Toronto, Canada
  6. 6 Department of Medicine (Critical Care Medicine), University of Toronto, St. Michael’s Hospital, Toronto, Canada
  1. Correspondence to Dr M Elizabeth Wilcox; elizabeth.wilcox{at}


Introduction Up to 9 out of 10 intensive care unit (ICU) survivors will suffer some degree of cognitive impairment at hospital discharge and approximately half will have decrements that persist for years. The mechanisms for this newly acquired brain injury are poorly understood. The purpose of this study is to describe the prevalence of sleep abnormalities and their association with cognitive impairment, examine a well-known genetic risk factor for dementia (Apolipoprotein E ε4) that may allow for genetic risk stratification of ICU survivors at greatest risk of cognitive impairment and determine if electroencephalography (EEG) is an independent predictor of long-term cognitive impairment and possibly a candidate intermediate end point for future clinical trials.

Methods and analysis This is a multisite, prospective, observational cohort study. The setting for this trial will be medical and surgical ICUs of five large tertiary care referral centres. The participants will be adult patients admitted to a study ICU and invasively ventilated for ≥3 days . Participants will undergo follow-up within 7 days of ICU discharge, 6 months and 1 year. At each time point, patients will have an EEG, blood work (biomarkers; gene studies), sleep study (actigraphy), complete a number of questionnaires as well as undergo neuropsychological testing. The primary outcome of this study will be long-term cognitive function at 12 months follow-up as measured by the Repeatable Battery for the Assessment of Neuropsychological Status and Trails Making Test B.

Ethics and dissemination The study has received the following approvals: University Health Network Research Ethics Committee (13–6425-BE), Sunnybrook Health Centre Research Ethics Committee (365–2013), Mount Sinai Research Ethics Committee (14–0194-E) and St. Michael’s Hospital Research Ethics Committee (14-295). Results will be made available to critical care survivors, their caregivers, the funders, the critical care societies and other researchers.

Trial registration number NCT02086877; Pre-results.

  • Critical Illness

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See:

Statistics from

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and weaknesses of this study

  • COGWELL will provide the first multisite, comprehensive study to investigate sleep and circadian function, rhythmic cortical electrophysiological activity measured by quantitative electroencephalography and long-term cognitive impairment in survivors of critical illness.

  • Our longitudinal study design will allow us to look at changes over time in the same patient, defining the temporal sequence of changes and providing stronger evidence for causality.

  • Based on strong scientific reasoning from other patient populations, if true, our genomic association theory would provide a way of identifying susceptible individuals who may benefit most from intervention strategies.

  • The primary limitation of this study is loss to follow-up and missing data points that would challenge the internal validity of reported results from COGWELL.



Cognitive outcomes have been evaluated in various intensive care unit (ICU) patient populations: mixture of patients who are critically ill and who required prolonged mechanical ventilation,1 2 survivors of sepsis and septic shock3 4 and medical patients who underwent elective surgery.5 Impaired cognition was seen in several domains at varying time periods. Cognitive impairment was seen in 39%–91% of patients at hospital discharge, 13%–79% at 3–6 months follow-up and 20%–71% at 1 year.6 Little is known regarding the interactions between identifiable risk factors (host factors and acute events in the ICU and after ICU discharge) and cognitive function after critical illness. Moreover, there are few objective tools with which to risk stratify patients with regard to persistent cognitive dysfunction. Identifying objective risk factors and risk markers are first steps towards developing and effectively targeting interventions to prevent post-ICU cognitive impairment.

Current knowledge

Sleep disorders

There is considerable evidence linking sleep-disordered breathing and poor sleep quality with cognitive impairment in a variety of patient populations.7–11 Cognitive domains particularly associated with sleep disruption include working memory, semantic memory, processing speed and visuospatial abilities.8 Experimental studies support a number of potential neurobiological mechanisms including accumulation of beta amyloid pathology,12 13 abnormalities of tau,7 synaptic abnormalities,14 changes in hippocampal long-term potentiation,15 impaired hippocampal neurogenesis16 17 and gene expression changes.18 The appeal of sleep and circadian dysfunction as potential mechanisms mediating post-ICU cognitive impairment is that effective interventions exist to improve sleep and circadian function.

Few studies have rigorously evaluated the prevalence of sleep disruption after critical illness and its potential role in potentiating cognitive impairment. A prospective multicentre cohort study (n=1625) reported no change in self-reported sleep quality in the year following critical illness using a non-validated single instrument assessment.19 However, subjective reports of sleep quality can be confounded by poor recall and misperception. A second small case series reported sleep disruption and poor sleep efficiency as measured by polysomnography in five out of seven survivors of Acute Respiratory Distress Syndrome  each of whom reported sleep difficulties 6 months after hospital discharge.20 Neither study reported cognitive outcomes. A study demonstrating the prevalence of sleep abnormalities after critical illness and their longitudinal association with cognitive impairment would yield potential targets for therapy and novel endpoints for ICU-based studies.

Proteomics and genomics

The Apolipoprotein E (APOE) ε4 allele is a well-established and common genetic risk factor for Alzheimer’s  disease21–23 and is also a risk factor for cognitive impairment in a number of medical conditions including sleep apnea11 24 25 and following repeated head trauma.26 Recently, in a longitudinal cohort of 737 community dwelling older adults without dementia, the APOE ε4 allele was shown to accentuate the impact of sleep fragmentation on the risk of incident Alzheimer’s disease in older persons, an effect that was mediated by the accumulation of tau pathology.7 27 In individuals with high sleep fragmentation, the presence of at least one APOE ε4 allele (APOEε4 +/− or +/+) was associated with a three times faster rate of cognitive decline as compared with individuals not carrying an APOE ε4 allele (APOEε4 −/−).7

Although there are no large studies of genetic susceptibility to cognitive impairment following critical illness, data suggest the APOE ε4 allele can have dramatic effects on the acute cognitive status of critically ill patients. In one study, the APOE ε4 allele was associated with a sevenfold increase in the odds of a long duration of delirium (OR 7.3; 95% CI 1.8 to 30).28 The presence of APOE ε4 was found to have a stronger association with duration of delirium than age, severity of illness score (APACHE II), sepsis or benzodiazepine use.28 Although the duration of delirium is associated with worse cognitive performance after the ICU, the specific role of the APOE ε4 genotype in this association is unknown. Recent work in elderly patients who are non-critically ill found that administration of benzodiazepines in healthy elderly subjects (n=42) with the APOE ε4 allele was associated with more pronounced cognitive impairment and slower to recover cognitive functioning.29 30 This association was found to be independent of deranged pharmacokinetics. Thus, the possibility arises that APOE ε4 may herald a more pronounced vulnerability to a number of brain insults, including drug-related brain toxicity.

This study may identify APOE genotype as a biological marker of susceptibility to cognitive impairment and the disruptive effects on sleep following ICU discharge. If this is true, then APOE ε4 positive individuals may represent a subpopulation of critical illness survivors who may benefit from particularly close cognitive monitoring and early intervention to improve sleep and circadian function.


Studies have so far been unable to identify patients at higher risk of long-term cognitive impairment using screening tools at hospital discharge. For example, in a study by Woon and colleagues, neither the Folstein Mini Mental Status Examination or MiniCog performance at hospital discharge predicted cognitive impairment at 6 month follow-up.31 Performance on more sensitive tests of cognitive impairment may have predictive value, but these have not been evaluated. This lack of predictive ability restricts the capacity of clinicians and researchers to adequately risk stratify patients with regard to the likelihood of cognitive impairment.

One candidate predictor for cognitive impairment is quantitative electroencephalography (EEG). Serial quantitative EEG has been used to diagnose delirium in older patients (n=25) with and without underlying dementia on an inpatient geriatric psychiatry service.32 Not only did quantitative EEG (amount of slow wave activity in theta and delta frequencies) prove sensitive, as compared with the clinical exam, for the diagnosis of delirium across a range of underlying aetiologies (medication intoxication, hypoxia, electrolyte disturbances and so on), it also measured severity of delirium. In the ICU, quantitative EEG has also been found to be a sensitive predictor of mortality in patients with severe sepsis, with well-defined categories (numerical and qualitative variables: no encephalopathic changes, mild encephalopathy and severe encephalopathy) of progressively slower EEG waveforms associated with an increased risk of death, with the highest risk associated with burst suppression.33 34 Similar findings were found in a prospective observational study in medical ICU patients, where burst suppression was found to be an independent predictor of death at 6 months.35 Finally, a recent case series of sepsis survivors showed EEG to be a possible candidate predictor of cognitive impairment. Deficits in verbal learning and memory were associated with low-frequency activity on routine EEG at 6–24 months following hospital discharge (indicative of non-specific brain dysfunction).4 This study is supportive of our study hypothesis but is insufficient to answer the question of whether EEG could be used as a predictive tool in studying cognitive function after critical illness as it was limited by small sample size (n=25) and inadequate control of time, as follow-up was not standardised (single data collection point per patient; range of 6–24 months).4

Although it is likely an imperfect tool, EEG may be able to provide prognostic information. If quantitative EEG is linked with long-term cognitive outcomes, it may serve as a good intermediate endpoint in therapeutic trials assessing interventions to decrease the risk of post-ICU cognitive impairment.

Study aims

Research hypothesis and aims

We hypothesise that critical illness will be associated with decrements in sleep and circadian function, quantifiable by actigraphy, that are in turn associated with worse cognitive performance in ICU survivors at 6 and 12 months after hospital discharge. Second, APOE genotype will be a risk factor for cognitive impairment following a number of brain insults (eg, intermittent hypoxia, sleep disruption) and may modify the effect of sleep fragmentation on cognition in ICU survivors. APOE genotype may help predict the trajectory of recovery from critical illness, specifically with respect to cognitive impairment. Finally, we hypothesise that survivors of critical illness with cognitive dysfunction will have a greater proportion of low frequency versus high frequency cortical electrophysiological activity compared with survivors without cognitive dysfunction. EEG will be a predictor of long-term cognitive impairment and therefore could serve as a surrogate endpoint for clinical trials.

To test our first hypothesis, we will determine the impact of sleep and circadian disruption on long-term cognitive impairment in survivors of critical illness. Further, we will determine the relationship among the APOE genotype, sleep disruption and cognitive impairment in a cohort of survivors of critical illness. This is an exploratory aim to examine for direct associations between APOE genotype and cognitive function as well as for gene and environment interaction (eg, APOE and sleep fragmentation interaction) effects on cognitive function. Finally, we will determine the relationship between rhythmic cortical electrophysiological activity, measured by serial quantitative EEG and long-term cognitive outcomes in a cohort of patients who have survived critical illness and are clinically stable prior to hospital discharge.

Methods and analysis

Study protocol

This is a multisite, prospective, observational cohort study involving five teaching hospitals (Toronto Western Hospital, Toronto General Hospital, St. Michael’s Hospital, Mount Sinai Hospital and Sunnybrook Health Sciences Centre) at the University of Toronto. Study patients will enter the cohort after they have been mechanically ventilated for at least 3 days, after they meet inclusion/exclusion criteria (see table 1), and they have survived to ICU discharge. Trained research personnel will obtain informed consent from the patient or their next of kin (see online supplementary file 1). Patients will leave the cohort 1 year after discharge from ICU or at the time of death.

Table 1

Inclusion and exclusion criteria

At the time of enrolment, we will record the following data: baseline demographic, admission diagnosis and dates, severity of illness (APACHE II); burden of comorbid illness using Charlson36 and Elixhauser37 comorbidities scores; pre-existing cognitive impairment by Informant Questionnaire on Cognitive Decline in the Elderly Short Form (IQCODE-SF); ICU and hospital length of stay (LOS).

Study personnel blinded to study hypothesis will prospectively collect data on important confounders such as haemodynamic and ventilator parameters, glycaemic control and the presence or absence of delirium on a daily basis. At the time of study enrolment, information collected on each patient will include the following: APACHE II disease category, patient demographics, dates of hospital and ICU admission, initial date of mechanical ventilation, admission diagnosis, history of comorbid disease(s) present at the time of ICU admission captured by the Charlson and Elixhauser Comorbidity Scales and pre-existing dementia by the IQCODE-SF. During the course of each patient’s stay in the ICU data will be collected on: acute lung injury score, Sequential Organ Failure Assessment Score and APACHE II score; mean PaO2 of oxygen (PaO2)/fraction of inspired oxygen (FiO2), mean arterial pressure and blood glucose, daily mean Riker’s sedation agitation score, Confusion Assessment Method in the ICU status and average daily doses of the following medications: benzodiazepines, propofol, narcotics and dexmedetomidine. All patients will undergo standardised follow-up prior to hospital discharge and at 6 and 12 months. Outcome variables will be collected at each time point (see figure 1). A trained assessor blinded to our study hypothesis will perform all cognitive assessments. Study participants will be identified with a study number only. No identifying information will be transferred outside of the participating hospital site.

Figure 1

Flow diagram of the COGnitive Outcome and WELLness in survivors of critical illness (COGWELL) study. APOE, Apolipoprotein E; CAM-ICU, Confusion Assessment Method in the ICU; EEG, electroencephalography; ICU, intensive care unit; IQCODE-SF, Informant Questionnaire on Cognitive Decline in the Elderly Short Form; PSQI, Pittsburgh Sleep Quality Index; RBANS, Repeatable Battery for the Assessment of Neuropsychological Status; TICS, Telephone Interview for Cognitive Status.

Measurement of exposures and confounders


Actigraphy is the continuous measurement of an individual’s movement using a wristwatch-like device (Actiwatch Spectrum, Phillips Respironics, Bend, Oregon, USA) and is an objective method of quantifying sleep and circadian rhythms. It has been validated against polysomnography for the measurement of total sleep time and sleep fragmentation7 38 and validated against biochemical markers for the assessment of circadian rhythmicity.39 All patients will have an actigraph placed on their non-dominant wrist days within 1 week of ICU discharge. Recordings will continue while on the inpatient ward; however, the number of days of actigraphic data recorded in hospital is likely to vary depending on severity of illness and trajectory of recovery. If patients are discharged home or to a rehabilitation facility prior to attaining 10 days of actigraphic data, the patient will be asked to continue the recording and return the actigraph to the study centre by prepaid courier. Patients will return to follow-up clinic at 6 and 12 months where actigraphs will be worn again for 10 days as an outpatient.

All actigraph data will be analysed using MATLAB (Mathworks, Natick, Massachusetts, USA). Markers of sleep and circadian function will include: (1) circadian timing (average time of the activity acrophase (midpoint of 8 consecutive hours) of each 24 hours of greatest activity), (2) sleep duration (determined by the Cole-Kripke algorithm), (3) sleep fragmentation (quantified by KRA)7 8 40 and (4) regularity of circadian rhythmicity (determined using the χ2 periodogram).41

Richards-Campbell Sleep Questionnaire (RCSQ)

This is a five-item, visual analogue scale designed to assess the perception of sleep in patients who are critically ill.42 The scale evaluates perceptions of depth of sleep, sleep onset latency, number of awakenings, time spent awake and overall sleep quality. Patients will complete the questionnaire as they reflect on their last night’s stay in the ICU prior to ward discharge.

Pittsburgh Sleep Quality Index (PSQI)

The PSQI is a self-rated questionnaire, assessing sleep quality over a 1-month time interval. Nineteen individual items generate seven ‘component’ scores: subjective sleep quality, sleep latency, sleep duration, habitual sleep efficiency, sleep disturbances, use of sleeping medication and daytime dysfunction. The sum of scores for these seven components yields one global score; a global PSQI score greater than 5 yielded a diagnostic sensitivity of 89.6% and specificity of 86.5% in distinguishing good and poor sleep quality.43 Patients will complete the questionnaire first, while in hospital, to identify any pre-existing sleep disorders (reporting on their sleep the month prior to hospitalisation) and then again at 6 and 12 months, reporting perceived reasons for impaired sleep, if any, the month prior to each follow-up appointment.

Genomics (APOE)

The APOE coding single-nucleotide polymorphism sites rs7412 and rs429358 will be determined using the Invitrogen Snapshot assay at The Centre for Applied Genomics at The Hospital for Sick Children Hospital (Toronto, Ontario, Canada; Blood samples (5–10 mL) will be drawn prior to discharge in a lavender top ethylenediaminetetraacetic acid tube. Blood will be stored at −20°C prior to being shipped for testing at The Hospital for Sick Children Hospital.


Within 7 days after ICU discharge, approximately 30 min of EEG activity will be digitally acquired (XLTEK, Oakville, Ontario, Canada) with electrodes placed according to the international 10–20 system with additional surface sphenoidal electrodes. In outpatient follow-up, at 6 and 12 months, 30 min of EEG activity will be recorded. Data sampling will occur at a rate of 256 Hz. Power spectra will be calculated for consecutive 4-s windows for each electrode contact and absolute spectral band power for conventional EEG frequency bands (δ: 0.5–4 Hz; θ: 4–8 Hz; α: 8–13 Hz; β: 13–20 Hz; γ: 20–40 Hz) will be averaged across different windows. Given that global changes are expected, the band power values will be averaged over all electrode contacts. Similar measures have been previously used to characterise Alzheimer’s disease and depression and, in the former, were correlated with clinical measures of severity of dementia.44–46

Beck’s Depression Inventory (BDI-II)

This instrument screens for depression using criteria consistent with the Diagnostic and Statistical Manual of Mental Disorders—Fourth Edition. Higher scores (range, 0–63) indicate more depressive symptoms. Based on testing in psychiatric outpatients, depression symptom severity is classified as minimal (score, 0–13), mild (score, 14–19), moderate (score, 20–28) and severe (score, 29–63).47 The BDI-II will be performed after each neuropsychological assessment as depression could confound our primary outcome, cognition. Recently, the BRAIN-ICU study, a prospective cohort of mixed medical, surgical and cardiac patients, reported that regardless of age, executive dysfunction was independently associated with subsequent worse severity of depressive symptoms and worse mental health related quality of life.48

The Informant Questionnaire on Cognitive Decline in the Elderly Short Form (IQCODE-SF)

The IQCODE-SF is a brief questionnaire that uses information provided by an informant (typically a close relative) to assess a person’s change in cognitive functioning over the preceding 10 years. The questionnaire is often used as a screening test to detect dementia. The standard method used to generate the test score is to take the average rating across 16 situations. A person who has no cognitive decline will have an average score of 3, while scores of greater than 3 indicate that some decline has occurred.49

Measurement of outcomes: long-term cognitive morbidity

Repeatable Battery for the Assessment of Neuropsychological Status (RBANS)

The RBANS is a comprehensive and validated neuropsychometric battery for the evaluation of global cognition, including individual domains of immediate and delayed memory, attention, visuospatial construction and language.50 The population age-adjusted mean (±SD) for the RBANS global cognition score and for the individual domains is 100±15 (on a scale ranging from 40 to 160, with lower scores indicating worse performance). The RBANS has been validated in diverse patient populations including those with mild cognitive impairment, moderate to severe traumatic brain injuries, vascular dementias and Alzheimer’s Disease.51–54

Trailing making tests A and B

Executive function (specifically, cognitive flexibility) will be tested using the Trail Making tests A and B; age-adjusted, sex-adjusted and education-adjusted mean T score is 50 (range 0–100), with lower score indicating poor performance.55

Telephone Interview for Cognitive Status (TICS)

The TICS instrument will be used as a secondary means to assess cognitive outcome prior to hospital discharge, as well as at 6-month and 12-month follow-up. It is made of 11 test items: 10 word immediate and delayed recall tests of memory, a serial 7-s subtraction test of working memory, counting backwards to assess attention and processing speed, an object naming test to assess language and recall of the date and US president (or Canadian prime minister) to assess orientation.56 Composite scores using all the items create a measure of cognitive functioning, which can range from 0 to 35. It takes approximately 10 min to administer and score. T-scores are based on normative data from 6726 persons.56 In an effort to minimise loss to follow-up when in-depth neuropsychological testing cannot be performed due to patient time pressures, we will administer this less burdensome instrument. The TICS tool has been extensively validated; it was the cognitive assessment tool used in the Health and Retirement Study to make national estimates of dementia and cognitive impairment without dementia (CIND) in the US (n=30 000).57 Its performance was determined against a detailed neuropsychological and clinical assessment in a smaller subsample. The overall levels of dementia and CIND estimated using TICS was similar to those directly estimated from the neuropsychological study. The TICS was found, however, to be less sensitive at discriminating between normal cognitive function and mild cognitive impairment.58

Statistical analysis plan

Assessing the epidemiology of long-term cognitive impairment will focus on prevalence, severity and natural history. Prevalence will be determined based on binary assessment of patient having or not having clinically significant cognitive impairment, defined as test scores 1 SD below the population mean on the RBANS global cognition score. We will screen the covariates using the univariate association between the outcome and level of education, RCSQ and PSQI scores, BDI-II, hospital LOS and days of mechanical ventilation and selecting those with p<0.2. Logistic regression analysis models will be used to determine the association between sleep fragmentation and cognitive impairment at 1 year while adjusting for the variables selected. We will enter into the model only those covariates that are not multicollinear based on the variance inflation factor criterion. Given that we predict we will have approximately 30 events at the 1-year follow-up, this will give us at least five events per variable.59

Generalised estimating equations models, to take into account the correlation between the three measurements per subject, will be used to determine the association of EEG and the effect of time on cognitive impairment. We will test the association between APOE ε4(+/− or +/+) versus APOE ε4(−/−) and cognitive impairment using χ2 test. The degree of association between APOE and sleep efficiency will be determined using Spearman’s correlation; this information will be used to inform future trials.

We calculated our sample size based on logistic regression analysis with outcome cognitive impairment at 12 months. We used a proportion of 30% cognitive impairment at 1 year in this patient population. We do not know a priori the association between our sleep efficiency variable and the other covariates, so we will use a range of R-squared (R-squared obtained by regressing the sleep efficiency variable on the other covariates) from low to moderate (0.1–0.5). With a sample size of approximately 110, we have 80% power with α=0.05 for R-squared=0.5 to detect an absolute increase in percentage of cognitive impairment of 20% (from 30% to 50%) for a decrease in sleep efficiency value with 1 SD from the mean or an increase of 15% (from 30% to 45%) for a R-squared=0.2. With 110 patients, approximately 20% in the APOE ε4(+/− or +/+) group, a χ2 test at α=0.05 will be able to detect a 37.5% difference (25% in the APOE ε4(−/−) group and 62.5% in the APOE ε4(+/− or +/+) group) in the cognitive impairment group with about 92% power or about 80% power to detect a difference of 31% (25% in the APOE ε4(−/−) group versus 56% in the APOE ε4(+/− or +/+) group).

A total of approximately 150 patients will be consented to participate. This estimate is based on a calculated 1-year mortality rate of 15% in patients discharged from critical care units and a conservative loss to follow-up rate of 15%.

Methodological issues

Our longitudinal study design, in which parallel covariates are reliably and repeatedly measured over time, will allow us to look at changes over time in the same patient, defining the temporal sequence of changes and providing stronger evidence for causality than could be obtained from a cross-sectional design. Although our genomic association theory is an exploratory aim, it is based on strong scientific reasoning from other patient populations and if our hypothesis is true, would provide an easy way of identifying susceptible individuals who may benefit the most from interventions to decrease the risk of cognitive impairment.

The primary limitation of this study is loss to follow-up and missing data points that would challenge the internal validity of reported results from COGWELL. However, our research team has extensive experience in achieving high follow-up rates in similar studies of cognitive function and long-term follow-up of patients who are critically ill.60–64 Efforts to minimise loss to follow-up will include respecting the time commitment of patients, formal tracking procedures of patients enrolled including acquiring of multiple contacts for arranging follow-up, strong interpersonal skills of study personnel and flexible hours for testing.65

Data management and oversight

Site investigators will take responsibility for the conduct of COGWELL. Site investigators will supervise the day-to-day operation of the project and are responsible for ensuring that International Conference on Harmonisation Good Clinical Practice guidelines are followed.

Members of the COGWELL research team from the University Health Network will monitor the data. Members will review the first three completed charts from each site as well as a random sample of 10% of completed data thereafter. Monitoring will ensure protocol compliance, proper study management and timely completion of study procedures.

Protocol and registration

This study is registered with (NCT02086877).

Data storage and security

Data will be stored on institutional network drives with firewalls and security measures in place. Hard copy records will be stored in a locked cabinet in a secure location. Access to records and data will be limited to study personnel. Study data will be de-identified and a master linking log with identifiers will be kept and stored separately from the data.


The authors thank E. Wesley Ely, Margaret Herridge and Jill Cameron for their valuable comments on drafts of this protocol.


  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
  46. 46.
  47. 47.
  48. 48.
  49. 49.
  50. 50.
  51. 51.
  52. 52.
  53. 53.
  54. 54.
  55. 55.
  56. 56.
  57. 57.
  58. 58.
  59. 59.
  60. 60.
  61. 61.
  62. 62.
  63. 63.
  64. 64.
  65. 65.


  • Contributors The study concept and design was conceived by MEW, ASL, MPM, RAW, SEB and GDR. KDW, MST, JOF and MEW will conduct screening and data collection. Analysis will be performed by RLP. MEW prepared the first draft of the manuscript. All authors provided edits and critiqued the manuscript for intellectual content.

  • Funding This work was supported by Physician Services Incorporated grant number 13-42-COGWELL.

  • Competing interests None declared.

  • Patient consent Detail has been removed from this case description/these case descriptions to ensure anonymity. The editors and reviewers have seen the detailed information available and are satisfied that the information backs up the case the authors are making.

  • Ethics approval University Health Network Research Ethics Committee (13-6425-BE), Sunnybrook Health Centre Research Ethics Committee (365-2013), Mount Sinai Research Ethics Committee (14-0194-E) and St. Michael’s Hospital Research Ethics Committee (14-295).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement The final trial dataset will be available to study investigators, Steering Committee members and the Research Ethic Boards at all participating sites.