Purpose In the Simple Intensive Care Studies-I (SICS-I), we aim to unravel the value of clinical and haemodynamic variables obtained by physical examination and critical care ultrasound (CCUS) that currently guide daily practice in critically ill patients. We intend to (1) measure all available clinical and haemodynamic variables, (2) train novices in obtaining values for advanced variables based on CCUS in the intensive care unit (ICU) and (3) create an infrastructure for a registry with the flexibility of temporarily incorporating specific (haemodynamic) research questions and variables. The overall purpose is to investigate the diagnostic and prognostic value of clinical and haemodynamic variables.
Participants The SICS-I includes all patients acutely admitted to the ICU of a tertiary teaching hospital in the Netherlands with an ICU stay expected to last beyond 24 hours. Inclusion started on 27 March 2015.
Findings to date On 31 December 2016, 791 eligible patients fulfilled our inclusion criteria of whom 704 were included. So far 11 substudies with additional variables have been designed, of which six were feasible to implement in the basic study, and two are planned and awaiting initiation. All researchers received focused training for obtaining specific CCUS images. An independent Core laboratory judged that 632 patients had CCUS images of sufficient quality.
Future plans We intend to optimise the set of variables for assessment of the haemodynamic status of the critically ill patient used for guiding diagnostics, prognosis and interventions. Repeated evaluations of these sets of variables are needed for continuous improvement of the diagnostic and prognostic models. Future plans include: (1) more advanced imaging; (2) repeated clinical and haemodynamic measurements; (3) expansion of the registry to other departments or centres; and (4) exploring possibilities of integration of a randomised clinical trial superimposed on the registry.
Study registration number NCT02912624; Pre-results.
- Adult intensive & critical care
- Accident & emergency medicine
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
- Adult intensive & critical care
- Accident & emergency medicine
Strengths and limitations of this study
The large prospective design is powered to evaluate the value of combinations of clinical and haemodynamic variables for guiding decisions in acutely admitted critically ill patients.
The flexible simple design allows expansions in time and/or place and/or other research questions.
The basic study is limited to a one-time evaluation of variables.
Critical care ultrasound measurements are not obtainable in all critically ill patients due to positioning issues or insufficient image quality.
Circulatory shock occurs in about one-third of all critically ill patients.1 These patients have an increased risk of multiorgan failure, long-term morbidity and mortality.2 3 A recent consensus statement on circulatory shock recommends to use a combination of clinical, biochemical and/or haemodynamic variables, varying from simple to advanced, for establishing the diagnosis and instigation of treatment.4 The consensus advocates frequent measurement of heart rate, blood pressure, body temperature, skin perfusion, urine output and mental status.4 If necessary, more advanced and sequential haemodynamic assessments using critical care ultrasound (CCUS) as preferred modality are recommended.4–7 Previous studies have found different prognostic or diagnostic variables, many have presented single or dual variable associations and no research has evaluated their additional value on top of the accepted predictors. Different studies highlight different predictors of mortality: low blood pressures,8–11 increased lactate levels,8 9 11–14 prolonged capillary refill times,15–17 skin mottling,18–20 oliguria21 22 and decreased cardiac output23 24 are identified as prognostic variables. These contrasting results are also seen in studies that investigated the value of clinical and biochemical variables for diagnosing shock.17 18 23 25–34 The reason for inconsistency of results in these studies potentially originate from several methodological flaws, including improper research design, lack of confirmation cohorts and power and sample size issues. Several studies selected specific subpopulations (eg, patients with sepsis,8–11 13 17 18 33 acute cardiac failure16 23 or trauma15) and some had a retrospective design or used convenience samples from large databases.9–12 15 20 21 Most studies analysed single variable associations rather than evaluating their additional predictive value on top of the widely accepted variables using multivariate models.8 17 18 21 23 Also, most had relatively small sample sizes.8–10 12 15–18 23 24 33
Both clinical and haemodynamic variables used for diagnosing shock are currently recommended as ‘best practice’.4 Both the consensus and the Surviving Sepsis Campaign guideline recommend further haemodynamic assessment (such as cardiac function) to determine the type of shock if the clinical examination does not lead to a clear diagnosis (best practice statement).4 35 Less invasive devices are recommended instead of more invasive devices only when they have been validated in the context of patients with shock.4 36
The additive diagnostic and prognostic value of combinations of clinical, biochemical and haemodynamic variables remains to be established with a higher quality of evidence. These variables have never been evaluated collectively in a large, unselected, prospective cohort of critically ill patients. Therefore, we established the Simple Intensive Care Studies-I (SICS-I) with the aim to evaluate the diagnostic and prognostic value of a comprehensive selection of clinical and haemodynamic variables in the critically ill. This paper describes the study protocol with the diagnostic and prognostic aims of the basic study as well as the characteristics of the patients included in the cohort so far. All substudies will be presented here for illustrative purposes without elaborating on each specific rationale and design.
This prospective cohort study is conducted in the Department of Critical Care of the University Medical Center Groningen (UMCG), a tertiary teaching hospital in the Northern part of the Netherlands. Our intensive care unit (ICU) has 44 beds divided over four subunits to which all types of critically ill adult patients are admitted. In our department, CCUS is available if considered indicated to inform practice but is not performed in each patient each day. We initiated our study in one unit to deal with start-up issues and to assess feasibility, including (1) whether it was logistically possible to include a broad population of acutely admitted critically ill patients, (2) whether all clinical and haemodynamic measurements could be recorded within a limited time so that it did not obstruct routine patient care and (3) whether novices could obtain CCUS images of sufficient quality after training. The entire study was purely observational in design; no interventions were applied. After inclusion of our first patient on 27 March 2015, we gradually expanded inclusions to all the four subunits of the department within 1 year.
All acutely admitted adult critically ill patients expected to stay beyond 24 hours were included on their first day of ICU admission. The attending intensivist estimated the expected duration of ICU treatment. Inclusions and measurements were obtained by medical research interns and PhD students who were not in any way involved in patient care. All measurements, including CCUS findings, were not revealed to the care providers. If any possible abnormality was observed by CCUS, an independent qualified intensivist was contacted for judgement of informing the attending intensivist. All researchers underwent a focused CCUS training by experienced cardiologist-intensivists. Following hospital regulations, patients or their legal representatives were informed and were excluded if they refused to participate. Other reasons for exclusion were acute psychiatric disorders, mental retardation, serious language barriers, continuous resuscitation efforts or mechanical circulatory support. The local institutional review board (Medisch Ethische Toetsingscommissie (METc) of the UMCG; M15.168207) approved the main study and the additional measures added when initiating the substudies (METc M11.104639 and M16.193856).
Registry, substudies and research questions
The cohort study was designed to register a set of baseline clinical, biochemical and haemodynamic variables in each included patient. In the initial basic study, we collected baseline demographic data, clinical data by protocolised physical examination and CCUS data to measure cardiac output (see online supplementary file 1). The co-primary aims are to determine the association between variables measured by physical examination and cardiac output and to assess the prognostic value of both the clinical and haemodynamic variables for 90-day mortality. The flexible design in terms of research questions, planning and data collection allows incorporation of substudies with additional measurements to assess the feasibility in terms of the quality of the measurements (figure 1). The designed substudies with their specific research questions and (temporarily) added variables are listed in table 1. After completion of SICS-I, we will analyse the variables to establish an optimised basic set of variables as SICS-II (figure 1).
Supplementary file 1
On inclusion, we collected a clinical and haemodynamic profile of each patient by physical examination, recording data from the bedside monitor as well as using CCUS. All variables and the measurements were predefined in a protocol (see online supplementary file 1). In the current study, CCUS comprised transthoracic echocardiography (basic study, substudies 1, 3–9 and 11), pulmonary ultrasound (substudy 3 and 10) and ultrasonography of the large arteries (substudy 5). The CCUS images and measurements were validated by an independent core laboratory (Groningen Image Core Lab, UMCG, Groningen, the Netherlands, www.gicl.com). These echo laboratory technicians were blinded for all other measurements. Other variables such as laboratory values and diagnoses as judged by an ICU physician at ICU admission and discharge were obtained from the patient’s electronic medical records. Comorbidities, relevant medical history and Acute Physiology and Chronic Health Evaluation II and IV (APACHE II and IV) scores were registered as well. All-cause mortality at 90-day follow-up was based on the municipal personal records database.
The protocol of this study and its substudies was published on the intranet of our hospital before the start of the study (project number: 201500144) and, after completion of the pilot phase, was also registered at clinicaltrials.gov (NCT02912624). A customised electronic case report form (e-CRF) was developed prior to study onset in OpenClinica version 3.9 (OpenClinica, LLC and collaborators, Waltham, Massachusetts, USA). Patient data were pseudoanonymised and entered in OpenClinica, and a decoding list of included patients was kept separate from the e-CRF by the research office of the Department of Critical Care. All measurements, informed consent forms and other patient details were uploaded in OpenClinica and stored on a secure hospital server. Independent study monitoring of the organisation and the conduct of the study was in adherence to the Good Clinical Practice guidelines.37
Findings to date
Characteristics of study population
Between 21 March 2015 and 31 December 2016, all eligible patients were identified by daily screening of all new patients admitted to the ICU (figure 2). Currently, 704 patients have been included from a total of 791 eligible patients. The mean age was 61 (±15) years and 457 patients (65%, 95% CI 61% to 68%) were male. Table 2 displays demographic data along with all haemodynamic variables of the basic study. There were no missing data for the following variables: blood pressures, heart rate, urine output, central temperature, arterial haemoglobin and lactate levels. Mottling scores, capillary refill times and peripheral temperatures had missing values in 2%–8% of the patients.
Reasons for missing data included a dark or icteric skin colour (mottling and capillary refill times) and compression stockings (capillary refill time at the knee and peripheral temperature at the dorsum of the foot).
Vasopressors and/or inotropes were used in 363 patients (52%, 95% CI 48% to 55%), of whom 351 patients (50%, 95% CI 46% to 54%) were given noradrenalin, 10 (1%, 95% CI 1% to 3%) vasopressin, 29 (4%, 95% CI 3% to 6%) milrinone and 20 (3%, 95% CI 2% to 4%) dobutamine. In 46 patients (7%, 95% CI 5% to 9%), more than one type of vasopressor or inotrope was administered. The median APACHE IV score of our population was 74 (IQR 57–92) with a corresponding associated risk of in-hospital mortality of 25%.38 At 90-day follow-up, 173 patients (25%, 95% CI 22% to 28%) had died, and 6 patients (1%, 95% CI 0% to 2%) were lost to follow-up due to emigration or residence in another country.
Critical care ultrasound
Cardiac output measurements by CCUS were performed in all the 704 included patients. After validation by the independent core laboratory 632 (90%, 95% CI 87% to 92%) CCUS images were judged to be of sufficient quality for reliable cardiac output measurement. CCUS could not be performed in 68 patients due to various reasons obstructing the CCUS window, such as thoracic drains, postsurgical incisions, wounds or (subcutaneous) emphysema (figure 2).
To date, we have initiated nine substudies that focus on more clinical or haemodynamic measurements (table 3). After evaluation of finished substudies (substudies 1–7), we considered ‘pulmonary ultrasound for the presence or absence of B-lines’ (substudy 2), ‘the right ventricle function’ (substudy 4), ‘validation of the FloTrac cardiac output measurement device’ (substudy 6) and ‘serial clinical and haemodynamic measurements’ (substudy 7) to be feasible. These substudies were successively implemented in the basic study line and data collection is still ongoing. Substudies 1, 3 and 5 were discontinued as results appeared inaccurate or were too time-consuming. Currently, two substudies are running (8 and 9), and two new substudies are planned (10 and 11) (figure 1).
In the near future, we aim to expand our SICS studies to patients in the emergency room, independent of their destination ward in the hospital. We expect that both the diagnostic and prognostic value of available clinical and haemodynamic variables will change when patients are included in earlier phase of acute illness. Other future possibilities may include even more advanced CCUS imaging, other specific haemodynamic research questions and expansion to other national and/or international centres. Ultimately a randomised clinical trial for evaluation of haemodynamic interventions may be superimposed on this registry with the ultimate goal to improve patient-centred outcomes.39
Strengths and limitations
We have described the study protocol including the research questions and design as well as the characteristics of the patients included in the cohort so far. The strengths of the study include the prospective design allowing systematic data collection following a predefined protocol. All variables are measured according to strict definitions in a broad ICU population that represents the daily critical care in a university hospital. We already learnt that values of clinical and haemodynamic variables show large individual differences in the critically ill patients of the SICS-I cohort. Currently in critical care all patients are assessed by the same combination of clinical and haemodynamic variables. It is very likely that these variables will have different diagnostic and prognostic value depending on patient subgroups. A more personalised approach for clinical and haemodynamic assessment in this heterogeneous population seems to be appropriate. We therefore aim to include a sufficient number of critically ill patients to establish the additional diagnostic and prognostic value of specific clinical and haemodynamic variables in predefined subgroups, for example, patients with sepsis, shock or acute respiratory distress syndrome.
Another strength is the flexible design that allows temporary or definite incorporation of specific haemodynamic research questions. This design facilitates a combined evaluation of clinical and haemodynamic variables used in daily practice and offers the possibility of evaluating whether new and/or advanced measurements can improve diagnostic and prognostic accuracy. Furthermore, evaluations of substudies adapt the set of clinical and haemodynamic variables to be measured in the basic study line. Evaluations of inclusions or exclusions of variables are based on the additional diagnostic and prognostic value as well as the efforts and possible interference with patient care needed for recording.
A lesson learnt from this cohort study is that novices, that is, senior medical and PhD students, can be effectively trained to obtain advanced haemodynamic variables derived from CCUS. While previous studies showed that non-cardiological professionals could obtain reliable CCUS images and measurements after an education programme,40–42 we demonstrated that this possibility seems to apply to novices as well. Recently, CCUS is increasingly applied in different areas of medicine including the prehospital phase, the emergency department and the ICU setting.42–46 CCUS is highly operator dependent and time consuming. Due to validation of all our measurements by an echographic core laboratory, we ensured the quality of our echographic images and accuracy of the related measurements. Despite training and independent validation of our measurements, the quality and accuracy of our images may still be inferior compared with those obtained by skilled echolaboratory technicians, cardiologists, intensivists or cardiologist-intensivists. However, our researchers scheduled themselves 7 days a week and can easily expand to other potential study locations. A limitation inherent to the technique is that CCUS cannot be performed in patients with pathology interfering with a proper ultrasound window view, such as drains, wounds and subcutaneous emphysema. This limitation will, however, apply to both inexperienced and experienced investigators.
One limitation for statistical interference of the current study design is that we will encounter multiplicity issues due to multiple testing of the data across substudies. Repeated testing may result in increased type I errors. Additionally, all substudies need separate detailed sample size considerations. As a rule of thumb, at least 10 events are necessary for each variable included in a final model.47 48 To account for this potential multiplicity issue combined with multiple sample size considerations, we emphasise the hypothesis-generating aspect of results and advocate that findings should be validated in an independent cohort.
Another major limitation of our SICS-I basic study is that all measurements are limited to a single time point. To expect, for example, that one single cardiac output measurement may predict mortality is obviously unrealistic as cardiac output may vary widely over time.49 50 One of our substudies specifically aims to determine the diagnostic accuracy of continuously monitoring cardiac output in patients with shock. Other CCUS measurements with less variation over time might eventually appear to be better predictors, and we are currently exploring which set of CCUS measurements may accommodate clinical needs. However, in daily practice, snapshot measurements guide treatment decisions as triggers for interventions. Ideally, decisions for interventions will be informed by (trends of) repeated or even continuous measurements of both cardiac output and other haemodynamic variables. Continuous measurement is limited to the variables heart rate, blood pressures and non-invasively measured cardiac output. The use of either invasive or non-invasive continuous monitoring of cardiac output has no documented benefit on mortality,51 which might result from either lack of prognostic additive value, insufficient diagnostic accuracy, the treatment algorithm used or absence of any beneficial effects of the selected treatment interventions.52 The entire process of setting the correct diagnosis, implementing an appropriate intervention, monitoring treatment effect and eventually improving patient prognosis in a haemodynamically unstable patient is an extremely complex chain of events. Evidence-based evaluation of such a process with complex time-dependent repeated interactions between diagnosis and treatment requires an approach that includes all three types of research: diagnostic, prognostic and a combination of intervention with prognostic research. For the latter, our study could serve as an infrastructure to conduct randomised clinical trials.
We have described the study protocol and the characteristics of the patients. The aim of the SICS-I study is to serve as a pilot for a large, multicentre, preferably multinational registry aimed at evaluating simple clinical and haemodynamic measures to guide treatment decisions focused on haemodynamics. Our experience with the SICS-I will fuel future projects and the selection of clinical and haemodynamic variables in large-scale collaborations. This experience has already led to an ongoing collaboration with the Copenhagen Trial Unit, the Centre for Research in Intensive Care and The Division of Intensive Care Medicine of the Helsinki University Hospital, and we are open for any further suggestions or proposals for collaboration.
Contributors IvdH and FK created the idea of and supervised the SICS-I study. BH, RJE, GK and RW developed the protocol, created the educational platform and implemented the study. BH and RJE drafted the initial versions of the manuscript, analysed the data and contributed equally to this manuscript. JW, AP, VP and HS were involved in future expansions within an international consortium. All other authors critically reviewed the manuscript and agreed with the final version and findings.
Funding This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests None declared.
Patient consent The manuscript does not contain any identifiable medical information. For our informed consent procedure, we refer to our manuscript.
Ethics approval Medisch Ethische Toetsingscommissie, University Medical Center Groningen.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement Upon completion of our study, anonymised data will be available on reasonable request.
Collaborators R.P. Clement, W. Dieperink, P. van der Harst, D.H. Hilbink, M. Klasen, M. Klaver, T. Kaufmann, T.W.L. Scheeren, L.J. Schokking, V.W. Sikkens.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.