Article Text
Abstract
Introduction MRI and MR spectroscopy (MRS) provide early biomarkers of brain injury and treatment response in neonates with hypoxic-ischaemic encephalopathy). Still, there are challenges to incorporating neuroimaging biomarkers into multisite randomised controlled trials. In this paper, we provide the rationale for incorporating MRI and MRS biomarkers into the multisite, phase III high-dose erythropoietin for asphyxia and encephalopathy (HEAL) Trial, the MRI/S protocol and describe the strategies used for harmonisation across multiple MRI platforms.
Methods and analysis Neonates with moderate or severe encephalopathy enrolled in the multisite HEAL trial undergo MRI and MRS between 96 and 144 hours of age using standardised neuroimaging protocols. MRI and MRS data are processed centrally and used to determine a brain injury score and quantitative measures of lactate and n-acetylaspartate. Harmonisation is achieved through standardisation—thereby reducing intrasite and intersite variance, real-time quality assurance monitoring and phantom scans.
Ethics and dissemination IRB approval was obtained at each participating site and written consent obtained from parents prior to participation in HEAL. Additional oversight is provided by an National Institutes of Health-appointed data safety monitoring board and medical monitor.
Trial registration number NCT02811263; Pre-result.
- neonatal intensive & critical care
- neonatology
- neurological injury
- neuroradiology
- developmental neurology & neurodisability
- paediatric radiology
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
- neonatal intensive & critical care
- neonatology
- neurological injury
- neuroradiology
- developmental neurology & neurodisability
- paediatric radiology
Strengths and limitations of this study
This study will be the first to determine if high-dose erythropoietin administered to infants with moderate to severe neonatal hypoxic-ischaemic encephalopathy (HIE) reduces brain injury as measured by quantitative MRI and MR spectroscopy (MRS) biomarkers.
MRI and MRS data are collected prospectively, using standardised MRI and MRS protocols, with quality assurance and oversight provided by the high-dose erythropoietin for asphyxia and encephalopathy neuroimaging core.
Findings will clarify treatment effects of erythropoietin in neonates with HIE and will provide further support of efficacy.
Limitations include the use of nine different MRI platforms and clinical workflow, which poses challenges for harmonisation and for collecting quantitative data, including MRS files. Techniques for mitigating these are discussed.
Introduction
Neonatal hypoxic-ischaemic encephalopathy (HIE) is a major cause of death and neurodevelopmental disability, contributing to almost a quarter of neonatal deaths worldwide.1–3 Therapeutic hypothermia (TH) is the first empirically supported therapy for neuroprotection in neonates with HIE.2 3 Still, even with TH, 40%–50% of neonates die or develop moderate to severe neurodevelopmental impairments.2 3 To improve outcomes, efforts are focused on the development and clinical translation of adjuvant neuroprotective therapies.
The high-dose erythropoietin (Epo) for asphyxia and encephalopathy (HEAL) trial (NCT02811263) is a multicentre, randomised, double-blind, placebo-controlled, phase III clinical trial designed to test the efficacy of Epo for neuroprotection as an adjuvant to TH in neonates with moderate to severe HIE.4 Preclinical studies have shown that Epo induces multiple neuroprotective responses that act synergistically to reduce brain injury, promote repair and improve neurological outcomes after hypoxia-ischaemia.5 Recent phase I/II clinical trials support the safety of high-dose Epo and potential efficacy for neuroprotection in neonates with HIE.6–9 In the HEAL trial, 500 neonates with moderate or severe HIE undergoing TH will be randomised to receive Epo (1000 U/kg) or placebo on days 1, 2, 3, 4 and 7 of life. The primary endpoint is the composite of death or neurodevelopmental impairment at 24 months of age. As a secondary aim, HEAL will determine whether Epo decreases the severity of brain injury by MRI and MR spectroscopy (MRS). In this paper, we provide the rationale for incorporating MRI and MRS biomarkers into the multisite, phase III HEAL trial, the MRI/S protocol and describe the strategies used for harmonisation across multiple MRI platforms.
Neuroimaging biomarkers of neonatal HIE
Neuroimaging biomarkers provide information regarding the nature and severity of the precipitating insult, timing and prognosis. This is implied by the locus and extent of injury and the signal characteristics on T1-weighted (T1w), T2-weighted (T2w) and diffusion-weighted imaging (DWI). Additionally, advanced techniques such as MRS provide biochemical information regarding energy homoeostasis and injury progression, while diffusion tensor imaging (DTI) provides information regarding microstructure and connectivity.
Patterns of injury
There are two hallmark patterns of injury associated with neonatal HIE: a central pattern involving injury to the deep grey nuclei (ventrolateral thalamus and posterior putamen) and perirolandic (paracentral) cortex, with or without concomitant injury to the brainstem and a peripheral pattern, involving injury to the white matter and/or overlying cortex in a parasagittal distribution along the vascular borderzone (watershed territory). These patterns are similar to the patterns of injury observed experimentally in primates following ‘near total’ and ‘prolonged partial’ asphyxia, respectively.10–14 Other commonly observed findings in neonates with HIE include punctate white matter lesions, focal lesions (including strokes) and haemorrhages (intraventricular, intraparenchymal and extra-axial), as well as ‘normal’ MRIs (no apparent injury).15–20
Epidemiological neuroimaging data are limited, and thus, the prevalence of various injury patterns in neonates with mild, moderate or severe HIE, as classified by Sarnat Stage, is not known. Multiple studies have investigated whether the pattern of injury varies by maternal–fetal factors, including sentinel events during delivery and placental function; however, a consistent pattern has yet to emerge. Several studies have shown that sentinel events were associated with an increased risk of injury to the thalamus/basal ganglia and/or cortex and white matter21 22; however, the opposite has also been found.23 Likewise, placental abnormalities have been associated with HIE24–26; however, there has been inconsistency with regard to which placental findings are associated with which pattern(s) of injury.27–30
Timing and evolution of HIE brain injury
HIE injury evolves over days, and serial imaging has demonstrated this evolution is associated with varying signal abnormalities on T1w and T2w MRI, DWI and MRS. Acutely, injury appears as areas of restricted diffusion on Trace-DWI and apparent diffusion coefficient (ADC) maps. Quantitative measurements obtained in neonates with HIE show that ADC values reach their nadir 2–3 days after birth and rise thereafter, pseudonormalising at approximately 1 week after birth.31 32 These curves are similar at 1.5 and 3T; however, measured ADC values are inversely related to b-value, and higher b-values (≥1000 s/mm2) are more sensitive for detecting acute injury.33 34 TH augments the ADC curve producing lower ADC values and may extend the time window for pseudonormalisation to as late as 8–10 days of age.35
Conventional MRI demonstrates parallel signal changes. Acutely, oedema appears as areas of low signal and high signal on T1w and T2w MRI, respectively. These areas may show corresponding low ADC values indicating cytotoxic oedema (cell swelling). As injury evolves, focal areas of T1 hyperintensity with correspondent T2 hypointensity begin to appear in the deep grey and/or cerebral cortex, especially, in the ventrolateral thalamus, posterolateral putamen and perirolandic cortex. Additionally, T1w and T2w imaging may show disruption of the normal cortical ribbon, particularly in borderzone (watershed) regions or in the vicinity of other focal injuries (eg, infarcts, contusions).
MRS demonstrates comparable changes in metabolite concentrations during the first and second week after birth. Acutely, there is a rise in lactate, a marker of anerobic metabolism; however, lactate peaks during the first week, followed by a rise in lipids, which are only detectable at short echo time.36 By contrast, n-acetylaspartate (NAA), a marker of neuronal mitochondrial metabolism, declines during the first few days and then remains lower among HIE infants with brain injury.32 37–39 Other metabolites show transient changes following HIE including phosphocreatine, myoinositol, glutamine and choline.40–43
In conjunction with evolving signal abnormalities on T1w, T2w, DWI and MRS, serial imaging has also shown that the locus of injury may evolve during the first week. This is especially common among infants with injury to the deep grey matter who often demonstrate injury localised to the ventrolateral thalamus +- dorsal brainstem on early scans (1–3 days of age), followed by more widespread injury in the deep grey nuclei (particularly posterolateral putamen) and perirolandic cortex on later scans (4+ days).15 32 44 Moreover, as injury evolves, areas of Wallerian degeneration often appear on DWI, including in the posterior limb of the internal capsule (PLIC), splenium and brainstem.15 32
MRI as a prognostic biomarker
MRI is widely employed clinically as a prognostic biomarker, and several semiquantitative scoring systems have been developed for use in clinical research.16 17 20 45–49 Most of these systems place greater weight on injury to the grey matter (thalamus, basal ganglia and perirolandic cortex) as these findings have been most consistently associated with adverse outcomes, including death and neurodevelopmental impairment.16 20 45–49 However, scoring systems differ with regard to how they quantify severity, with some inferring severity from the locus of the injury alone16 39 45 while others infer severity from the locus and extent of signal abnormality.20 48 Several yield information regarding pattern of injury.16 44 45 None provide quantitative information regarding stage (ie, acute, subacute, chronic) based on the evolving signal abnormalities on MRI.
Several studies have assessed the validity of the semiquantitative MRI scores in single centre45 48 and multicentre studies.16 20 39 47 50 51 These studies have demonstrated variable accuracy for predicting death or neurodevelopmental impairment at follow-up, ranging from area under the curve (AUC) 0.7–0.99.20 37 48 51 Some of this variability in predictive accuracy may be accounted for by the timing of the MRI exams and the sequences employed. Several studies have suggested that early scans (<1 week) may provide better sensitivity while later scans provide better specificity.51 52
Multiple studies have shown that MRS enhances the predictive accuracy of MRI20 37 51 and several studies have suggested that MRS may provide the highest predictive accuracy of all MRI biomarkers.39 51 By contrast, quantitative ADC measurements have poor prognostic accuracy,51 likely due to pseudonormalisation, as discussed above.
Neuroimaging biomarkers in prior randomised controlled trials for neuroprotection
MRI was included as a secondary outcome in three previous phase III randomised controlled trials (RCTs) for TH: the NICHD Neonatal Research Network (NRN) Trial (2005),16 the Total Body Hypothermia for Neonatal Encephalopathy (TOBY) Trial (2009)17 and the Infant Cooling Evaluation (ICE) Trial (2011).47 All three trials found that TH was associated with less injury on MRI. Furthermore, the sensitivity and specificity of the MRI biomarkers for predicting adverse outcome did not differ between neonates who received TH and those who received normothermia (NT), indicating that TH did not alter the prognostic value of MRI in neonates with HIE.
However, the MRI results from the three cooling trials varied in several important aspects. First, although TH was associated with less brain injury on MRI in each trial, the nature of the effect varied. In the TOBY Trial, TH was associated with a reduction in signal abnormalities in the basal ganglia/thalamus (BGT) (OR 0·36, 95% CI 0·15 to 0·84; p=0·02), white matter (0·30, 0·12 to 0·77; p=0·01),and PLIC (0·38, 0·17 to 0·85; p=0·02).17 In contrast, TH was not associated with a significant reduction in BGT injury in either the NICHD NRN or ICE trial, but was associated with a significant reduction in injury to the cortex and underlying white matter.16 47
The inconsistent MRI findings in the three cooling trials are likely due, at least in part, to differences in study design, including inclusion criteria, cooling technology and neuroimaging methods. Moreover, only a subset of patients in each trial had analyzable MRI data, and both the proportion of patients in the MRI subanalyses, which ranged from 40% to 65%, and relative proportion assigned to each treatment group (TH vs NT) varied across trials.16 17 47 Likewise, the MRI protocols differed between trials (e.g., with or without DWI) as did the timing of imaging, with mean age ranging from 647 to 15 days.16 Consistent with the variability in the neuroimaging methods, the sensitivity and specificity of MRI biomarkers as predictors of outcome varied substantially across trials, with the highest sensitivity—but low specificity—in the NICHD NRN trial, and the highest specificity—but low sensitivity—in ICE.16 17 47 This variability limits any conclusions regarding differences in neuroimaging outcomes across the three TH trials and points to the necessity of standardisation and harmonisation.
Special considerations for MRS
Incorporating MRS into multisite trials poses additional challenges beyond those encountered for conventional MRI. Many hospitals do not routinely acquire MRS in neonates with HIE as MRS requires specific software packages, which may not have been purchased. MRS acquisition is also more technically demanding due to its low signal to noise ratio (SNR) compared with conventional MRI.53 There are also challenges associated with detection of lactate and other j-coupled metabolites that must be addressed at acquisition and/or postprocessing in order to avoid known pitfalls.54 Likewise, MRS analysis and interpretation are more complex than conventional MRI and require expert knowledge beyond core competence in diagnostic radiology. Last, MRS has its own separate billing code, and reimbursement is poor, often requiring preauthorisation. Thus, although recommended by the American College of Obstetrics and Gynecology task force on Neonatal Encephalopathy and endorsed by the American Academy of Pediatrics for assessment of brain injury in neonatal HIE,55 MRS usage lags behind MRI.
MRS was not systematically incorporated into any prior multicentre, phase III cooling trials for HIE, but it has been incorporated into single-centre32 41–43 56–58 and multicentre observational studies39 59 as well as several recent phase I/II RCTs.60 61 The sensitivity and specificity of MRS for predicting outcome is not affected by TH, making it suitable for use as a prognostic biomarker in neonates undergoing TH for HIE.39 51 57 62–64 As with MRI, the reliability and diagnostic accuracy of MRS biomarkers may be affected by the timing of exam, sequence parameters (short echo vs long echo), region sampled (BGT vs white matter), postprocessing methods (ratios vs absolute quantitation) and the precise metabolites chosen (eg, lactate, NAA, creatine, choline).39 51 52
Methods
In this section, we present the HEAL Neuroimaging Protocol in accordance with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) reporting guidelines.65
Study design
The HEAL trial is a multicentre, phase III, randomised, double-blind, placebo-controlled trial involving 500 neonates, ≥36 weeks gestational age with moderate to severe HIE who are undergoing TH. Treatment allocation (Epo or placebo) is parallel (1:1), stratified by site and HIE severity. Parents, participants and study personnel—including the Neuroimaging Core—are blinded to the treatment group. For further details regarding the HEAL trial, please see online supplemental appendix 1 and also Juul et al.4
Supplemental material
MRI and MRS data are obtained at 4–5 days of age as part of routine clinical care, using a standardised MRI protocol. Neuroimaging data are then analysed centrally by the HEAL Neuroimaging Core. Details regarding acquisition, data transfer, data processing and analyses are provided in the next section.
Patient and public involvement
This study was designed by the HEAL Study Group. There is no parental advisory board. Results will be disseminated to other physicians via academic medical conferences and to the public at large via standard press releases.
Study locations
The HEAL trial is being carried out across a network of 17 study sites, using 9 MR platforms (table 1). Five of the sites include two or more enrolling hospitals. Each of the participating hospitals has a 3T MR system, with the exception of one hospital, which is using a 1.5T MR system and a dedicated neonatal head coil.
MRI and MRS sequences and sequence parameters
Prior to the start of HEAL enrolment, detailed MRI protocols were developed for each MRI platform. During the preparatory phase, we compared different sequences and sequence parameters across platforms in order to maximise consistency in image contrast, resolution and SNR across platforms using US Food and Drug Administration-approved product sequences. The final protocol is presented in table 2 (see also figures 1 and 2, eg, images). One limitation is that we were not able to find an optimal solution for a 3 dimensions (3D) T2w sequence. Therefore, we used a 2D sequence, with the in-plane resolution matched to our 3D T1w sequence and slice thickness at 2 mm (no gap) in alignment with our DTI sequence.
The MRS protocol includes both short echo (TE 35) and long-echo (TE 288) acquisitions. Furthermore, the decision to use TE 288 over TE 144 mitigates a known pitfall with lactate at 3T, namely the attenuation and even absence of signal at TE 144 due to anomalous j-coupling,54 while the short echo (TE 35) acquisitions allow for quantitation of additional metabolites, including glutamate, glutamine and lipids.
Timing of brain MRI and MRS
The target window for the HEAL MRI is day 4 or 5 after birth (between 96 and 144 hours of age). This window corresponds to a period of maximal sensitivity and specificity for MRI and MRS51 when abnormal DWI/ADC signal is maximised51 57 and risk of pseudonormalisation is minimised.31 44 Furthermore, this timing is compatible with current clinical practice and provides information to guide medical management including decisions about redirection of care. For those infants who are not clinically stable for MRI during this window, MRIs are obtained as soon after the infant becomes clinically stable as possible.
Use of sedation
Because HEAL MRI scans are performed as part of routine clinical care, the use of sedation is determined locally by the attending physicians on a case-by-case basis. Given concerns regarding possible neurotoxic effects of anaesthetic drugs,66 every effort has been made to facilitate non-sedated imaging whenever possible. To determine whether sedatives effect MRS metabolite concentrations, all psychoactive medications administered within 4 hours of the examination are recorded in the HEAL database.
Anonymisation and data transfer
Anonymisation and transfer of neuroimaging data is facilitated by using a secure, Health Information Portability and Accountability Act (HIPAA)-compliant, cloud-based service (Ambra Health, New York, New York, USA). Because raw quantitative MRS data are not compatible with clinical PACS systems, we developed specific protocols to transfer these data from the MR scanner in standard DICOM (Siemens), enhanced DICOM (Philips), P-files (GE) other file formats (eg, SPAR/SDAT, RDA), as needed. Furthermore, although the cloud-based service provides anonymisation on upload to the HEAL Neuroimaging Core, uploading the raw MRS data requires anonymisation prior to or during export from the MR scanner as detailed in table 3.
Data processing: MRI
The primary HEAL neuroimaging outcome measures is the total MRI injury score based on a previously validated MRI scoring system for HIE.48 This score indicates the extent of signal abnormality (ie, 0=none, 1 ≤25%, 2=25%–50%, 3 ≥50%) for each of the deep grey nuclei, PLIC, cerebral cortex, white matter and cerebellum, as well as brainstem (scored on a 0–2 scale) separately for each sequence as shown in table 4. ‘Signal abnormality’ is defined qualitatively as either abnormally low or high signal on T1w and T2w images or areas of restricted diffusion on Trace-weighted or ADC images calculated from the DTI sequence. We do not employ a quantitative threshold for ADC, consistent with the previously validated scoring system.7 48 Areas with high ADC are not scored as injury for the DTI images, which is designed to measure acute injury; however, correspondent areas of low and/or high signal on the T1w and/or T2w images are scored.
For each ROI, injury is scored qualitatively for each sequence on a 4-point scale based on the extent of signal abnormality (0=none, 1 = <25%, 2=25%–50%, 3 ≥50%), except for the brainstem which is scored on a 3-point scale (0=none; 1=focal; 2=multifocal/widespread).
To compute the MRI injury score, each scan is reviewed independently by two of three experienced readers (AMM, JLW and RCM), who are blinded to the infant’s clinical course, treatment assignment and MRS findings. After the primary review, each scan undergoes final consensus review during which any discrepancies are reviewed by all three reviewers and resolved by consensus. The individual and consensus scores are then classified as none (total=0), mild (1–11), moderate (12–32) or severe (33–138), in accordance with the previously validated MRI injury classification.48 Inter-rater reliability between the three independent readers will be determined for both the total score and for the categorical classification (none, mild, moderate, severe). For the total score, we will use a general linear mixed effects model to estimate the intraclass correlation coefficient (ICC).67 For the categorical classification, we will use kappa.68 Secondary MRI measures include the MRI injury severity classification discussed above as well as classification of injury pattern and acuity. Injury pattern is classified as: (1) normal MRI (defined as no evidence of injury); (2) central (injury to the BGT±perirolandic cortex); (3) peripheral (injury to the parasagittal cortex and/or WM, ie, ‘borderzone/watershed distribution); (4) global (injury to BGT+ total or near total involvement of cortex±underlying WM); (5) punctate WM Lesions (discrete foci of injury typically 1–10 mm in size localised to the periventricular WM or centrum semiovale); (6) arterial ischaemic stroke (infarct localised to the vascular territory of the middle, anterior or posterior cerebral arteries); (7) other focal lesions (includes venous infarcts, contusions, and unilateral lesions to the BGT, cortex or white matter not classified elsewhere) and (8) atypical/not otherwise specified (with additional text field for describing the lesion). The scoring system allows for multiple patterns to be coded, which will allow us to determine the frequency of individual patterns as well as the co-occurrence across patterns.
Acuity is defined by the co-occurrence of signal abnormalities across the MRI sequences. Of note, the HEAL MRI examination occurs on day 4 or 5, prior to the expected pseudonormalisation of the ADC signal, and final analyses will be restricted to patients whose MRIs were completed within the first week. Acute lesions are defined as lesions that show correspondent diffusion restriction. Subacute lesions are defined as lesions (signal abnormalities) on T1w and/or T2w images without correspondent diffusion restriction (high or ‘normal’ ADC signal). Chronic lesions are defined as lesions associated with volume loss and tissue remodelling (eg, porencephalic cysts). As for injury pattern, the scoring system permits coding multiple levels of acuity (eg, acute + subacute injury).
Data processing: MRS
The primary MRS outcome measure is the ratio of lactate to NAA. As secondary analyses, we will also determine lactate and NAA concentrations (mmol/kg) as well as additional MRS metabolites. Raw MRS data (ie, quantitative files, see table 3) are processed centrally under the direct supervision of SB and JLW using a modified LCModel (V6.3–1 L, Stephen Provencher, Oakville, Ontario, Canada) pipeline. This fully automated pipeline applies zero-order and first-order corrections for phase, estimates a baseline, corrects for ppm shift and eddy currents, and determines metabolite concentrations, all without need for user interaction. Data are fitted with linear combinations of model spectra of known concentration from a standard basis set. For quantitation, the unsuppressed water signal is used as a concentration reference, with tissue water content estimated at a standardised value (ie, 86% or 47.8M) consistent with prior published methods.43 69
Statistical analyses
The primary neuroimaging outcome measures are: (1) the total injury score (derived from the HEAL/Wash U MRI scoring system above) and (2) the ratio of lactate/NAA determined for the left thalamus and parietal white matter from the quantitative MRS data. For the MRI injury score and the lactate/NAA ratio, we will use linear regression to compare Epo treated patients to controls while adjusting for site and HIE severity since these are factors used to stratify the randomisation. In the event that we have missing data due to either early patient death or other factors (eg, family declines MRI or infant is unable to complete all of the sequences), we will estimate the resultant sampling bias by comparing our final neuroimaging sample to the overall HEAL sample with regard to patient demographics and primary outcome data.
Sample size
The sample size for the HEAL trial (n=500) is designed to yield greater than 90% power to detect a relative reduction in the rate of death or neurodevelopmental impairment (primary outcome) of 33% in the Epo group as compared placebo group.4 To calculate the sample size necessary for the secondary neuroimaging analyses, we first calculated the observed effect size for the MRI injury score for the prior phase II trial.7 This study demonstrated a lower brain injury score in Epo-treated infants as compared with placebo (mean 5.26±9.9 vs 16.36±18.3, p<0.01, Cohen’s d=0.75) and a lower rate of moderate/severe brain injury (4% vs 44%, p<0.002). Using a conservative effect size for HEAL (Cohen’s d=0.75/2) and controlling for multiple comparisons, a total sample size of 356 will yield greater than 90% power to detect a medium size effect (Cohen’s d=0.375) on brain injury as measured by the MRI injury score or lactate/NAA biomarker.
Neuroimaging harmonisation and quality assurance
The primary goal of harmonisation is to reduce measurement error by maximising the consistency of neuroimaging data within and across sites. Minimising measurement error maximises the standardised effect size and therefore statistical power.70 Intrasite and intersite variability in MRI measurements can arise due to variability in: (1) MR hardware (eg, field strength, gradient strength, sensitivity of the head coils, hardware upgrades); (2) software (eg, sequences, sequence parameters, software upgrades); (3) patient workflow (eg, whether an infant is sedated or fed/swaddled in an infant immobiliser; whether the infant is properly positioned in the centre of the head coil) and (4) the timing of the MRI (eg, before or after expected pseudonormalisation of the diffusion signal). Additionally, noncompliance, a common challenge in multisite studies, contributes further error. Although it is possible to include ‘site’ as a covariate in statistical models, site and scanner effects are often non-linear and non-uniform across the brain as well as sequence-specific, making them challenging to manage retrospectively using statistical techniques. Accordingly, managing harmonisation prospectively through study design and real-time monitoring are key to ensuring the reliability and reproducibility of the neuroimaging biomarkers.
Our harmonisation efforts for HEAL centre on two areas: (1) a certification process to ensure that each site was able to obtain high-quality data in accordance with the HEAL protocol and (2) a robust quality assurance process designed to monitor acquisition and mitigate errors in a timely fashion throughout the trial. Prior to the start of HEAL, we developed a standardised MRI/S protocol and verified that it could be carried out across platforms to generate resultant images that were comparable across platforms with regards to tissue contrast, resolution and SNR. Because the HEAL MRIs are acquired as part of standard clinical care, as part of site initiation, we had discussions with at least one neuroradiologist from each site, as well as site PI, to ensure that the proposed HEAL MRI/S protocol would meet the site’s requirements for a clinical MRI protocol and to mitigate any site-specific challenges implementing the HEAL protocol. Additionally, each site provided a test dataset, which were used to verify sequence parameters, image homogeneity, slice orientation and motion. MRS data were reviewed for voxel position and raw data was processed to ensure adequate line width and SNR. Furthermore, the test scans certified the data transfer process and ensured that all data, including raw MRS, could be captured from each site and transferred to the HEAL Neuroimaging Core.
During the enrolment period, quality assurance is maintained through a real-time process aimed at monitoring acquisition and mitigating any protocol deviations. All brain MRI and MRS data are reviewed shortly after being uploaded to the HEAL database. Any protocol deviations are recorded and each sequence (T1w, T2w and DTI) is scored for motion on a four-point scale: none, mild (unlikely to affect interpretation), moderate (may affect interpretation), severe (obfuscates interpretation). Likewise, MRS sequence parameters and voxel positions are reviewed, and raw data are checked to ensure that valid files are present for MRS processing. All protocol deviations and severe motion or other artefacts are immediately discussed with the site.
Phantom studies
The primary HEAL MRI and MRS endpoints, namely the total MRI injury score and the ratio of lactate/NAA, were designed to be robust across a wide range of scanner platforms. However, to take full advantage of potential secondary analyses, including quantitative MRS and DTI biomarkers, we are carrying out additional phantom studies during the HEAL trial. These phantoms studies are aimed at further reducing unwanted site-related and scanner-related variance from our quantitative MRS and DTI measures. For MRS, we are using a commercially available phantom (GE Healthcare), which contains physiological concentrations of NAA, lactate, creatine, choline, glutamate and myoinositol. For DTI, we are using the diffusion ice-water phantom, which leverages the known properties of water diffusion at 0°C.71 Both phantoms will be scanned on multiple days at the HEAL neuroimaging core and twice within a single session at participating HEAL sites using the HEAL MRS and DTI protocols. We will use these data to compute the coefficient of variation for each metabolite concentration and ADC value across MR vendors, platforms and sites. These data will not only provide an estimate of the degree of measurement error that is attributable to scanner and site-specific effects, but also help to inform whether we will need to deploy additional retrospective statistical approaches (eg, ComBat72) to address unwanted site-related and scanner-related variance.
Unfortunately, we could not identify comparable phantoms with appropriate T1 and T2 values for an infant brain and employing a ‘travelling infant’ as a phantom was impractical. Thus, further harmonisation of the T1w and T2w data will have to be carried out using retrospective statistical approaches.
Discussion
The search for new neuroprotective therapies is ongoing, not only for neonatal HIE, but also a range of disorders, including stroke, traumatic brain injury and cardiac arrest. As preclinical studies identify promising therapies, the research community needs reliable biomarkers with which to move promising therapies from phase II to phase III trials. This is critical, given the scarce resource of appropriate patients and the cost of clinical trials. Neuroimaging biomarkers can help facilitate clinical translation by providing early endpoints for evaluating treatment efficacy. Furthermore, they can be used to elucidate treatment effects and the mechanisms by which improvements in neurological outcomes are achieved.
At the same time, ensuring the reliability and reproducibility of neuroimaging data across a large-scale, multisite RCT remains challenging. As a field, some of these challenges could be mitigated by adopting common protocols for neuroimaging. This would not only aid in the reproducibility within and across trials, but also strengthen research from bench to bedside by providing a means for directly comparing the effects of therapies in preclinical and clinical trials to those obtained in clinical practice. Last, some of the technological challenges, such as MRS data transfer and storage, would be eliminated if manufacturers were to use the standard DICOM format for archiving MRS data, as was done for conventional MRI more than three decades ago.
Summary
HEAL is the first phase III RCT for neuroprotection to incorporate MRI, DTI and MRS biomarkers on a large scale. We present standardised MRI and MRS protocols for HIE that are feasible on any modern 3T platform and describe our rigorous quality assurance procedures. Using phantom studies, we will characterise the degree of unwanted site-specific and scanner-specific effects remaining after harmonisation, which, in turn, will be used to estimate the need for advanced statistical methods to reduce such nuisance variance. Together, these methods will ensure rigour and reliability of the neuroimaging biomarkers collected in the HEAL trial and may help inform the design of future neonatal neuroprotection trials.
Ethics and dissemination
The study protocol (currently: V.2.9, 18 March 2020), site-specific informed consent forms, participant education and recruitment materials and all study modifications have been approved by the local Institutional Review Board at each of the participating sites. Parents have provided written permission for their child’s participation in the HEAL trial. Safety and progress reports are provided to the NIH-appointed data safety monitoring committee every 6 months.
Study findings will be disseminated through scientific conferences, peer-reviewed journal publications, public study website materials and invited lectures. Results from this study will be reported according to SPIRIT guidelines65 and submitted for peer-reviewed publication. Individual participant data, including neuroimaging data, will be made available through the National Institute of Neurological Disorders and Stroke (NINDS) Data Archive: https://www.ninds.nih.gov/Current-Research/Research-Funded-NINDS/Clinical-Research/Archived-Clinical-Research-Datasets. The data will be deidentified and a limited access data set will be available after March 2024 through a request form on that page. Data dictionaries, in addition to study protocol, the statistical analysis plan and the informed consent form will be included.
Acknowledgments
We acknowledge the Clinical Coordinating Center (Yvonne Wu, Sandra Juul, Dennis Mayock, Fernando Gonzalez, Amy Goodman, John Feltner, Stephanie Hauge, Samantha Nikirk, Kelleen Nelson), Data Coordinating Center (Patrick Heagerty, Bryan Comstock, Christopher Nefcy, Mark Konodi), Neuroimaging Committee (Robert McKinstry, Jessica Wisnowski, Stefan Bluml, Ashok Panigrahy, Amit Mathur, Yvonne Wu, Sandra Juul, Kelleen Nelson), Data Safety and Monitoring Committee (Ronnie Guilllet, Robin Ohls, Janet Soul, Jody Ciolino, Renee Shellhaas), Independent Medical Monitor (Mike Schreiber) and all of the Clinical Coordinators and study personnel participating at each site.
References
Footnotes
YWW and RCM are joint senior authors.
Collaborators The HEAL Study Group: Kaashif Ahmed (Children’s Hospital of San Antonio and Methodist Children’s Hospital), Mariana Baserga (Primary Children’s Hospital and the University of Utah Hospital), Ellen Bendel-Stenzel (Chidren’s Hospitals and Clinics of Minnesota), Lina Chalak, (University of Texas Southwestern), Taeun Chang (Children’s National Medical Center), John Flibotte (Children’s Hospital of Philadelphia), Amy Goodman (UCSF Benioff Children's Hospital), Fernando Gonzalez (UCSF Benioff Children’s Hospital), Andrea Lampland (Children’s Hospitals and Clinics of Minnesota), Nathalie Maitre (Nationwide Children’s Hospital), Dennis Mayock (Seattle Children’s Hospital and the University of Washington Medical Center), Ulrike Mietzsch (Riley Children’s Hospital), Kelleen Nelson (UCSF Benioff Children's Hospital), Brenda Poindexter (Cincinnati Children’s Hospital Medical Center), Rakesh Rao (Washington University Medical Center), David Riley (Cook Children’s Hospital), Gregory M. Sokol (Riley Children’s Hospital), Krisa Van Meurs (Stanford University), Hendrik Weitkamp, (Vanderbilt University Medical Center), Tai-Wei Wu (Children’s Hospital Los Angeles), and Toby Yanowitz (Children’s Hospital of Pittsburgh of UMPC and the Magee Women’s Hospital).
Contributors YWW and SJ conceived the study, wrote the funding application and are responsible for the conduct of all aspects of the study; JLW, SB, AP, AMM, BC, PJH, SJ, YWW and RCM designed the neuroimaging protocol and oversee neuroimaging data collection and analysis; JB, P-SKC, JD, TF, SF, SDF, HWH, CYH, BK-F, MO, RP, SP, YMR, JRa, NR, JRu, DWS, MS, JT, SV, AV, MTW, DX and KY provided data and critical feedback on the neuroimaging protocol; JLW wrote the first draft of this manuscript; and, all authors contributed to manuscript revision and approved the final version for submission.
Funding This work was supported by grants from the National Institutes of Health (U01NS092764, U01NS092553 and K23HD099309).
Disclaimer The funding agency has no role in the design of the study, collection, management, analysis and interpretation of the data, the writing of the report and the decision to submit the report for publication.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.