Study design

This is a single-centre, single-blinded, two-arm RCT to test the efficacy of Cogmed intervention versus standard of care in children with CHD after neonatal and/or infant open-heart surgery (n=50 in each group). All eligible subjects undergo a baseline neurodevelopmental assessment and then are randomly assigned to either the home-based Cogmed intervention or to a control group receiving the standard of care for children with CHD. All participants will undergo a post-treatment and a 3-month follow-up assessment. All investigators collecting outcome data are blinded to patients’ group assignment (Cogmed intervention versus standard of care) and to medical and surgical histories. Participants and their parents know their group assignment and thus are not blinded. For children assigned to the Cogmed group, post-treatment assessments are performed 1–2 weeks after the end of the intervention (ie, approximately 7–8 weeks after baseline assessment) and follow-up will be performed 3 months after the end of the intervention (ie, approximately 5 months after baseline assessment). For children in the control group, post-treatment and 3-month follow-up assessments are performed approximately 7–8 weeks and 5 months after baseline assessment, respectively.

Participants and recruitment

Participants are included if they meet the following criteria: (1) diagnosis of CHD requiring at least one open-heart surgery before 1 year of age; (2) age between 7 years and 12 years at baseline assessment; (3) ≥6 months postcardiac surgery; (4) had received cardiovascular care at Boston Children’s Hospital; (5) English or Spanish speaking; and (6) informed consent from parent/guardian as well as assent of the child. Exclusion criteria will be: (1) diagnosed chromosomal anomalies and/or genetic syndromes; (2) severe physical and/or sensory impairments (hearing, visual or psychomotor) that would prevent the use of the computerised program; (3) confirmed diagnosis of an autism spectrum disorder and/or severe developmental or intellectual disorder that would prevent successful completion of the planned study testing; (4) placement in a separate classroom for severe sensory, motor, language or other developmental disability receiving individual support; (5) scheduled to undergo major cardiac interventions in the 6 months following enrolment; and (6) received, receiving or scheduled to receive Cogmed or any other computerised behavioural training programme targeting EF or ADHD. We will not exclude children who underwent multiple heart or other surgeries, children with a pre-existing neurological history (eg, epilepsy and stroke) or with a history of a concurrent diagnosis of ADHD (treated or untreated). Rather, we will account for these factors in the data analysis.

Eligible children living in the USA are recruited through patient databases of Boston Children’s Hospital Cardiology Clinic and affiliated New England medical centres. Families are invited to participate in the study via a mail packet and follow-up phone call. Flyers and study brochures are displayed in Boston Children’s Hospital Cardiology Clinic and affiliated medical centres as well as in some local advocacy parent organisations. Participants are assessed for eligibility and enrolled by a study coordinator and a research nurse. Informed consent and assent from the child are obtained by a study coordinator or a research neuropsychologist before the baseline assessment at the hospital. Parents and children receive monetary compensation for participation in the study. These incentives are given at the second and third visits. Additionally, in order to further facilitate participants’ compliance and reduce dropouts, the second and third study assessments may be completed at a child’s home. The study start date (ie, start of active enrolment) was 27 February 2017, and it is anticipated that enrolment will be completed in September 2019.

Patient and public involvement

Patients, patient/family advocacy groups or the public were not involved in the design, recruitment and conduct of this study. Participants are informed of the burden of the intervention and are given the option to stop at any time point. All eligible patients completing the study will receive an individual report of the results of his or her baseline assessment as well as a general report on study results for the group with CHD when data analyses are completed.

Randomisation and stratification

All eligible subjects undergo a baseline neurodevelopmental assessment (figure 1) and then are randomly assigned to either the standard home-based Cogmed intervention group or to a control group (standard of care). Allocations are assigned using a computerised system only seen by the research assistant or study coordinator after confirming all eligibility criteria and consent. Subjects are assigned in the order in which they are enrolled into the study. Randomisation is done by computerised permuted blocks design with blocks of varying sizes. Once a subject has been assigned to a group, he or she will remain in the same trial arm for the duration of the study. The randomisation scheme involves two stratification factors: type of CHD (univentricular or biventricular) and baseline level of EF (a score <85 or ≥85 on the working memory test from the NIH Toolbox). Figure 1 shows the flow chart of the trial design.

• Download figure
• Open in new tab
• Download powerpoint

Figure 1

Flow chart of trial design. ND, neurodevelopmental.

Intervention group: home-based Cogmed Working Memory Training

Children randomly assigned to receive the Cogmed intervention will complete the standard home-based format of the programme, Cogmed RM, for children aged 7 years and older. The training programme contains 12 child-friendly visual-spatial and verbal working memory tasks (eg, remembering the order in which lamps light up on a 4×4 grid; recalling a series of numbers of increasing length on the screen). All tasks are adaptive, that is, task complexity levels are automatically adjusted to match each child’s working memory capacity, to improve performance and to limit non-compliance to the intervention due to lack of motivation. Tasks become more difficult, on a session-by-session basis, as a child’s performance improves. Each training session lasts approximately 40–50 min, and the child is instructed to complete one session per day 5 days each week for 5 weeks, for a total of 25 sessions. The programme yields individual session-by-session and task-by-task training results, including the children’s responses, time spent on each task and evolution curves. Cogmed is not Food and Drug Administration (FDA)-regulated. Based on our specific aims, Cogmed is considered a non-significant risk device.

Study tablets (ie, iPads) are provided to families randomised to the Cogmed group in order to standardise the method of delivery. Families receive a link for downloading a web-based software program to the tablet. The program is installed on the tablet by a study coordinator who explains how the training program works and how to log into the system and complete training. The training session and installation of the program are completed after baseline assessment and randomisation. Parents and children will be actively involved, and during the installation session, children will complete several practice trials under the supervision of the study coordinator. The 25 sessions will be completed by the child, supervised by a parent. For the first five sessions, the child trains on the same set of games; on the sixth session and every fifth session thereafter, a new task is introduced and replaces one of the initial tasks. At the end of each session, the child can play an age-appropriate tablet game as a reward. After each session, a parent will upload the results to a secure website. Families are contacted weekly to check program function and discuss concerns. Compliance is automatically registered by the computerised program and is defined as completing at least 20 sessions, the criterion by which children are categorised as compliant or non-compliant to treatment.41 42

To implement this intervention, each investigator and study coordinator involved in coaching is certified as a ‘Cogmed Coach’. The Cogmed Coaches will monitor children’s performance on mycogmed.com secured website every week during the intervention to permit continuous evaluation of treatment compliance and fidelity. The Cogmed coach specifically monitors performance of each child and contacts the parents and the child by phone on a weekly basis to discuss progression and any issues arising during the training week. A designated Cogmed coach will be available during the trial to respond to any questions or help with any difficulties during the training. Families and children are encouraged to continue the training for at least 20 sessions. If parents or children struggle with some aspects of the intervention such as the time commitment or a lack of motivation to persist with the training, the Cogmed coach discusses alternative options for accommodating each individual child’s needs (ie, rewards systems available, best time of the day to practice, number of breaks necessary during each session and so on) We provide weekly feedback sessions and close monitoring in order to discourage dropouts and increase compliance with the intervention. Parents are asked to complete a training evaluation scale following completion of Cogmed; this scale is an integrated component of Cogmed that gathers information regarding the child’s motivation and attention during the training as well as parents’ feedback. As soon as a child finishes the intervention, a blinded post-treatment assessment will be scheduled to occur within the following weeks.

Control group: standard of care

Children randomly assigned to the control group will receive the standard of care recommended for patients with critical CHD. This includes cardiac surveillance and, if needed, neurodevelopmental counselling and screening at Boston Children’s Hospital Cardiac Neurodevelopmental Program. Once enrolled in the study, a child in the control group will not receive Cogmed intervention or any other cognitive intervention that targets EFs or ADHD symptoms until after the 3-month follow-up assessment is completed, that is, 5–6 months after initial enrolment. Like children assigned to the intervention group, children in the control group can continue treatments that are already in place for other neurodevelopmental disabilities (eg, speech therapy and occupational services). For children in the control group, post-treatment and 3-month follow-up assessments will be performed 6–7 weeks and 4–5 months after baseline assessment, respectively. After the study is completed, children in the control group will be offered the possibility of completing the Cogmed intervention at no cost.

Primary outcome measure

The NIH Toolbox55 is a set of computerised assessments designed to measure outcomes in longitudinal or intervention trials. This battery is particularly appropriate for our study because it is presented in a computerised child-friendly version, paralleling that of the Cogmed intervention. The List Sorting Working Memory Test from the NIH Toolbox is the primary outcome of the trial. This standardised measure assesses the ability to process information across a series of modalities (visual-spatial and verbal), to hold this information in a short-term buffer and to actively manipulate it mentally. It is considered an excellent composite indicator of children’s EF skills, as it requires the simultaneous implementation of control of attention and working memory abilities on tasks of increasing complexity. Mean scores are automatically computed and are compared with a standardisation sample of US children of the same age. Scores are normally distributed (mean=100, SD=15) in the standardisation sample. The construct validity of the NIH Toolbox working memory tasks is 0.58 for convergent validity and 0.30 for divergent validity. This test has a test–retest reliability of 0.89 (95% CI 0.85 to 0.92).

Secondary outcome measures

Covariate measures

We will investigate cognitive, medical and sociodemographic patient-specific factors as predictors of response to the intervention, at both post-treatment and 3-month follow-up assessments. The following variables will be investigated: baseline Full-Scale IQ scores and all subscales on the Wechsler Intelligence Scale for Children, Fifth Edition,59 and perinatal medical history, including birth weight, gestational age, type of CHD, history of neurological abnormalities, number of open-heart surgeries, intensive care unit length of stay and total number of hospitalisations.

Data management and safety monitoring

Overall integration of the statistics, data management and administrative functions of this trial occur in the Department of Cardiology’s Research Support and Statistics Core (RSSC) led by Drs Jane Newburger and David Wypij. The RSSC provides the infrastructure necessary to facilitate the conduct of this clinical trial including biostatistical analysis, computerised data entry, data base programming and development, data management, quality control, assistance with manuscript preparation and administrative functions. The RSSC provides a centralised resource for maintaining database. Study documents are being stored in individual subject folders, each folder containing a tracking page. All study materials are stored in a locked file cabinet accessible only to authorised study staff. All study data are recorded on case report forms and entered into a Research Electronic Data Capture database.

A Data and Safety Monitoring Board (DSMB) is composed of expert members in cardiology, neuropsychology and biostatistics. Members will be independent of the study investigators and their Departments at Boston Children’s Hospital as well as from the sponsors of this study. The function of the DSMB will be to advise the funding sources, Boston Children’s Hospital and the study investigators on: (1) final study designs and protocols prior to the beginning of data collection, (2) problems encountered protocol implementation, (3) frequency of occurrence of adverse events and their relation to study protocols, (4) withdrawals and losses to follow-up, (5) data interpretation and ethical issues and (6) recommendations arising from the study. The DSMB chair will receive reports of any serious events that occur in the conduct of the study. This trial has been considered as a non-significant risk device study and reviewed accordingly by the Boston Children’s Hospital Institutional Review Board and the Human Research Protection Office, US Department of Defense.

A complete description of this trial’s data management plan, safety monitoring board and risk/benefits assessment is presented in online appendix 1.

Sample size and power considerations

Our specific aims are to determine whether there are significant differences between the intervention and control groups in the change in scores on the List Sorting Working Memory Test between measurements at baseline and post-treatment (specific aim 1) and between baseline and 3-month follow-up (specific aim 2). Although this test has a good test–retest reliability of ρ=0.87, to be conservative, we will assume a value of ρ=0.70 between baseline and post-treatment and between baseline and 3-month follow-up on the same subject. Given a sample size of 100 subjects, ρ=0.70 for within-subject correlations, and a two-sided type I error rate of 5%, we have 81.4% power to detect a mean difference of 0.5 SD between treatment groups, with a conservative 20% attrition rate (hence, analysing a minimum of 80 subjects) in our primary outcome measure. This corresponds to a mean difference of 7.5 units, given an expected SD of 15 for the List Sorting Working Memory Test of the NIH Toolbox.

Among children who receive the Cogmed intervention, we also seek to assess associations of cognitive, sociodemographic and medical factors with changes in the scores for our primary outcome measure (specific aim 3). Given a sample size of 50 children in the Cogmed group and a two-sided type I error rate of 5%, we have 79.9% power to detect a correlation of 0.43 (or R ²=0.43² = 0.185 from a linear regression) between a patient-specific factor and the primary outcome variable even with a conservative 20% attrition rate (analysing a minimum of 40 subjects).

Data analysis plan

For specific aims 1 and 2, the efficacy of the intervention will be evaluated by comparing within-subject differences (baseline to post-treatment, baseline to 3-month follow-up and, in secondary analyses, post-treatment to 3-month follow-up) across treatment groups using an intention-to-treat analysis.

Descriptive statistics will be calculated, including means, SD, medians and IQRs for continuous variables and frequency counts and percentages for categorical variables. The primary outcome measure, the List Sorting Working Memory Test of the NIH Toolbox and most other study outcomes are continuous variables. T-tests and linear regression will be used to assess differences between the intervention and control groups for continuous outcomes (ie, differences in means, 95% CI). Proportions and logistic regression will be used to examine group differences in binary outcomes (ie, χ² tests, ORs and 95% CI). We expect that randomisation will produce balance between treatment groups in terms of demographic and baseline factors, but we will use regression methods to adjust for any factors that may be unbalanced. All analyses will be accompanied by graphical exploration of the data to identify outlying and influential observations. Data transformations and non-parametric methods (eg, Wilcoxon rank-sum tests) will be used as appropriate when parametric assumptions are violated. Primary analyses of treatment group differences will focus on complete cases. In secondary analyses, we will assume no change over time for subjects who do not return for their post-treatment assessment (ie, last value carried forward approach), but we will also carry out other sensitivity analyses to assess the strength of our findings based on other missing data assumptions.

For specific aim 3, we will explore the associations between patient factors and within-subject differences (baseline to post-treatment, baseline to 3-month follow-up) using correlation and linear regression methods, including consideration of possible confounding or effect modification. Specific attention will be given to certain patient-specific risk factors including age at first heart surgery (neonatal vs non-neonatal), number of surgeries and neurological complications. Because we will be conducting multiple analyses with several predictors and primary and secondary outcomes in an exploratory fashion, we will interpret results cautiously, based on significance levels (p<0.05, two tailed) and on the magnitude of differences, correlations or regression effects. As appropriate, we will also consider the use of other statistical methods, such as generalised additive models, partial and sparse partial least squares and family-wise error rates, in our approach. Analyses will be conducted primarily using SAS V.9.4, Stata V.15.1, SPSS V.25 and R V.3.5.2.

Trial progress

The trial is currently in the active recruitment phase (first baseline assessment February 2017). This is Protocol V.4, 10 July 2018. Substantial protocol amendments will be communicated to investigators via email and to other parties as required. All changes are submitted to Boston Children’s Hospital’s IRB, to the Sponsor of this trial (US Department of Defense) and updated in clinicaltrials.gov.