2A. Quantitative evaluations—well described | ||||||||
Study | New orvalidatedoutcome | Outcome | Outcomes—thematicgrouping | N | Premean (SD) | Postmean (SD) | Meanchange (SD) | Pvalue |
Quantitative studies reporting pretest and post-test or a control group | ||||||||
Bhavaraju and Miller38 | New | Confidence in writing and leading writing exercises |
| 12 | 3.1 | 4.2 | 1.1 | N.R. |
New | Confidence in leading literary discussions |
| 10 | 3.7 | 4.4 | 0.7 | N.R. | |
New | Integration of tools gained in training into teaching |
| 10 | 2.2 | 2.7 | 0.5 | N.R. | |
Harrison and Chiota-McCollum85 | New | Listening skills |
| 11 | (Median) 4.0 | (Median) 4.0 | (Median) 0 | N.R. |
New | Visual observation skills |
| 11 | (Median) 4.0 | (Median) 4.0 | (Median) 0 | N.R. | |
New | Understanding of narrative medicine |
| 11 | (Median) 3.0 | (Median) 4.0 | (Median) 1.0 | N.R. | |
New | Value of the arts in medical education |
| 11 | (Median) 3.0 | (Median) 5.0 | (Median) 2.0 | N.R. | |
Holub55 | Validated | JSPE—control group |
| 41 | 119.10 (15.64) | 116.15 (16.15) | −2.95 (6.77) | 0.001 |
Validated | JSPE—treatment group | 41 | 119.28 (9.05) | 124.48 (8.47) | 5.10 (7.20) | |||
Rivlin and Westhoff87 | Validated | Objective structured clinical examination—control group |
| 50 | N/A | 11.9 (1.5) | N/A | 0.0049 |
Validated | Objective structured clinical examination—treatment group |
| 50 | N/A | 11.3 (1.6) | N/A | ||
Winkel70 and Winkel et al22 | Validated | Maslach burnout inventory: emotional exhaustion |
| 43 | N.R. | N.R. | −2.0 (8.7) | 0.12 |
Validated | Maslach burnout inventory: depersonalisation |
| 43 | N.R. | N.R. | 0.1 (4.0) | 0.61 | |
Validated | Maslach burnout inventory: personal accomplishment |
| 43 | N.R. | N.R. | 1.2 (7.1) | 0.70 | |
Validated | Interpersonal reactivity: empathic concern |
| 43 | N.R. | N.R. | 0.76 (5.9) | 0.01 | |
Validated | Interpersonal reactivity: perspective taking |
| 43 | N.R. | N.R. | 21.37 (7.8) | 0.01 | |
Yang et al82 | Validated | Jefferson Scale of Empathy—control group |
| 48 | 104.08 (12.43) | 103.85 (12.00) | −0.23 (N.R.) | N.R. |
Validated | Jefferson Scale of Empathy—treatment (NM only) group |
| 53 | 104.59 (13.48) | 107.57 (12.83) | 2.98 (N.R.) | N.R. | |
Validated | Jefferson Scale of Empathy—treatment (NM+reflective writing) group |
| 52 | 104.42 (14.11) | 109.98 (13.37) | 5.56 (N.R.) | P<0.05 | |
Quantitative studies using a cross-sectional design with a post-test only | ||||||||
Study | New or validated outcome | Outcome | Outcomes—thematic grouping | N | Postmean (SD) | |||
Goupy et al51 | New | Interest of topic | Satisfaction | 41 | 1.84 (0.82) | |||
New | Satisfaction with choice of theme | Satisfaction | 41 | 2.13 (0.72) | ||||
New | Satisfaction of discussion related to theme | Satisfaction | 41 | 2.30 (0.62) | ||||
Whitesides et al89 | New | Quality of sessions | Satisfaction | 44 | 4.5 | |||
New | Usefulness of writing component | Satisfaction | 44 | 3.9 | ||||
New | Usefulness of the group discussion | Satisfaction | 44 | 4.5 | ||||
Study | New or validated outcome | Outcome | Outcomes—thematic grouping | N | % agreement with outcome | |||
Gowda et al84 and Gowda et al52 | New | Participant would recommend training |
| 50 | 94 | |||
New | Participant would continue participating |
| 50 | 74 | ||||
New | Programme’s ability to facilitate interprofessional dialogue |
| 50 | 90 | ||||
Goodrich et al49 | New | Usefulness of the training |
| 48 | 79 | |||
New | Interest of the training |
| 48 | 88 | ||||
Hinyard et al77 | New | Writing about own experiences helped develop communication skills |
| 24 | 80 | |||
New | Listening to stories helped develop communication skills |
| 24 | 88 | ||||
Moss et al63 | New | Satisfaction of training |
| 27 | 99 | |||
New | Relevance of training to work |
| 27 | 97 | ||||
Walker et al69 | New | Total satisfaction with course |
| 20 | 89 | |||
New | Appropriateness of activities |
| 32 | 94 | ||||
New | Overall experience with instructors |
| 32 | 97 | ||||
2B. Qualitative evaluations—well described† | ||||||||
Study | Design | Timing | Methods | Outcome improved—thematic grouping | ||||
Adamson et al74 | Pretest and post-test | Pretest, immediate post-test | Interviews |
| ||||
Arntfield et al33 | Post-test | Immediate, 1.5 years later | Open-ended surveys; focus group |
| ||||
Balmer and Richards37 | Post-test | Immediate | Ethnography, content analysis, interviews |
| ||||
Birigwa et al39 | Post-test | Immediate | Surveys |
| ||||
Bobb40 | Post-test | Immediate | Ethnography, interviews |
| ||||
Boudreau et al41 and Liben et al42 | Randomised step wedge | Immediate | Interviews |
| ||||
Brigley and Jasper43 | Post-test | Immediate | Observation, focus groups, interviews |
| ||||
Chretien et al44 and Chretien et al45 | Post-test | Immediate | Focus groups, patient interviews |
| ||||
Cunningham et al76 | Post-test | Immediate | Content analysis of essays |
| ||||
DasGupta et al46 and DasGupta15 | Post-test | Immediate | Focus groups, resident evaluations |
| ||||
Goodrich et al49 | Post-test | Immediate | Focus group; programme evaluation survey |
| ||||
Gordon50 | Post-test | Immediate | Content analysis of essays |
| ||||
Goupy et al51 | Post-test | Immediate | Open-ended survey |
| ||||
Gowda et al52 and Gowda et al84 | Pretest, midpoint-test and post-test | Pretest, midpoint-test, immediate post-test | Observational notes, interviews, survey |
| ||||
Harrison and Chiota-McCollum85 | Post-test | Immediate | Open-ended survey |
| ||||
Hinyard et al77 | Post-test | Immediate | Open-ended survey |
| ||||
Holub55 | Post-test | Immediate | Focus groups |
| ||||
Kennedy and Sgro58 | Post-test | Immediate | Open-ended survey |
| ||||
Murrinson64 | Post-test | Immediate | Content analysis of responses |
| ||||
Polvani et al65 | Post-test | Immediate | Patient and family interviews; video-recorded patient-doctor interactions, document review of letters of complaint |
| ||||
Small et al90 | Post-test | 1.5 years later | Interviews |
| ||||
Spike91 | Post-test | Immediate | Open-ended survey |
| ||||
Walker et al69 | Post-test | Immediate | Open-ended survey |
| ||||
Wesley et al81 | Post-test | Immediate | Open-ended survey |
| ||||
Winkel et al71 | Post-test | Immediate | Questionnaire |
| ||||
Wohlmann and Halstein72 | Post-test | Immediate | Open-ended survey |
| ||||
Zohouri et al73 | Post-test | Immediate | Content analysis of essays |
|
*All quantitative evaluations—well-described report evaluation at the end of the programme except for Winkel et al and Winkel.22 70
†See online supplementary appendix 2 for outcomes/findings.
N/A, not available; N.R., not reported.