Article Text

PDF

Pharmacy study of natural health product adverse reactions (SONAR): a cross-sectional study using active surveillance in community pharmacies to detect adverse events associated with natural health products and assess causality
  1. Candace Necyk1,
  2. Ross T Tsuyuki2,
  3. Heather Boon3,
  4. Brian C Foster4,
  5. Don LeGatt5,
  6. George Cembrowski6,
  7. Mano Murty7,
  8. Joanne Barnes8,
  9. Theresa L Charrois9,
  10. John T Arnason10,
  11. Mark A Ware11,
  12. Rhonda J Rosychuk12,
  13. Sunita Vohra12
  1. 1Faculty of Pharmacy and Pharmaceutical Sciences, University of Alberta, Edmonton, Alberta, Canada
  2. 2Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada
  3. 3Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, Ontario, Canada
  4. 4Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
  5. 5Department of Laboratory Medicine and Pathology, University of Alberta Hospital, Edmonton, Alberta, Canada
  6. 6Laboratory Services, University of Alberta Hospital, Alberta Health Services, Edmonton, Alberta, Canada
  7. 7Marketed Biologicals, Biotechnology and Natural Health Products Bureau, Marketed Health Products Directorate, Health Canada, Ottawa, Ontario, Canada
  8. 8Faculty of Medical and Health Sciences, School of Pharmacy, University of Auckland, Auckland, New Zealand
  9. 9School of Pharmacy, Curtin Health Innovation Research Institute, Perth, Australia
  10. 10Department of Biology, Faculty of Science, University of Ottawa, Ottawa, Ontario, Canada
  11. 11Alan Edwards Pain Management Unit, McGill University Health Centre, Montreal, Quebec, Canada
  12. 12Department of Pediatrics, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Alberta, Canada
  1. Correspondence to Dr Sunita Vohra; svohra{at}ualberta.ca

Abstract

Objectives To investigate the rates and causality of adverse event(s) (AE) associated with natural health product (NHP) use, prescription drug use and concurrent NHP-drug use through active surveillance in community pharmacies.

Design Cross-sectional study of screened patients.

Setting 10 community pharmacies across Alberta and British Columbia, Canada from 14 January to 30 July 2011.

Participants The participating pharmacy staff screened consecutive patients, or agents of patients, who were dropping or picking up prescription medications.

Primary outcome measures Patients were screened to determine the proportions of them using prescription drugs and/or NHPs, as well as their respective AE rates. All AEs reported by the screened patients who took a NHP, consented to, and were available for, a detailed telephone interview (14%) were adjudicated fully to assess for causality.

Results Over a total of 105 pharmacy weeks and 1118 patients screened, 410 patients reported taking prescription drugs only (36.7%; 95% CI 33.9% to 39.5%), 37 reported taking NHPs only (3.3%; 95% CI 2.4% to 4.5%) and 657 reported taking prescription drugs and NHPs concurrently (58.8%; 95% CI 55.9% to 61.6%). In total, 54 patients reported an AE, representing 1.2% (95% CI 0.51% to 2.9%), 2.7% (95% CI 0.4% to 16.9%) and 7.3% (95% CI 5.6% to 9.6%) of each population, respectively. Compared with patients who reported using prescription drugs, the patients who reported using prescription drugs and NHPs concurrently were 6.4 times more likely to experience an AE (OR; 95% CI 2.52 to 16.17; p<0.001). Combined with data from Ontario, Canada, a national proportion was calculated, which found that 45.4% (95% CI 43.8% to 47.0%) of Canadians who visit community pharmacies take NHPs and prescription drugs concurrently, and of those, 7.4% (95% CI 6.3% to 8.8%) report an AE.

Conclusions A substantial proportion of community pharmacy patients use prescription drugs and NHPs concurrently; these patients are at a greater risk of experiencing an AE. Active surveillance provides a means of detecting such AEs and collecting high-quality data on which causality assessment can be based.

Statistics from Altmetric.com

Strengths and limitations of this study

  • Active surveillance likely detects adverse events (AEs) due to natural health product (NHP) and prescription drug use at a higher rate than passive surveillance alone, the system that is currently employed by most of the regulatory agencies around the world.

  • Patient interviews allowed for meaningful information to be collected to allow for full causality assessment of an AE; laboratory analysis supported this assessment.

  • The AE rate in patients taking NHPs and prescription drugs concurrently could be compared with those taking prescription drugs alone.

  • The first national data were analysed for this hypothesis across Canada.

  • Data in British Columbia are not consistent with Alberta and Ontario.

  • Risk for possible biases (recall bias, selection bias) due to observational study design.

  • High loss to follow-up rate occurred between the screening and patient interview phases.

Introduction

The use of natural health products (NHPs) is popular worldwide.1–3 Recent surveys in North America, Australia and Europe have found that at least half of the population use NHPs, defined by Health Canada, Canada's federal regulatory agency, as any vitamin, mineral, herbal remedy, homeopathic medicine, traditional medicine, probiotic, amino acid or fatty acid product.1 ,4–7 NHPs have become the second most purchased over-the-counter (OTC) product in Canada in 2012, next to headache and pain relief products.2 Reasons for use are multifactorial, including an increased interest in natural approaches focused on prevention, media advertising and increased concern with taking synthetic drugs.1 ,8 Healthcare professionals are following this trend in their practices as well, with 38% of physicians now recommending NHPs to their patients and 89% of pharmacists spending more than 30 min/day counselling on these products.9 ,10

With increasing NHP use, the concern for consumer safety is also growing.3 ,11 ,12 Typically, NHPs are considered by users to be safe since they are ‘natural’13; however, studies demonstrate some serious toxicities and many possible adverse reactions (ARs) with the use of these products.3 ,11–15 Further, NHP use is higher among patients with chronic medical conditions,16 ,17 where prescription drug use is likely: 58% of cardiovascular patients taking narrow therapeutic index drugs used NHPs and prescription drugs concurrently,18 compared with 39.7% of community pharmacy patients screened in Ontario (ON).19 In patients over 50 years old, 87.4% of those taking NHPs did so in combination with drugs.20 Such patients are at greater risk of drug interactions,21 and therefore ARs.

In regulatory agencies worldwide, passive surveillance systems are employed to detect postmarketing ARs.22 These systems rely on spontaneous reports of suspected ARs by consumers, health professionals and industry.23 While this type of postmarketing surveillance allows for the detection of ARs in ‘real-world’ conditions, it depends on individuals recognising when an adverse event (AE) should be reported and their knowledge to submit a high-quality report for interpretation and assessment.22 ,23 Of note, an AE becomes an AR when causation is suspected to be due to a health product.24 An AE encompasses any unfavourable or unintended sign, symptom or disease associated with the use of a medicinal product, whether or not considered related to the product itself.24 It is estimated that only 1–10% of all AEs are ever captured by passive surveillance systems.23

Detection of AEs associated with NHPs is further complicated by physicians and pharmacists who do not consistently inquire about NHP use during medical history-taking, and reporting NHP-related AEs less often than AEs associated with prescription drugs or OTC drugs.9 ,25 In addition, many patients choose not to disclose NHP use to their healthcare providers, or to report to them about suspected adverse drug reactions associated with these products.12 Evidence suggests that one-third of patients are unaware of any risk associated with NHPs.26

An alternative system, or one that can be used to complement passive surveillance, is increasingly being identified as necessary to mitigate the harms to patients.23 Worldwide active surveillance systems, such as the Sentinel initiative to monitor postmarket risk analysis of health products in the USA and the National Cancer Registry in the UK, are proving to be a successful means of collecting AR data.23 A method of active surveillance that still appears underutilised, however, is the process of building AE detection screening into health professionals’ practice.

Pharmacy study of NHP ARs (SONAR) is a multicentre population-based observational study in which researchers partnered with Health Canada and community pharmacists and pharmacies to implement an active surveillance screening system to detect AEs associated with NHPs experienced by patients at this setting.19 A pilot study in ON, Canada, found that 39.7% of patients were taking NHPs and prescription drugs concurrently, of which 7.4% reported an AE.19 This represented at least a 3000-fold higher rate of ARs than that captured by Health Canada's passive surveillance system over a corresponding time period. The Pharmacy SONAR pilot study was limited, however, by the lack of comparable data for patients taking prescription drugs or NHPs alone.19

Pharmacy SONAR was expanded to Alberta (AB) and British Columbia (BC), Canada, to investigate the rate of each prescription drug, NHP and concurrent prescription drug-NHP use, and their respective AE rates, through an active surveillance model in community pharmacies across Western Canada. Our objective was to further assess the feasibility of implementing active surveillance into community pharmacy practices and to calculate a national proportion of patients using prescription drugs and NHPs concurrently, as well as the proportion of those reporting an AE.

Methods

A two-phase cross-sectional model, as detailed in the ON pilot study,19 was maintained for the purpose of this study. Phase I involved the implementation of active surveillance in community pharmacies and data collection through patient interviews; phase II involved AE causality assessment and laboratory analysis where appropriate.

Phase I: active surveillance

Community pharmacists volunteered to participate. In-store training and all relevant study materials, such as screening logs and patient information packages, were provided to each community pharmacy site. Each site received a copy of an authoritative reference text, Natural Standard27 and a NHP–drug interaction grid28 (created for the pilot study) to support knowledge in this area. Staff were provided follow-up and assistance through remote support (ie, telephone contact), as compared with in-person support by the ON study19 to assess for continued feasibility with less intervention.

All consecutive patients bringing prescriptions or collecting medication for themselves (or for a child or other close family member) at a participating pharmacy were included in the study. Pharmacists and pharmacy staff asked such patients three questions on the screening log (figure 1). The patients unable to communicate in English were excluded. NHPs were defined in accordance with Health Canada's definition: any vitamin, mineral, herbal remedy, homeopathic medicine, traditional medicine, probiotic, amino acid or fatty acid product.7 One month was chosen as a suitable screening history period to capture AEs following product use to minimise recall bias. If the patient answered yes to questions 2 and 3, they received a study information package. If the patient agreed to participate in follow-up, written consent was obtained by a pharmacy staff member and the study pharmacist was notified. Community pharmacy staff did not assess causality of any reported AE.

Figure 1

Patient screening questions.

The study pharmacist (CN) conducted a detailed telephone interview with consenting patients within 1 week of their reporting an AE(s). Verbal consent was obtained at the start of the interview. The interview comprised questions detailing medical conditions, all drug and NHP use and details around the AE(s). The interview form was adapted from the pilot study to include additional details of the NHPs (ie, how they were prepared, when relevant). A copy of the interview form is available from the corresponding author on request. The medical history of 3 months was collected through a telephone interview, allowing for more extensive data to lend knowledge to the overall causality assessment. If deemed necessary, the patient was asked to provide samples of the NHPs and drugs taken at the time of the AE(s) for laboratory analysis in phase II and for consent to report the AE(s) to Health Canada, if this had not already been done.

Phase II: causality assessment and laboratory analysis

All interviewed cases were summarised and adjudicated by a three-member committee: one clinical NHP expert, one basic science NHP expert and a committee chair (SV) knowledgeable in both areas. The two experts independently assessed each case based on the WHO Causality Assessment Criteria,29 the Naranjo Probability Scale30 and the Horn Drug Interaction Probability Scale.31 In each instance, consensus was reached through discussion. Two laboratories were available for undertaking the following analyses in this study: (1) NHP constituent assessment and (2) adulteration/contamination assessment. The laboratories tested the samples provided by the participants, and if the samples were unavailable, similar products from the same lot or batch were tested.

Statistical analysis

Phase I data were used to calculate proportions by pharmacy. A weighted average proportion for each outcome with the associated 95% CIs were provided using a logistic regression with intercept only model. ORs and the associated 95% CIs for AE rates for participants using NHPs only and NHP-prescription drugs concurrently, compared with prescription drug use only, were calculated using logistic regression. Stata V.12.0 was used for all analyses.32

Results

Phase I: active surveillance

Ten pharmacies across AB (n=7) and BC (n=3) participated in the study. Over a period of 105 pharmacy weeks (14 January to 30 July 2011), 1118 patients were screened. Tables 1 and 2 show proportions of patients screened using NHPs and/or prescription drugs and those reporting AEs, respectively. The results were similar when the responders with incomplete screening data (ie, each of the three questions were not filled in) were included in the denominator of the analysis; therefore, the results are reported including all patients screened.

Table 1

Weighted proportions of participants using prescription drugs, NHPs or both, by pharmacy and province

Table 2

Weighted proportions of participants reporting AEs for those using prescription drugs, NHPs or both, by pharmacy and province

When compared with taking prescription drugs alone, patients taking concurrent NHP-prescription drugs were 6.38 (95% CI 2.52 to 16.17; p<0.001) times more likely to experience an AE. When looking at AB separately, the OR was 4.78 (95% CI 1.88 to 12.16; p<0.001); an OR could not be provided for BC due to having no AE reports in the exposure reference group (prescription drugs only). Table 3 provides ORs for each province, where such analysis was possible. Similarly, data could not be further stratified by pharmacy due to a lack of AE reports in the exposure reference group in some pharmacies. Nearly half (n=17; 34.0%) of the patients reporting an AE, while also taking a NHP, consented to be contacted for a detailed interview, of whom 7 (14.0%) were interviewed. Four patients reporting an AE with NHP use were referred to the study for causality assessment. All four patients were interviewed and underwent phase II of the study; however, they were not included in the phase I analysis since they were not screened at a participating study site. Figure 2 details patient involvement during the two study phases.

Table 3

ORs of NHP use only and concurrent prescription drug-NHP use compared with prescription drug use only by province

Figure 2

Flow diagram of phase I and II results. AE, adverse event; NHP, natural health product.

Phase II: causality assessment and laboratory analysis

Nine of the 11 cases with detailed interviews underwent causality assessment; 2 were not assessed due to AEs occurring beyond the 1-month screening timeframe (figure 2). Two of nine cases (22.2%) were determined to be ‘likely’ due to a NHP, with one case likely due to an interaction between one or more NHPs and a prescription drug. A brief summary of each adjudicated case, as well as patient demographics collected, is described in table 4. Laboratory analysis was available for all cases that warranted it, which was determined on a case-by-case basis. Analyses were performed in three reported cases (3, 4 and 5) to assess contribution to causality assessment; significant findings, or lack thereof, are described in table 4.

Table 4

Summary of cases for which causality assessment was undertaken

Discussion

Principal findings

Implementing active surveillance into community pharmacies markedly improves the detection of AEs reported by patients taking NHPs. The results indicate that adding one or more NHPs to a patient's prescription drug regimen significantly increases the likelihood of reporting an AE. Our study's interview and adjudication process allowed for complete causality assessment of the AEs reported by consenting and interviewed patients, since an AE is not considered an AR until causality is suspected or confirmed, as well as until meaningful, high-quality AR reports are submitted to Health Canada. The screening questions trialled were brief33 and well accepted by pharmacists, allowing full disclosure around NHP use and an opportunity to discuss health outcomes with their patients.

Strengths of the study

Pharmacy SONAR's active surveillance detected 54 AE reports in 1118 patients screened; in comparison, Health Canada received 342 spontaneous AR reports involving NHPs during the same time period from a population of approximately 30 million Canadians.34 It is arguable whether these data are comparable, as by definition, AR reports assume a causal relationship by whomever submits them, while AE requires assessment to determine causality. While reports submitted to Health Canada are labelled ARs, they still undergo independent assessment by the regulatory agency to assess causality. Events identified in Pharmacy SONAR were labelled AEs pending adjudication; however, they were obtained through specific questioning about product exposure. We believe that the designation of ‘AR’ should be reserved until causality assessment has been determined. Our study was able to ascertain AE reports in specific patient subgroups: those taking prescription drugs only, NHPs only and both concurrently. Another strength of our study is the causality assessment that was available for each AE reported; however, in practical terms, it was restricted to only those who consented to, and were available for, an interview. Although scheduling patient interviews was not without challenges, all that were completed provided meaningful information to allow for a full adjudication of the AE. Health Canada could not provide information on how many of their 342 reports involving NHPs were assessed for causality.34 Many important steps need to be taken before a reported AE associated with a product can be deemed causal; unfortunately, data collected through passive surveillance systems are often of insufficient quality to support this process.11 ,23 ,24 ,35 The knowledge gained through laboratory analysis around constituents and toxicology of NHPs associated with AEs collected in our study allowed insight into the causality of the event.

Limitations of the study

Only a fraction of patients visiting participating pharmacies was screened in our study; exact information on the proportion screened is not known since pharmacies consider the denominator (number of patients seen) proprietary. Community pharmacists reported time constraints due to high prescription volumes and numerous corporate demands. We attempted weekly phone calls to improve staff involvement, but limited our support to that which could be accomplished remotely (ie, off-site). Seeking pharmacy participation from the store level rather than the corporate level seemed to improve staff engagement. Ideally, the screening questions tested in this study should be built into pharmacists’ routine practice in order to gain insight into their patients’ health outcomes and monitor health product (drugs and NHPs) safety. Given the Canadian population of 30 million people, the relatively few patients screened in our study do not allow for a definitive conclusion to be drawn; our results are, however, strongly indicative of the potential risks present when combining prescription drug and NHP use.

Biases were also possible given the observational study design. Sampling bias may have occurred with respect to whom, or when, pharmacists screened, based on their workload. Recall bias was minimised limiting the screening history timeframe to 1 month, encouraging patients to obtain information from product bottles during the interview and by confirming information from hospitalisation records.

The data collected from the pharmacies in BC are not consistent with that of AB, or even ON.19 Even with fewer overall patients screened, the AE rates found in individual pharmacies are much lower than other pharmacies in AB and ON with similar numbers of patients screened. Based on discussion with the pharmacy staff, no clear reasons were provided as to why this may have occurred. It is possible that the number of patients screened at those pharmacies was too few to capture a true AE rate, or there may be important differences in the number of AEs experienced by patients in this population. At the time of screening, pharmacists in BC were reimbursed by the government to conduct medication history interviews with their patients; this may have prevented or resolved AEs occurring in patients visiting these pharmacies. Further screening is needed to determine whether this variation found is a true difference or not.

Our study sampled patients visiting community pharmacies, who, therefore, are more likely to be taking prescription drugs, allowing us to sample our target population of individuals taking NHPs and drugs concurrently. Macedo et al36 concluded that these patients might be more likely to experience an AE, since the simultaneous exposure to three or more drugs significantly increases the risk of a serious AE. In addition, our study setting could not capture those patients who are hospitalised, due to a serious medical condition or AE, or those who may have experienced an AE that lead to death. Given that in any given week, over half of Canadians aged 18 years and older visit a pharmacy; community pharmacy was considered to be a suitable study setting to capture the general population.37

The NHPs listed in table 4 are stated as on the manufacturers’ product packages since this is the information immediately available to someone selling, recommending or purchasing a NHP; typically, manufacturers’ packaging did not include full product specifications, and often even basic details, such as plant species and plant part, were absent.

Study findings in the context of previous research

Results from our study were similar to those collected in our ON pilot study19; when these data are combined with those of AB and BC, estimated national proportions suggest that 45.4% (95% CI 43.8% to 47.0%) of Canadians who visit community pharmacies take NHPs and prescription drugs concurrently, and of those, 7.4% (95% CI 6.3% to 8.8%) report an AE. To our knowledge, no other national data about AEs associated with concurrent NHP-drug use have been reported previously. Active surveillance in paediatric populations has been studied, finding that 48% of patients to be using complementary and alternative medicine (CAM) and prescription drugs concurrently and 11% had potential vitamin and medication interactions.38 ,39 In patients of 50–64 years old, 14.2% were at risk of a potential NHP–drug interaction; this proportion increased to 23.7% and 38.4% in those taking 5 or more and 10 or more health products concurrently, respectively.21

When looking at NHP safety, other active surveillance systems such as national and provincial drug and disease registries or databases are limited, as most of them lack the ability to record NHP and OTC product use.23 ,40 In addition, many of these registries and databases focus on chronic medical conditions, such as cancer or rheumatoid arthritis,23 and the general population is not targeted. Menniti-Ippolito et al41 found that active surveillance increased AE reporting from 4 to 15.1 in 100 000 children screened. Similarly, AE reporting in a CAM-specialised primary care setting improved by 148% when active surveillance was implemented.42

Our study results provide similar data to a recent national Health Canada survey, where 73% of Canadians report taking at least one NHP and 15% experienced an unwanted reaction.1 However, we were able to capture more specific data (ie, how many of those patients were taking a NHP with a prescription drug vs alone) and we identified a markedly higher number of AE reports than Health Canada.1 It can be argued that the type of events reported through spontaneous reporting is already suspected to be causally linked to a health product by the reporter, and would therefore be viewed as an AR instead of an AE. It is possible that Pharmacy SONAR captured a higher number of harms due to screening for all AEs, with or without suspicion of causation. However, it is also possible that the first two questions in the screening process may have prompted a patient to link an event to a health product (asking about product use before asking about an AE). In addition, the pharmacy staff may have selectively recorded certain AEs over others based on their own knowledge or bias around whether a causal link was plausible.

A survey conducted by Salvo et al43 in southern Italy found that women aged between 18 and 52 years who reported an adverse drug event (ADE) were significantly more likely to be using alternative or complementary medicine than those who reported no ADE (20.4% and 8.2%, respectively). This survey also collected data on drug use; however, details around how drugs and complementary medicines were taken (alone or in combination) were not described.43 Our study was able to collect such data and, as such, determine whether patients taking both types of products in combination are more likely to experience an AE than those taking drugs alone.

It is likely that there exists a continuum between food, or dietary compounds, NHPs and drugs, and clinically relevant interactions exist along this spectrum. Studies in the literature report such interactions44–48 and further research will likely continue in this area. The data collected in our study involved drug use and NHP use; however, further information was collected on dietary intake during the telephone interview, especially when food or beverages were taken at the same time as NHPs and/or drugs, and considered by the adjudication committee when assessing for causality.

Implications for policy, research and clinical practice

While passive surveillance systems play an important role in pharmacovigilance, the use of current active surveillance models should be used to complement these systems.22 ,23

Health professionals are encouraged to screen for NHP use and AEs associated with NHP and prescription drug during routine patient care. By improving the rates of AE identification and reporting, possible harms can be detected sooner, and even prevented. Our study screening questions are brief, taking approximately 15 seconds per patient to administer.19 Health professional prompting will increase the discussion around NHPs with their patients as well as improve awareness of the therapies their patients are engaged in so as to improve safety and health outcomes. It is also important for clinicians to consider that there is a continuum from food–functional foods–nutraceuticals–NHPs–OTCs–prescription drugs, and they should be vigilant in collecting a complete medical history from patients around all products taken and any dietary modifications made by patients for the purpose of health.

The data collected during this study will be populated in a database to allow for health professional and researcher access to NHPs, prescription drugs and combinations that have been used with and without reported AEs, as well as details around specific AEs found. The data collected around which prescription drugs and NHPs were taken with and without reports of harm would be valuable to analyse, and would be important to patient safety in the future.

Conclusions

Pharmacy SONAR demonstrates that active surveillance of prescription drug and NHP-related AEs in community pharmacies is feasible and increases the rate of AE detection significantly compared with that of passive surveillance. With methods refined in our pilot study,19 we have been able to determine national estimates for NHP, drug and concurrent NHP-drug use and associated AEs. Of particular note, one of the strongest aspects of this study is its ability to assess each case reported for causality, to include laboratory analysis of products and produce high-quality suspected AR reports for the federal regulatory body (in this case, Health Canada).

Future research might include assessing the impact of implementation of active surveillance of NHPs in different healthcare locations, such as hospitals or naturopathic clinics. In addition, it would be valuable to screen patients with chronic medical conditions who may be at higher risk for experiencing AEs. In terms of the study process, methods to improve the number of patients screened and those interviewed after reporting an AE (loss to follow-up) would allow for a more definitive conclusion to be drawn and more data collected in this area.

Acknowledgments

The authors would like to thank Hitesh Bhatt for his assistance in data analysis.

References

View Abstract

Footnotes

  • Contributors CN initiated the project, responsible for design and methodology, interviewed the patient presented in case report and wrote manuscript (including final draft). RTT participated in original conception and design of the project, case adjudication, supervised project and reviewed all drafts of manuscript. HB supervised project, participated in original conception and design of the project and reviewed all drafts of manuscript. JB, MAW and TLC participated in original conception and design of the project, case adjudication and reviewed final draft of manuscript. JTA, DL, GC and BCF participated in original conception and design of the project, case adjudication, laboratory analysis and reviewed final draft of manuscript. MM participated in original conception and design of the project, provided support from Health Canada and reviewed final draft of manuscript. RJR participated in original conception and design of the project, provided graduate student statistical support and reviewed final draft of manuscript. SV is the primary supervisor of project, participated in original conception and design of the project, and reviewed all drafts of manuscript.

  • Funding This work was funded by the Canadian Institute of Health Research, Health Canada, Canadian Patient Safety Institute.

  • Competing interests SV receives salary support from the Canadian Institute of Health Research and holds an Alberta Heritage Foundation for Medical Research Health Scholar Award. RJR receives salary support by Alberta Innovates—Health Solutions (Edmonton, Canada) as a Health Scholar.

  • Ethics approval Human Research and Ethics Board, University of Alberta.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement Researchers can access the data collected in this study through the corresponding author.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.