Article Text

Download PDFPDF

Developing implementation strategies for firearm safety promotion in paediatric primary care for suicide prevention in two large US health systems: a study protocol for a mixed-methods implementation study
  1. Courtney Benjamin Wolk1,
  2. Shari Jager-Hyman1,
  3. Steven C Marcus2,
  4. Brian K Ahmedani3,
  5. John E Zeber4,
  6. Joel A Fein5,6,
  7. Gregory K Brown1,
  8. Adina Lieberman1,
  9. Rinad S Beidas1
  1. 1Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
  2. 2School of Social Policy and Practice, University of Pennsylvania, Philadelphia, Pennsylvania, USA
  3. 3Henry Ford Health System, Center for Health Policy and Health Services Research and Behavioral Health Services, Detroit, Michigan, USA
  4. 4Center for Applied Health Research, Baylor Scott & White Health, jointly with Central Texas Veterans Health Care System, Dallas, Texas, USA
  5. 5Department of Pediatrics, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
  6. 6Division of Emergency Medicine, The Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
  1. Correspondence to Rinad S Beidas; rbeidas{at}upenn.edu

Abstract

Introduction The promotion of safe firearm practices, or firearms means restriction, is a promising but infrequently used suicide prevention strategy in the USA. Safety Check is an evidence-based practice for improving parental firearm safety behaviour in paediatric primary care. However, providers rarely discuss firearm safety during visits, suggesting the need to better understand barriers and facilitators to promoting this approach. This study, Adolescent Suicide Prevention In Routine clinical Encounters, aims to engender a better understanding of how to implement the three firearm components of Safety Check as a suicide prevention strategy in paediatric primary care.

Methods and analysis The National Institute of Mental Health-funded Mental Health Research Network (MHRN), a consortium of 13 healthcare systems across the USA, affords a unique opportunity to better understand how to implement a firearm safety intervention in paediatric primary care from a system-level perspective. We will collaboratively develop implementation strategies in partnership with MHRN stakeholders. First, we will survey leadership of 82 primary care practices (ie, practices serving children, adolescents and young adults) within two MHRN systems to understand acceptability and use of the three firearm components of Safety Check (ie, screening, brief counselling around firearm safety and provision of firearm locks). Then, in collaboration with MHRN stakeholders, we will use intervention mapping and the Consolidated Framework for Implementation Research to systematically develop and evaluate a multilevel menu of implementation strategies for promoting firearm safety as a suicide prevention strategy in paediatric primary care.

Ethics and dissemination Study procedures have been approved by the University of Pennsylvania. Henry Ford Health System and Baylor Scott & White institutional review boards (IRBs) have ceded IRB review to the University of Pennsylvania IRB. Results will be submitted for publication in peer-reviewed journals.

  • implementation
  • intervention mapping
  • means restriction
  • firearms
  • suicide
  • adolescent

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • This study aims to engender a better understanding of how to implement the three firearm components of a universal evidence-based safety intervention (ie, Safety Check) as a suicide prevention strategy in paediatric primary care.

  • This study will advance the implementation science literature by using intervention mapping to systematically develop multilevel implementation strategies in partnership with stakeholders.

  • The study will be conducted in two large, diverse, and geographically distinct health systems in the USA, and the extent to which results will generalise to other health systems is unknown.

  • Both participating health systems are a part of the Mental Health Research Network (MHRN); health systems participating in the MHRN may have unique characteristics that may limit generalisability.

  • The firearm components of Safety Check have previously been bundled with other injury prevention strategies; thus, the effectiveness of Safety Check as a stand-alone firearm safety intervention specifically for suicide prevention in paediatric primary care is unknown.

Introduction

The rate of youth suicide has increased steadily over the past 15 years.1 The most recent statistics identify suicide as the second leading cause of death among adolescents in the USA,2 making this a critical age group to target for suicide prevention strategies. Firearms are the most common and most lethal method of suicide deaths in the USA; risk of suicide is two to five times greater in homes containing a firearm.3 This is of great concern given that one in three US homes contain a firearm.4 5 Thus, safe firearm practices at home are of paramount importance in reducing death by suicide among youth.

Lethal means restriction refers to the promotion of practices to make the environment safer by reducing access to potentially lethal methods of suicide. Several population-level natural experiments have supported the efficacy of means restrictions.6 For example, in the 1960s, the UK substituted domestic gas with a non-toxic alternative, resulting in a 30% drop in the national suicide rate.7 8 In the 1990s, the Sri Lankan government placed restrictions on the sale of toxic pesticides, the leading suicide method in the country at the time, and overall suicide rates dropped by 50%.9 A 2006 Israeli policy designed to reduce soldier suicide required soldiers to leave their firearms on base during periods of leave, resulting in a 40% decrease in soldier suicides.10

Reducing access to firearms is one promising, although underutilised, suicide prevention strategy. Firearm means restriction strategies include the promotion of safe firearm storage practices as well as gun control legislation to reduce availability to firearms generally and to children in particular. In the USA, broadly reducing access to firearms has been deemed infeasible.11 Child access protection laws are associated with modest effects.12 Estimates from case–control and simulation studies suggest that a firearm safety intervention implemented in the USA yielding even modest results (ie, only one-fourth of households restrict access to firearms) could lead to 3600–3900 adult lives saved annually.6 13

Although suicide prevention strategies for youth have traditionally been implemented in behavioural health settings,14 only one-third of youth receive mental health treatment in the 12 months preceding a suicide attempt.15–17 Yet four out of five youth who die by suicide will have visited primary care in the year prior to their death,16 and 90% of youth visit primary care annually,18 highlighting the advantages of implementing a universal prevention approach in primary care for firearm safety interventions. One intervention, Safety Check, includes a tripronged approach to firearm safety counselling and resulted in safer firearm storage practices in homes with children aged 2–11 years.19 Safety Check in its original form includes screening about access to firearms, brief counselling informed by motivational interviewing informed counselling regarding firearm safety and provision of free firearm locks bundled with other injury prevention strategies (eg, use of time out).19 In a large cluster-randomised trial of 137 paediatric primary care practices, parents who received the Safety Check intervention reported they were 21.4% more likely to engage in safe firearm storage practices compared with parents in the control condition at 6-month follow-up. Despite the substantial evidence base, as well as recommendations from the American Academy of Pediatrics20 and the Institute of Medicine,21 the three firearm components of Safety Check continue to be underutilised in US paediatric primary care clinics.13 15 22

To maximise the likelihood that this promising intervention is translated into practice, it is essential to gain a more nuanced understanding of the implementation context from multiple levels. Importantly, it is necessary to understand barriers and facilitators to implementation that relate to characteristics of providers, organisations and the health systems, as well as the states in which they work. These perspectives have been understudied. In the case of firearms, it is also important to obtain the perspectives of both firearm-owning and non-owning stakeholders when possible.23 While information can be gleaned from efforts to implement other safety interventions, such as seatbelts, given that doctor–patient firearm conversations have been the topic of legislation in the USA, firearm safety interventions may involve unique barriers. Therefore this formative work is critical to the successful, large-scale implementation of Safety Check.

The Consolidated Framework for Implementation Research (CFIR) provides a context to guide the project.24 The CFIR24 is an effort to synthesise the many conceptual frameworks in implementation science.25 The five major domains that comprise the CFIR24 are (1) intervention characteristics (ie, the features of an intervention); (2) outer setting (ie, the economic, political and social context within which an organisation exists); (3) inner setting (ie, the organisational setting); (4) characteristics of individuals involved in implementation (eg, providers); and (5) the implementation process (see figure 1). In the case of Safety Check implementation, intervention characteristics such as terminology (eg, means restriction vs firearm safety, endorsement of written materials by firearm organisations) may be important. At the provider level, low self-efficacy or lack of knowledge about best practices for firearm safety promotion and/or suicide prevention may contribute to provider reluctance to engage in discussions with patients about firearms.26–29 At the inner setting, barriers and facilitators regarding availability of resources (eg, firearm locks, educational pamphlets focused on safe storage of firearms) and organisational support (eg, buy-in from front-desk staff and management) may be present. Outer setting barriers may include lack of policies to support implementation (eg, absence of guidelines about firearm counselling and associated documentation in the electronic health records) and state legislation. For example, the Florida Privacy of Firearm Owners Act, passed in 2011, stipulated that providers must refrain from enquiring about firearm ownership and documenting firearm-related information in patients’ medical record except under specific circumstances, such as when the healthcare practitioner determines that this information is relevant to the patient’s safety or the safety of others. Of note, despite the stipulation permitting providers to enquire about and/or document firearms-related information when relevant to matters of safety, many providers mistakenly believed that it was illegal to discuss firearms during healthcare visits under any circumstances,30 and thus refrained from doing so. Key provisions of this legislation were overturned in 201731; however, similar legislation has passed in other states (eg, Montana, Missouri and Minnesota), and more restrictive legislation has been proposed elsewhere (eg, a pending proposal in Ohio prohibits any enquiries related to firearm ownership or possession without exception).30 Currently, there are no state or federal laws prohibiting provider questioning or counselling about firearms.

Figure 1

Study guiding framework. Figure adapted from Damschroder.62 CFIR, Consolidated Framework for Implementation Research.

Intervention mapping is a systematic approach to intervention development that has been used to develop a number of effective health-related programmes, including those addressing sex education,32 obesity,33 cancer prevention,34 osteoarthritis and low back pain.35 Intervention mapping, used in concert with the CFIR,24 can be applied to develop a menu of implementation strategies in a systematic and rigorous way by helping identify who should be involved in adoption, implementation and maintenance of interventions, as well as what specific behaviours they need to engage in.36 To date, implementation strategies have not been developed methodically and have lacked rigour in their application.37

Objectives and aims

Our goal in this study (Adolescent Suicide Prevention In Routine clinical Encounters; ASPIRE) is to collaboratively develop implementation strategies in partnership with stakeholders to understand how to most effectively implement a firearm safety intervention in US paediatric primary care (operationally defined as including paediatrics, internal medicine, family medicine and/or adolescent medicine). To date, there has not been a study to systematically examine factors that may impede or facilitate implementation of a firearm safety intervention as a suicide prevention strategy at the provider, organisation and system levels. This formative work is necessary to inform the development of multilevel implementation strategies to reduce death by suicide in youth. The National Institute of Mental Health-funded Mental Health Research Network (MHRN; www.mhresearchnetwork.org), a consortium of 13 healthcare systems across the USA, is an exceptional laboratory with established research infrastructure in which to better understand how to implement a firearm safety intervention in primary care from a system-level perspective.

Aim 1

We will survey the clinical leadership and providers of 82 primary care practices within two MHRN systems to understand (1) beliefs about the acceptability of screening, brief counselling around firearm safety and provision of firearm locks within paediatric primary care; and (2) use of these practices. Additionally, we will investigate if patient-level, provider-level and system-level characteristics predict acceptability and use of these practices.

Aim 2

In collaboration with MHRN stakeholders in these two systems, we will use intervention mapping and the CFIR24 to systematically develop and evaluate a multilevel menu of implementation strategies for youth firearm safety as a suicide prevention strategy in paediatric primary care.

Methods and analysis

We began data collection for this project in August 2016. The study is expected to conclude in April 2018.

Setting

The MHRN is a consortium of 13 public domain research centres based in large not-for-profit healthcare systems covering approximately 13 million lives in 15 US states. The mission of the MHRN is to improve the management of mental health conditions by connecting research, practice and policy. We have recruited two MHRN health systems to participate in project ASPIRE. The Henry Ford Health System (HFHS) has 37 primary care practices and serves 1 million lives annually; 12% of those individuals are under the age of 18. Thirty-eight per cent are ethnic minorities, which is important, given evidence that there are widening racial disparities among youth in the USA such that suicide has increased among black children while decreasing among white children.38 Baylor Scott & White (BSW) has 45 primary care practices and serves 630 000 lives annually; nearly 20% of those individuals are under the age of 18. This system is located in Texas, where proposed legislation prohibiting physicians from asking about firearm ownership is currently under review,39 and includes a number of rural practices, which is important given evidence that suicide rates among adolescents and adults are higher in rural versus urban communities and rural–urban disparities are increasing over time.36 40

Aim 1

Rationale

We will survey clinical leadership and providers of paediatric primary care practices within the two systems of interest to understand variation in acceptability and use of the three firearm components that comprise the Safety Check intervention.

Firearm safety intervention

The Safety Check intervention is an evidence-based safety intervention targeted to parents of children aged 2–11.19 It includes three firearm components: screening, brief counselling and provision of firearm locks. Given evidence that providers perceive components of evidence-based practices differently,41 we have elected to examine the acceptability and use of each of the three individual components separately rather than ask questions about the intervention as a whole. Additionally, in aim 1, we are hoping to extend research on Safety Check by understanding acceptability and use in youth for suicide prevention. In the original study19 examining the efficacy of Safety Check, the intervention was conducted on a different age group, with a focus on safe firearm storage for injury prevention; the firearm intervention was bundled with other injury prevention strategies (eg, use of time out). This will allow us to understand to what extent Safety Check adaptations are needed to maximise the success of broad health systems implementation efforts.

Sample

The target population for this survey will be clinical leadership and providers at all paediatric primary care practices within the participating MHRN sites. Current estimates suggest that the number of practices across both systems is 82. We elected to recruit all leaders (ie, physician managers) of paediatric primary care practices and all physicians who had seen 100 or more youth patients within the preceding 1 year from each of the 82 practices in the two health systems (n=261; we anticipate 80% recruitment rate for a total of 209).42 A brief electronic survey will be sent to these clinical leaders and providers to determine acceptability and use of the three firearm components of the Safety Check intervention at that site. The required elements of informed consent will be described on the first page of the electronic survey and, if they agree to participate, clinical leadership and providers will consent by proceeding to the second page of the electronic survey. We have obtained a waiver of written documentation of consent from the University of Pennsylvania Institutional Review Board (IRB). To ascertain our sample, investigators at each site will identify the physician managers of paediatric practices within their system and will use electronic health records to identify primary care providers who treat youth in those practices. To enhance participation, and based on previous work suggesting that participation is very high if the request comes from a contact within the system, investigators at each site will initiate contact with potential participants at their site and send the web-based survey. Each participant who completes the survey will receive a $10 gift card.

Data sources

Primary data

The survey will query about acceptability and use of the three firearm components of Safety Check, as well as relevant demographic information (eg, practice experience, firearm ownership). Sample questions include ‘Asking all caregivers about the presence of firearms in the home would be an acceptable suicide prevention strategy in my practice’ (rated from 1=strongly disagree to 6=strongly agree) and ‘How often do you screen caregivers of youth for the presence of a firearm in the home of youth’ (rated from 0=never to 4=always). All of the items in the survey have undergone cognitive response testing with physician managers and physician providers in paediatric primary care to identify ambiguous wording, awkward instructional sets and portions that may have been difficult to complete.42 Respondents have also evaluated the face validity of the survey during this process. In addition, before and after piloting, content validity was evaluated by experts in suicide research and primary care.

Secondary data

We will use publicly available data sources including data from the MHRN data warehouse, which includes a combination of electronic health records, insurance claims data and the National Center for Health Statistics National Vital Statistics System.42 A programmer from each MHRN system will extract information from the data warehouse for participating providers: patient demographics (age, gender, race, ethnicity, patient language, Patient Health Questionnaire-9 (PHQ-9)43 score and diagnostic codes); encounters (e-codes related to suicide and self-inflicted injury)42; provider demographics (specialty, age, gender, race, ethnicity and year graduated); census (socioeconomic indicators for patients based on geocoded patient addresses); public census data (education, income and poverty); and mortality (patient death by suicide; this is only currently available in HFHS). Additionally, we will extract youth (aged 12–24) suicide deaths over the past 5 years at the county level for each primary care practice location from the National Vital Statistics System.42 These data will be used as predictor variables in analyses examining characteristics associated with acceptability and use of firearm safety strategies.

Analyses

Our quantitative analyses will identify the patient, provider and site characteristics associated with acceptability and use of the three components. To examine the effect of patient, provider and site factors on acceptability, we will use three separate ordinary least squares regression models. For each model, the dependent variable will be the mean of the acceptability items on the survey, measured on a 6-point scale. The independent variables will include measures of patient demographics (eg, ethnicity/race), enrolment, provider demographics (eg, age) and geographically derived socioeconomic and mortality indicators. Analyses will be conducted separately for the physician manager and physician provider samples when questions were worded differently (eg, ‘I would consider using this strategy in my practice’ for physicians and ‘I would consider asking the providers in my practice to use this strategy’ for managers). For questions that are worded identically (eg, ‘Caregivers in my practice would view this strategy as intrusive’), we will run a single model and include responder type as a covariate.

In the physician manager group, respondents will report the per cent of providers in the practice who make use of each component. We will use linear regression models to examine the extent to which the independent variables predict use of the three components in paediatric practices. With 77 survey responses in each group, our models will have 80% power to detect a moderate effect (r2=0.09) of the independent variable while controlling for seven covariates. In the provider sample we will use logistic regression to predict any use (vs no use) of the three practices. Assuming 77 survey responses and that 24% of providers endorse use of each Safety Check component, we will be fully powered to detect between-group differences of 11% vs 36% in use of any of the three firearm components of Safety Check. For both samples, we will use multinomial logistic regression to model, among responders who report any use of each component at their site, the frequency with which they are used (rarely, sometimes, always). All models will control for health system.

Outcome

Based on the results generated from our survey, we will create a summary of acceptability and use of the three firearm components of Safety Check across each system to present as part of aim 2 to stakeholders.

Aim 2

In collaboration with MHRN stakeholders in these two systems, we will use intervention mapping and the CFIR24 to systematically develop and evaluate a multilevel menu of implementation strategies for a firearm safety intervention as a suicide prevention strategy in paediatric primary care.

Rationale

While intervention mapping has been proposed as a method for designing implementation strategies,42 it has yet to be widely used in this way. In a recently published proof-of-concept study, intervention mapping was employed to develop a multilevel implementation strategy to increase physicians’ adherence to guidelines for depression.42 Compared with implementation as usual, the implementation strategy developed using intervention mapping was found to increase adherence to the guidelines.42 In the proposed study, we are applying these tools to the development of multilevel implementation strategies to change provider, organisation and system behaviours around firearm safety promotion practices in paediatric primary care. The approach is consistent with the CFIR.24 To accomplish this, we will focus on the fifth step of intervention mapping, which focuses on planning for adoption, implementation and sustainment.44

Procedure

The target behaviour is implementation of a firearm safety intervention in paediatric primary care intended to be a suicide prevention strategy. As in other studies, the final content to emerge from intervention mapping cannot yet be specified because it depends on information gleaned from the intervention mapping process.

Needs assessment

Using the CFIR to guide us, we will assess the needs of stakeholders who will be impacted by implementing a firearm safety intervention in paediatric primary care.24 We will conduct semistructured interviews with MHRN stakeholders from the following groups: (1) parents of youth ages 12–24, (2) physician providers, (3) non-physician providers (nurses, physician assistants, medical assistants), (4) leaders of primary care practices, (5) leaders of behavioural health, (6) leaders of quality improvement in each system, (7) system leaders, (8) third-party payers and (9) members of national credentialling bodies and professional organisations (eg, American Academy of Pediatrics). We will use purposive sampling45 to recruit approximately six individuals from each stakeholder group (three per health system) and sample across the two systems to ensure diversity in responses. We will also return to aim 1 participants and invite their participation and ask them who else in their system we should interview. We estimate we will conduct approximately 54 interviews; however, this number will depend on thematic saturation (ie, when no new ideas or themes are identified46 in subsequent interviews). We will use purposive sampling to recruit a sample of parents that includes at least 67% firearm owners. Fifty per cent of those firearm-owning parents will also be parents of youth at high risk for suicide based on medical records (ie, PHQ-9 scores). In the case of providers and leaders of primary care practices, we will use stratified sampling to ensure that we recruit participants endorsing use of at least one of the Safety Check firearm components as reported in aim 1 and at least 50% firearm owners as reported in aim 1. In part I of the interview, we will present practice stakeholders with the aggregated data on their system collected in aim 1 and use the qualitative interviews as an opportunity to understand these data in a more nuanced fashion (quan→QUAL),47 consistent with previous studies.48 For example, ‘Your practice reported that about 50% of providers at your site screen for firearms in the home. Can you tell me more about how this is usually done?’ In part II of the interview, we will use the CFIR24 to query around barriers and facilitators at the intervention, provider, inner and outer setting levels, and the support needed to be able to provide a firearm safety intervention in daily practice (eg, ‘What kinds of changes or alterations to the intervention do you think would be needed for you to use it effectively?’ and ‘What resources or support would be needed to effectively implement screening, counseling, and gun lock provision in your setting?’). In part III of the interview, we will use intervention mapping to guide questions that identify programme adopters, implementers and sustainers, as well as the specific behaviours that each set of stakeholders needs to engage in to adopt, implement and sustain the Safety Check components (eg, ‘Who, specifically, in your health system would need to make the decision to implement this intervention with all guardians of adolescents presenting for well and/or sick visits at your site’). Participants will be paid $25 for participating in individual interviews.

We will recruit stakeholders using methods described in a similar MHRN study.42 To sample parents of youth, investigators at each site will identify random samples of 100 English-speaking parents or legal guardians of youth aged 12–24 who visited a primary paediatric care site within the previous 3 months from the electronic health records. Guardians will be sent an invitation letter with an opt-out card with postage. After 10 days, participants who have not returned the opt-out card will be called by phone, asked if they own a firearm (for sampling purposes) and invited to participate in our study. To sample providers, clinical leadership in paediatric primary care and behavioural health, leaders of quality improvement and system leaders, investigators at each site will identify the appropriate individuals to contact within their system, personally reach out to each of these individuals and invite them to participate via phone or email. We will work with clinical leadership in paediatric primary care to email invitations to providers inviting them to participate.

Interviews will be conducted by phone, digitally recorded with the participants’ permission, professionally transcribed and loaded into NVivo software for data management and analysis. Interviewers include doctoral-level researchers who have received extensive training and supervision in qualitative interviewing, and bachelor’s-level and master’s-level research staff trained and closely supervised by the doctoral-level members of the research team. Analysis will be guided by integrated theory, which incorporates inductive and deductive features.49 This approach uses an inductive process of iterative coding to identify recurrent themes, categories and relationships in qualitative data. A comprehensive coding scheme is then developed on the basis of this analysis and applied to the data in order to produce a fine-grained descriptive analysis. A priori codes informed by CFIR24 will also be applied (ie, deductive approach), such as coding for barriers and facilitators at the intervention, provider, and inner and outer setting levels. The research team will separately code a sample of the transcripts and compare their application of the coding scheme to assess the reliability and robustness of the coding scheme. Any disagreements in coding will be resolved through team discussion. We will also compute inter-rater agreement (ie, kappa), which provides a complementary approach to determining agreement between raters.46 We will ensure that reliability between raters is at least 0.80 or higher.

Implementation strategies

We will delineate implementation strategies based on existing theory, the scientific literature and the information gleaned from our stakeholder interviews. Consistent with the intervention mapping process, these implementation strategies will be translated into practical strategies using a theory-based causal model. We hypothesise that a model that accounts for individual behaviour and the environment would be most salient here, such as the theory of planned behaviour or social cognitive theory.50 51 Using whatever theory(s) best fit the identified determinants for the intervention, individual, inner and outer settings, we will then delineate practical strategies which will become the multilevel menu of implementation strategies. For example, if providers are unfamiliar with firearm safety counselling, training may be identified as a promising implementation strategy, whereas if providers are uncomfortable with implementing firearm safety counselling (ie, low self-efficacy), specific intervention to improve their self-efficacy is warranted. If parents report that the intervention would seem off-putting if not done in the context of other safety conversations, an approach that bundles firearm safety conversations with promotion of other safe practices (eg, use of bicycle helmets) may be appropriate.

Evaluation of feasibility and acceptability

We will evaluate the multilevel menu of implementation strategies by returning to the initial stakeholders who completed the needs assessment and asking them to complete a brief survey assessing feasibility and acceptability. These participants will be paid an additional $25 for completing this survey. We will also present our findings to leadership of each MHRN site and have them rate the feasibility and acceptability of the strategies. This will allow us to generate a list of the most feasible and acceptable implementation strategies within each level, which will then be tested in a larger effectiveness implementation trial.52

Discussion

Innovation

There are conceptual and methodological innovations in the proposed study, the former referring to the potential to directly impact youth with suicidal thoughts and behaviours. Specifically, this study seeks to understand how to implement a universal firearm safety intervention in primary care. Previous studies have used targeted intervention approaches.53 However, youth experiencing suicidal thoughts and behaviours often do not access services during times of heightened risk,54 suggesting a universal approach has the potential to reach more youth, and ultimately reduce suicide deaths. Addressing a highly prevalent social burden and understanding how health systems and their patients perceive a minimally intrusive yet common sense approach to improving firearm safety have the potential to improve patient quality of life while better tailoring limited healthcare resources. Methodological innovation refers to the impact of the proposed work on systematic and rigorous methods to develop implementation strategies. To date, few studies have used intervention mapping to develop a multilevel menu of implementation strategies.44 55 56 Further, this study will use the CFIR24 as part of this process to develop implementation strategies at the individual (eg, providers), inner setting (eg, paediatric practices), outer setting, and intervention characteristics levels. Evidence from the health services literature suggests that multilevel implementation strategies may be more effective than single-level implementation strategies.57–59

Limitations

Despite the strengths of the current study, several limitations should be noted. A primary limitation is that the study will be conducted in two health systems in the USA, and the extent to which results will generalise to other health systems is unknown. Moreover, both health systems are a part of the MHRN; health systems participating in the MHRN may have unique characteristics that may limit the generalisability of study findings to other healthcare systems (eg, an existing infrastructure to support partnerships with external researchers). Nonetheless, the diversity of the two systems, which are located in two distinct geographical and cultural settings, may mitigate threats to external validity. In addition, the Safety Check intervention was initially developed and tested as a broader safety initiative for parents of young children in which firearm storage was one of several safety targets. As such, the effectiveness of Safety Check as a stand-alone firearm safety intervention specifically for suicide prevention in paediatric primary care remains unknown. Additionally, the effectiveness of the intervention has been established based on parental self-report. It is possible that some parents may not be forthcoming when discussing matters related to firearm storage practices. Similarly, it is possible that providers and/or practice leaders may be reluctant to disclose information related to firearm safety given the sensitive nature of the topic. In an effort to mitigate these potential concerns, we will speak to both firearm-owning and non-owning stakeholders when possible to obtain a range of perspectives. We will also seek to understand providers’ concerns about parental reluctance to discuss firearm ownership and storage during qualitative interviews, as understanding these concerns will be important in the development of implementation strategies. However, this is not our primary focus; other ongoing work60 61 explores the perspectives of firearm owners in greater depth.

Impact

The work proposed has the potential to impact public health in two important ways. First, it will be a critical step in the research agenda of reducing death by suicide in children and adolescents by engendering a better understanding of how to implement an evidence-based firearms safety intervention, specifically components of Safety Check, in paediatric primary care. Second, it will advance the implementation science literature by providing a process, informed by the CFIR,24 for how to systematically develop implementation strategies in partnership with stakeholders across multiple levels of implementation (ie, providers, inner and outer contexts).

Ethics and dissemination

Study procedures have been approved by the University of Pennsylvania (Protocol number 824449). The IRBs of HFHS and BSW have ceded review to the University of Pennsylvania IRB. We began data collection for this project in August 2016. Results of aims 1 and 2 will be submitted for publication in peer-reviewed journals.

Acknowledgments

We are especially grateful for the support and cooperation the Mental Health Research Network has provided for this project, particularly Gregory Simon, MD, MPH, and the MHRN Suicide Prevention SIG. We would like to thank the following experts who provided their time and input on this project: Dr Collen Barry, Dr Shari Barkin, Dr Maria Fernandez, Dr Carol Runyan, Dr Garen Wintemute, Dr Marian Betz and Dr Megan Ranney. We are also grateful for the help provided by Danielle R Adams, BA; Kelly Zentgraf, BA; and Courtney Gregor, BA in assisting with this project.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
  46. 46.
  47. 47.
  48. 48.
  49. 49.
  50. 50.
  51. 51.
  52. 52.
  53. 53.
  54. 54.
  55. 55.
  56. 56.
  57. 57.
  58. 58.
  59. 59.
  60. 60.
  61. 61.
  62. 62.

Footnotes

  • Contributors RSB is the principal investigator for the study protocol. RSB generated the idea and designed the study, and approved all changes. CBW was the primary writer of the manuscript and is the project director for the study. CBW, SJH, SCM, BKA, JEZ, JAF, GKB, AL and RRB all made substantial contributions to study conception and design. All authors reviewed and provided feedback for this manuscript. The final version of this manuscript was vetted and approved by all authors.

  • Funding This project is supported by the following grants from NIMH: R21 MH109878-01 (RSB), F32 MH103955 (CBW) and U19 MH092201 (MHRN).

  • Competing interests None declared.

  • Patient consent Not applicable.

  • Ethics approval University of Pennsylvania IRB.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Correction notice This paper has been amended since it was published Online First. Owing to a scripting error, some of the publisher names in the references were replaced with 'BMJ Publishing Group'. This only affected the full text version, not the PDF. We have since corrected these errors and the correct publishers have been inserted into the references.