Article Text

Protocol
Instruments for measuring nursing research competence: a protocol for a scoping review
  1. Qirong Chen1,
  2. Chongmei Huang1,
  3. Aimee R Castro2,
  4. Siyuan Tang1
  1. 1Xiangya School of Nursing, Central South University, Changsha, Hunan, China
  2. 2Ingram School of Nursing, McGill University, Montreal, Québec, Canada
  1. Correspondence to Professor Siyuan Tang; tsycongcong{at}126.com; Dr Chongmei Huang; 15874162760{at}163.com

Abstract

Introduction Nursing research competence of nursing personnel has received much attention in recent years, as nursing has developed as both an independent academic discipline and an evidence-based practiing profession. Instruments for appraising nursing research competence are important, as they can be used to assess nursing research competence of the target population, showing changes of this variable over time and measuring the effectiveness of interventions for improving nursing research competence. There is a need to map the current state of the science of the instruments for nursing research competence, and to identify well validated and reliable instruments. This paper describes a protocol for a scoping review to identify, evaluate, compare and summarise the instruments designed to measure nursing research competence.

Methods and analysis The scoping review will be conducted following Arksey and O’Malley’s methodological framework and Levac et al’s additional recommendations for applying this framework. The scoping review will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews checklist. The protocol is registered through the Open Science Framework (https://osf.io/ksh43/). Eight English databases and two Chinese databases will be searched between 1 December 2020 and 31 December 2020 to retrieve manuscripts which include instrument(s) of nursing research competence. The literature screening and data extraction will be conducted by two researchers, independently. A third researcher will be involved when consensus is needed. The COnsensus-based Standards for the selection of health Measurement INstruments methodology will be used to evaluate the methodological quality of the included studies on measurement properties of the instruments, as well as the quality of all the instruments identified.

Ethics and dissemination Ethical approval is not needed. We will disseminate the findings through a conference focusing on nursing research competence and publication of the results in a peer-reviewed journal.

  • protocols & guidelines
  • health services administration & management
  • medical education & training
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Strengths and limitations of this study

  • The scoping review proposed in this protocol will achieve a high level of rigour, as it will adhere to Arksey and O’Malley’s methodological framework, Levac et al’s recommendations and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews checklist.

  • The scoping review will include different English and Chinese databases.

  • The COnsensus-based Standards for the selection of health Measurement INstruments methodology will be used to simultaneously evaluate the methodological quality of studies on measurement properties of the instruments and the quality of all instruments identified.

  • This scoping review may fail to include relevant literature, which has been published outside of the searched databases.

  • This scoping review is limited to include studies published in English or Chinese.

Introduction

Nursing research is important for the development of nursing as both an independent scientific discipline and an evidence-based practice profession.1 Nursing research competence (NRC), which refers to individual ability to conduct nursing research activities,2 is crucial for generating the high-quality nursing research required for the development of the nursing discipline/profession.3 NRC is a particularly necessary competency for nursing researchers and academics to have, as they are most responsible for developing high-quality nursing research. However, clinical nurses are also increasingly expected to be equipped with NRC, so that they can contribute to the ongoing development of evidence-based nursing practice, as well as to bring that evidence into practice to help reduce the known gaps between nursing research and practice.4 Furthermore, strengthening NRC among student nurses is important because they will work as future clinical nurses and nursing academics.5 For all of these reasons, NRC, which is vital for the development of the nursing discipline and evidence-based nursing practice, has been getting increased attention within many areas of nursing.

The measurement of NRC is important for research, education and management related to NRC. In research, NRC instruments are required to assess the state of NRC for a given individual nurse or for a nursing organisation; and to explore factors which influence NRC.6 7 In education, NRC instruments can be used to evaluate courses or training programmes for nursing research.5 The evaluation of NRC of clinical nurses using validated instruments can also provide nurse managers with evidence for nursing management related to nursing research, such as for determining which nurses within the organisation are most capable of assisting with the organisation’s research projects.6 Therefore, instruments for measuring NRC are important for related research, education and management.

Some related instruments have emerged during the past decade, based on varying definitions of NRC and diverse contexts for the instruments’ uses.3 5 6 Corchön defined NRC as nursing ‘research skills and knowledge, interest and attitudes’, and they developed corresponding instruments measuring NRC.3 Some definitions of NRC and corresponding instruments focus more on research knowledge and skills. For example, Pan et al developed an instrument measuring ‘Research Competence for Clinical Nurses’ based on the definition of NRC (ie, the ability to identify problems and formulate research questions, search and critically review literature, design and implement research, analysis data, and write research reports).8 Qiu et al defined NRC as the ‘ability (1) to systematically summarise clinical experiences as well as literature, in order to find researchable problems and formulate innovative research questions of relevance to nursing, (2) to collect, analyse and explain data related to those questions and (3) to apply knowledge accumulated in this way to solve problems innovatively’; they developed an instrument of Research Competency for Nursing Students.5 Some researchers simply define NRC as evidence-based practice competence; the corresponding instruments developed by these researchers tend to focus on domains relevant to evidence-based practice.9 These different definitions indicate that there is still no consistent definition of and instrument for measuring NRC.

In this study, we will define NRC as ‘individual ability to conduct nursing research activities’.2 Since a systematic review has already been conducted on instruments measuring knowledge, skills and attitudes for evidence-based practice among nurses,10 the literature on instruments designed solely for measuring evidence-based practice competence will be excluded in this study; however, literature on instruments measuring evidence-based practice and research competence will still be included. There has been also a systematic review of instruments measuring nurses’ attitudes towards research utilisation.11 However, to our knowledge, no comprehensive knowledge synthesis for instruments of NRC has ever been conducted.

In order to assess NRC in specific contexts, the selection of an appropriate, well-validated and reliable instrument is vital for the credible assessment of NRC in that context.12 Although an increasing number of instruments of NRC have emerged, an overview of all available NRC instruments; as well as an evaluation of these various instruments for guiding instrument selection and further instrument development; is still lacking. Therefore, the purpose of this protocol is to design a comprehensive and rigorous scoping review of the instruments for measuring NRC. The scoping review will offer implications for researchers on the NRC instrument development and improvement and/or provide guidance for nurse educators, managers and researchers on the selection of the appropriate NRC instrument to measure NRC in a specific context.

This scoping review will be able to answer the following questions: (1) What instruments for measuring NRC have been developed and how were they used in related studies? (2) Are there any well-validated and reliable instruments for measuring NRC? (3) If there is more than one well-validated and reliable instrument for measuring NRC, are there circumstances under which certain instruments are more appropriate for measuring NRC than the other instruments? (4) What are the differences between NRC instruments designed for different groups (eg, clinical nurses, nursing students)? and (5) What are potential directions for the future development and improvement of NRC instruments?

Methods

Objectives

The two objectives of the proposed scoping review are:

  1. To identify, evaluate, compare and summarise the instruments developed to measure NRC.

  2. To provide an overview of the use of all the instruments that have been developed for measuring NRC.

Study design

Considering that the aim of the proposed research is to provide an overview of the evidence; and to identify and analyse the knowledge gaps within the topic of NRC instruments; a scoping review methodology is appropriate for this aim.13 Therefore, the study design will be a scoping review following: (1) Arksey and O’Malley’s methodological framework,14 (2) Levac et al’s recommendations for using this framework15 and (3) the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews checklist.16

Search strategy

A systematic search will be performed between 1 December 2020 and 31 December 2020, in eight English databases (ie, Cochrane library, CINAHL, EMBASE, PubMed, PsycINFO, Scopus, ERIC, ProQuest Dissertations & Theses Global) and two Chinese databases (ie, CNKI and WANFANG DATA). The inclusion of these databases will help ensure the conduction of a comprehensive search which will include as much relevant literature as possible. The inclusion of Chinese databases is also an effort for a more comprehensive literature search, given that the research team includes four researchers whose first language is Chinese. A string of keyword search terms relating to ‘nursing’, ‘research’, ‘competence’ and ‘instrument’ will be used to identify relevant literature. An example of the search strategy in PubMed is shown in online supplemental table S1. The search strategy for Chinese databases is shown in online supplemental table S2.

Inclusion criteria

Papers will be included if they: (1) were published during 1999–2020 (We limit the time frame to 1999–2020 is because the most related studies in this area were published after 1999 and we will conduct the literature search between 1 December and 31 December 2020) ; (2) are either dissertations or original research studies published in peer-reviewed journals; (3) include at least one instrument for measuring NRC (ie, literature describing the development of an NRC instrument; literature describing the psychometric testing of an NRC instrument; and/or literature in which an instrument was used to measure the NRC) and (4) have full-text availability.

Study screening

References identified by the search strategy will be copied into EndNote. Duplicates will be detected and removed, first using EndNote’s deduplicating capabilities, followed by manual screening.17 Study screening will be conducted by two reviewers independently, using Covidence software. Reviewers will first use the titles and abstracts to screen studies. After the title and abstract screening, the full texts will be checked against the inclusion criteria by two reviewers, independently. In case of disagreements between two reviewers, a third reviewer will make the decision regarding the inclusion of the article. Reference lists of included papers will be checked to identify potentially relevant articles. Those added articles will be screened by using the screening process described above.

Data extraction

Two reviewers will independently conduct the data extraction, using predesigned data extraction tables (online supplemental tables S3–S6). For different studies, different information will be extracted (see figure 1). A detailed description of all included instruments will be extracted and shown in online supplemental table S3, including: name of the instrument, developer (ie, author(s), year developed), construct(s), country of development (language), targeted population, mode of administration, (sub)scale(s)/content(s) (number of items), response options and range of scores/scoring. Psychometric properties of the included instrument will be extracted and presented in online supplemental table S4 (Result columns).18 Characteristics of the included studies using the instrument of NRC will be extracted in online supplemental table S6, including: author, year, location, study aim, design/intervention, participants, sample size, the instrument of NRC and results related to NRC.

Figure 1

The process of data extraction and synthesis. The included literature will be categorized into two types: a‘Literature for instrument development’ refers to the articles focusing on the development and psychometric properties testing of the NRC instrument; b‘Literature using the instrument’ refers to the articles using the NRC instrument to measure NRC as a study variable. cThe data related to measurement properties of the included instrument results will be shown in online supplemental table S4 (Result columns). dEvaluation results of methodological quality of instrument development and psychometric testing studies will be shown in online supplemental table S4 (Methodological quality columns). NRC, nursing research competence.

Quality appraisal

Considering the aims of this scoping review, the evaluation of the instruments is more important than the quality appraisal of the included studies. Therefore, COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) methodology will be used to evaluate the methodological quality of the included studies on measurement properties of the instruments, as well as on the quality of all the instruments identified.12 The COSMIN methodology is primarily designed for improving the instrument selection of patient-reported outcomes measures, but it can also be adopted and used on other types of outcome measurement instruments.19 While using the COSMIN guidelines in our scoping review, some adaptions will be made based on the detailed descriptions of COSMIN guidelines and the characteristics of the construct of interest, that is, NRC.12 For example, the ‘patients’ will be replaced with ‘nursing students or nurses’ in the COSMIN risk of bias checklist. All adaptions will be discussed in our research group and reviewed by two professors experienced in nursing research.

As the methodological quality of studies on the measurement properties of an instrument is important for the quality of the instrument, COSMIN standards20 21 will be used to evaluate studies on the methodological quality of an instrument’s development and studies of psychometric testing included in this scoping review. The corresponding evaluation results will be shown in online supplemental table S4 (Methodological quality columns). The COSMIN criteria18 will be used to evaluate the results of the psychometric properties (Results columns in online supplemental table S4), in order to show the quality of the instruments identified (Rating columns in online supplemental table S4). The synthesised evidence on the quality of each instrument will be graded by using the modified Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach in the COSMIN manual and displayed in online supplemental table S5.12

Included studies which only use an instrument to measure NRC (as a study variable), but which do not include contents of instrument development and/or measurement properties testing, will not be appraised. However, these studies will still be included and analysed in online supplemental table S6, in order to construct an overview of the usage of all NRC instruments (figure 1).

Data synthesis

The number of the instruments identified and the numbers of the studies using each specific NRC instrument will be calculated; this analysis will provide an overview of the various NRC instruments. The data extracted for the description and evaluation of all instruments will be reported in data extraction tables (online supplemental tables S3 and S4) to facilitate the synthesis of the evidence, and to provide a visual comparison of all identified NRC instruments. The evidence will be summarised based on the contents of online supplemental table S4. The quality of evidence will be graded by using the modified GRADE approach12; these results will be shown in online supplemental table S5, which will indicate the evaluation results of each measurement property of every instrument.

Patient and public involvement

No patient or public involvement.

Ethics and dissemination

Ethical approval is not required for this protocol, nor for the scoping review. The scoping review will provide valuable information on the measurement of NRC which is important for research, education and management related to NRC. We will share the findings of this scoping review at a national or international conference and in a peer-reviewed journal article.

Discussion

To our knowledge, this will be the first scoping review of instruments measuring NRC, as well as the first scoping review to report the characteristics and psychometric qualities of these instruments. Our scoping review will identify, describe, evaluate and compare all instruments for measuring NRC. The findings based on the COSMIN methodology will be used to determine if there is (are) a well-validated and reliable instrument(s) for measuring NRC of a targeted population. This scoping review will also provide recommendations for the selection of the most appropriate instrument (given specific research circumstances), and it will discuss implications for future studies on the development and improvement of instruments for measuring NRC.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

Footnotes

  • Twitter @AimeeRCastro

  • Contributors Author contributions Study design: QC and ST. Study supervision: ST and CH. Manuscript writing: QC, ARC and CH. Critical revisions for important intellectual content: ST, CH and ARC.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Patient consent for publication Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.