Article Text

Original research
Assessment of core teaching competency of health professional educators in Ethiopia: an institution-based cross-sectional study
  1. Daniel Dejene1,2,
  2. Jelle Stekelenburg3,4,
  3. Marco Versluis5,
  4. Firew Ayalew6,
  5. Yohannes Molla6
  1. 1Department of Health Sciences, Groningen University Medical Center, Groningen, The Netherlands
  2. 2Health Workforce Improvement Program, Jhpiego-Ethiopia, Addis Ababa, Ethiopia
  3. 3Department of Obstetrics and Gynaecology, Medisch Centrum Leeuwarden, Leeuwarden, The Netherlands
  4. 4Department of Health Sciences, Global Health, Universitair Medisch Centrum Groningen, Groningen, The Netherlands
  5. 5Department of Health Sciences, Groningen University, Groningen, The Netherlands
  6. 6Health workforce improvment program, Jhpiego, Addis Ababa, Ethiopia
  1. Correspondence to Dr Daniel Dejene; d.j.birhanu{at}umcg.nl

Abstract

Objectives Understanding the competency of educators is key to informing faculty development, recruitment and performance monitoring. This study aimed to assess the core teaching competency of nursing, midwifery and biomedical educators, and associated factors in Ethiopia.

Design An institution-based cross-sectional study was conducted in January 2020 using structured tools adapted from the WHO’s nurse and midwifery educator competency frameworks.

Setting Two health science colleges and nine student practice sites in Ethiopia.

Participants All classroom instructors and clinical preceptors of nursing, midwifery and biomedical technician training programmes, and all the graduating class students.

Measures Overall teaching competency scores, teaching domain competency scores, competency gaps and performance gaps of educators were outcome measures. Past training on teaching skills courses, teaching experiences and sociodemographic characteristics of educators are associated factors.

Results Most educators were not trained in teaching methods (82%). The teaching competency scores of classroom instructors and clinical preceptors were 61.1% and 52.5%, respectively. Competency gaps were found in using active learning methods, performance assessment, feedback and digital learning. Professional background of classroom instructors had a significant and strong association with their competency score (p=0.004; V=0.507). Age and teaching experience of clinical preceptors had significant associations with their competency score (p=0.023 and p=0.007, respectively) and had strong associations (V=0.280 and 0.323, respectively). Sex of students and their perceptions of how well the educators give education resources had a significant and strong association (p<0.001; V=0.429).

Conclusions Nursing, midwifery and biomedical educators lacked the competency to undertake important teaching roles, which could contribute to the low quality of education. More attention should be given to strengthening faculty development.

  • Medical education & training
  • Human resource management
  • International health services

Data availability statement

Data are available upon reasonable request.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

STRENGTHS AND LIMITATIONS OF THIS STUDY

  • The use of validated nurse and midwifery educators’ competency frameworks improved the quality of data in this study.

  • We considered multiple data sources from classroom instructors, clinical preceptors and students to strengthen the study findings.

  • Although self-assessment is not the best method to determine competency, we used it to obtain reliable and efficient findings for informing professional development and regulation of educators.

  • Since there was no nurse and midwifery graduating class during the study period, health extension workers-students who were taught by the same educators were included.

  • Though we did not take representative samples to draw generalisable findings, we applied a feasible methodology to broaden knowledge in the health professional education field.

Introduction

A stronger health workforce is a vital determinant for improving population health outcomes. The world is currently facing health workforce shortages as the result of challenges in health professional education among others.1 2 Globally, 18 million more health professionals are needed by 2030, mainly in developing countries, to achieve universal health coverage (UHC)1; and 9 million more nurses and midwives are required to reach sustainable development goal (SDG) 3 on health.1 Biomedical engineering professionals are required to a great extent to optimise the development and use of medical equipment.2 3 Substantial health workforce investments are, therefore, required to achieve UHC and SDG health targets.

Ethiopia has suffered from a critical shortage of competent nurses, midwives and biomedical technicians.4 The 2018 national health workforce density was a total of 10 doctors, nurses and midwives per 10 000 populations, which was far below the WHO’s threshold of 45 for achieving the UHC.5 Few biomedical engineering professionals were available in 2017 (0.002 per 10 000 populations).6 The shortage of health professionals affected the access to quality healthcare and contributed to undesirable health outcomes.5

To address the shortages, the WHO recommended countries rapidly scale up and transform health professional education.7 Hence, Ethiopia expanded preservice education (PSE) leading to the burgeoning of the graduation capacity.8 9 In addition to the 46 universities, Ethiopia opened 23 public regional colleges, 45 private institutions and 4 biomedical training institutions using technical–vocational education and training (TVET) system, which enabled the country to produce the majority of nurses, midwives and biomedical technicians. As a result, Ethiopia was able to address the sharp rise in human resources for health needs that occurred as a result of the primary healthcare expansion in the last two to three decades.10

However, education quality received less attention. Scaling up of the education has further deteriorated quality since there were no congruent commitment and resources to support the expansion. In reality, the massive expansion in the face of the shortages of faculty exacerbated Ethiopia’s quality concerns.9 11 The country needs a lot of work to ensure that graduates are competent.12–14 Qualified educators who mastered teaching competencies for effective facilitation of classroom sessions and student clinical practice, developing learning materials, assessing student learning and providing support to students are critical.15–18 Effective educators should have adequate professional, communication, leadership and research skills.7 15 16 In addition, large student size, epidemiological transition, advancing medical knowledge and technology have required educators to improve their teaching.19 However, the teaching competency among health professional educators in Ethiopia is not well studied. Understanding the competency of educators guides faculty development and other quality enhancement interventions. Such evidence expands the global knowledge and informs health professional education practices in other countries having similar challenges. This study aimed to assess core teaching competency and associated factors of nursing, midwifery and biomedical educators in Ethiopia.

Methods

Study design and participants

We conducted an institution-based quantitative cross-sectional study in January 2020 to serve as a baseline survey for the faculty development project (FDP). Our study questions focused on core teaching competency levels and gaps among the educators, and the associated factors. The FDP aimed to improve the teaching and learning process of vocational nursing and midwifery programmes at Nekemte Health Science College (NHSC), and the biomedical training programme at Addis Ababa Tegebareid Polytechnic College (AATPTC). NHSC, located in western Ethiopia of Nekemte city, was providing vocational nursing, midwifery, health extension and other midlevel health professional training. AATPTC, found in Addis Ababa city administration, was providing vocational biomedical technician training and others. The colleges worked with 14 student practice sites. Based on convenience, we selected five hospitals, two health centres and two biomedical equipment workshops. The biomedical equipment workshops were workplaces for biomedical technicians and engineers where varieties of medical equipment were stored, tested, calibrated and maintained. There were a total of 154 educators for the nursing, midwifery and biomedical technician programmes and 125 graduating class students. Of the educators, there were 57 classroom instructors and 97 clinical preceptors. We used a census sampling technique to include all classroom instructors, clinical preceptors and graduating students. Classroom instructors were teaching staff hired by and work in the colleges to teach and support students. Health workers hired by health facilities or medical equipment workshops to provide patient care or medical equipment services were regarded as clinical preceptors. We decided to include graduating class students as they had adequate exposure and experience enough to make valid judgements on the performance of the educators. We obtained lists of the classroom instructors, clinical preceptors and graduating students from the deans’ and registrars’ offices. The educators and students who were present at work during the data collection period, willing and able to participate in the study were included as study participants. To evaluate the effectiveness of the FDP, an end-line assessment was planned to be conducted at the end of the project using the same methods and data collection tools.

Data collection

We adapted the WHO midwifery and nurse educator competency frameworks to develop three structured data collection tools.16 17 Since we were interested in assessing teaching competencies only, but not the profession-specific competencies, we used the same data collection tools across the three academic programmes. The first tool (with 63 variables) was a self-administered questionnaire aimed at exploring the perceptions of classroom instructors on their capabilities to implement specific teaching tasks related to six competency domains, namely: facilitating theoretical learning using engaging methods in classrooms; supporting student clinical practice through applying effective practical training methods; using student assessment methods; developing teaching and learning materials; providing guidance, counselling and gender-related support to students; and providing education management and leadership functions. The second tool (with 45 variables) was a self-administered questionnaire for assessing the perceptions of clinical preceptors on four competency domains. The three competency domains of clinical teaching, student assessment and student support are similar to those of the classroom instructors. The fourth domain is about the ability of clinical preceptors to apply infection prevention and patient safety principles and protocols during patient care. The third tool (with 49 variables) was also a self-administered questionnaire for graduating class students aiming to obtain information on the current teaching performances of their educators. All three tools had variables about the background characteristics of the study participants. In collaboration with five national health professional education experts, we validated and piloted the tools at two health training institutions.

To assure data quality, we selected seven data collectors who had an education level of master’s degree and relevant experiences. We trained the data collectors for 2 days on data collection procedures, the contents of the tools, the REDCap application and ethics. The data collectors orientated and supported study participants to fill out the questionnaires correctly. The responding educators rated their perceptions of competencies for each teaching task on a 5-point Likert scale, where ‘1’ meant not capable and ‘5’ meant proficient. The graduating students rated the performance of the educators on a 5-point Likert scale, where ‘1’ meant no educator applies the skill consistently and ‘5’ meant that all instructors apply the skill consistently. The data collectors were closely supported by three supervisors. Errors and omissions found during data collection were corrected timely. The data collection period was from 14 January to 22 January 2020.

Data management and analysis

Electronic data were collected using the REDCap application that was used for checking completeness, consistency of responses and cleaning data. We then exported the data to SPSS V.25. We conducted data analysis by computing proportions, means, SDs and other descriptive statistics. Aggregate scores were calculated as necessary. To assess the competency scores, average composite scores were calculated using weighted averages for each competency domain. Total composite scores were similarly calculated to determine overall competency scores. To calculate the proportions of educators with skills gaps, we combined the responses of all educators who rated themselves as not capable, novice and advanced beginners, and considered them incompetent. Similarly, we considered responses from all students who rated most, and all of their educators apply the teaching skills as well performing while calculating the proportion of performing educators. Pearson’s Χ2 test with p values was computed to assess the significance of associations among the variables. Cramer’s V coefficients (V) were calculated to assess the strength of associations. We considered the values of V less than 0.100, in the range of 0.100–0.250, and greater than 0.250 weak, medium and strong associations, respectively.20 As per the policy of the Ministry of Education (MOE) of Ethiopia, any level IV TVET educator needs to have university education with a minimum of a bachelor’s degree.19 The MOE also set a 60% passing mark to allow educators to graduate with a bachelor’s degree.21 Hence, we adopted the MOE 60% competency score as a cut-off point in our study to classify the educators as ‘competent’ or ‘not competent’.21 22

Patient and public involvement

No patients or members of the public were involved in the research design, analysis and dissemination of the findings. Deans and educators of the health colleges, and experts from the Ministry of Health, the Regional Health Bureau, professional associations and implementing partners were involved in the interpretation and utilisation of the findings.

Results

Background characteristics of study participants

A total of 147 educators and 112 students participated in the study with response rates of 95% and 90%, respectively. The mean age of the educators was 32 years with a range of 19–54 years. More than half of the educators were below 30 years of age (54%). Nearly half of them were female (48%) and had less than 5 years of teaching experience (45%). The mean period of the educators’ work experience was 7 years. The majority of them were not trained in teaching skills courses in the last 2 years (82%; table 1).

Table 1

Background characteristics of educators in Ethiopia, January 2020 (N=147)

The graduating students were mostly health extension workers by department (70%), in the age group of 20–22 years (64%) and female by sex (80%; online supplemental material 1).

Teaching competency score of the educators

The overall average composite competency scores of classroom instructors and clinical preceptors were 61.1% and 52.5%, respectively. The classroom instructors had less than 60.0% scores in two competency domains, namely: developing and using education materials (55.4%) and providing management and leadership functions (58.4%). However, clinical preceptors scored less than 60.0% in all four competency domains (tables 2 and 3).

Table 2

Mean teaching competency scores of classroom instructors in Ethiopia, January 2020 (N=51)

Table 3

Mean teaching competency scores of clinical preceptors in Ethiopia, January 2020 (N=96)

Teaching competency gaps of the educators

More than two-thirds of classroom instructors perceived that they had gaps in developing and using student performance assessments: portfolios, log books, objective structured clinical/practical examinations (OSCEs/OSPEs) and digital learning solutions. More than three-quarters of clinical preceptors perceived that they had gaps in developing and using student performance assessments, active learning methods (case study, role-play, discussion and group assignment) and providing constructive feedback (table 4).

Table 4

Top competency gaps of classroom instructors on the left and clinical preceptors on the right, Ethiopia, January 2020

Factors associated with the competency score of educators

The professional background of classroom instructors had a significant and strong association with their competency scores (p=0.004; V=0.507). The age of clinical preceptors had a significant and strong association with their competency scores (p=0.023; V=0.280). The teaching experience of clinical preceptors had also a significant and strong association with their competency scores (p=0.007; V=0.323). In addition, the sex of the clinical preceptors had a significant and medium strength association with their competency scores (p=0.019; V=0.240) (table 5).

Table 5

Factors associated with competency scores of classroom instructors (above) and clinical preceptors (below) in Ethiopia, January 2020

Students’ perception of the application of teaching skills by their educators

Significant proportions of graduating students perceived that most of their educators did not consistently use digital learning solutions (81%), create a conducive learning environment (50%), provide counselling and psychosocial support (50%), use a variety of student assessment methods (49%) and apply active learning methods (43%) (online supplemental material 2).

Factors associated with students’ perceptions of the application of teaching skills by educators

The sex of students had a significant and strong association with their perceptions of how well the educators provide appropriate education materials (p<0.001; V=0.429). In addition, the sex of students had a significant and medium strength association with their perception of how well their educators respect them as adult learners (p=0.031; V=0.204), orientate them (p=0.022; V=0.217) and ensure a conducive learning environment (p=0.035; V=0.199) (online supplemental material 3).

Discussion

In almost every country in the world, there are health workforce shortages, skill mix imbalances and uneven geographical distributions, leaving millions without access to healthcare.1 2 7 A need to scale up PSE has intensified to train more health professionals and transform training quality.7 Being 1 of the 57 countries with severe health workforce crisis,7 Ethiopia scaled up health professional education. However, it was challenged to uphold the PSE quality.9–12 Other low/middle-income countries (LMICs) faced similar challenges due to a shortage of qualified educators and other factors while addressing the workforce challenges.13 23–25

In this study, we found out that the educators felt competent in essential teaching tasks, but not in all relevant ones. We identified competency gaps among the educators in using active learning methods, performance assessments, digital learning solutions, gender-responsive pedagogy and performance-based feedback. The findings were not surprising as health profession education in Ethiopia was not well developed as a career. The educators lacked formal teachers’ education opportunities.19 22 Health professionals were recruited for the complex tasks without demanding skills and experiences in teaching.26 27 Faculty recruitment focused mainly on the academic achievements of new graduates. Similar faculty recruitment and development challenges were reported in many LMICs.23–25 28 On the contrary, educators in a developed country are required to have teaching qualifications and experiences before deployments.29–32 One contributing factor to the suboptimal teaching competency was the limited faculty development opportunities in Ethiopia.27 Meanwhile, faculty development on a wide range of educational activities is recommended to educators.33–35 The rapid PSE scale-up in the country exacerbated the shortage of qualified educators.9–12 Many educators were less than 30 years of age and had less than 5 years of work experience, which could limit their use of practice-based improvement opportunities. A WHO report corresponded with our findings that only 6.6% of educators in LMICs were adequately prepared and had sufficient teaching qualifications.17 From an optimistic point of view, one could argue that the educators were doing good, given they had no formal education, inadequate faculty development opportunities and limited experiences. Although we used distinct data collection tools for the classroom instructors and clinical preceptors, it is good to note that the competency scores of the clinical preceptors were lower. This might be due to the differences in their training, duties and work arrangement. Clinical preceptors were hired by the practice sites mainly to provide services with no explicit preceptorship roles. This meant that it is difficult to realise Ethiopia’s TVET education strategy.26 Reports also claimed that TVET trainers in Ethiopia lacked teaching skills.19 21

The significant difference between male and female students’ perceptions of the performances of educators on key tasks could be due to the low gender skills among the educators. The gender audit that was conducted in Ethiopia’s higher education showed comparable findings.36 Competency-based education programmes need to use non-traditional teaching and assessment techniques. Case study, role-play, group assignment and discussion are proven active learning methods for teaching critical thinking, problem-solving, communication, teamwork and collaboration skills,37 38 However, the educators had skills gaps in using them. The educators had limited ability to use OSCE/OSPE, log book, portfolio, 360-degree evaluation and global rating. Hence, assessing and teaching clinical skills, practical procedures, patient management, communication skills and professional behaviours of the students might be difficult.39 40 It is known that feedback is the vital cog in the wheel of competency-based education.41 However, the educators lacked the skills to provide quality feedback. The educators had learning technology skills gaps that might diminish the power of digital learning for transforming PSE in Ethiopia.42 43

It is known that self-assessments are not the best method of competency assessment. However, we mainly used self-reports of educators on their competencies in our study to generate reliable and efficient evidence needed for the professional development and regulation of educators. To improve the quality of self-assessment data, the views of students were considered. We also trained data collectors on data collection tools and processes. We did not take representative samples from all colleges. Therefore, the study findings are not generalisable. Given the similar contexts of the health training colleges in Ethiopia and other sub-Saharan African countries, it is clear that other colleges and researchers can learn from these pieces of work.

To ensure the availability of competent educators, the colleges are advised to revisit faculty recruitment, development and retention policies. Teaching experiences and skills of educators should be considered as faculty recruitment criteria. Faculty development programmes on active learning methods, performance assessments, digital learning, feedback and gender-responsive pedagogy should be designed. Strengthening education development units in the colleges can catalyse faculty development programmes. In addition, academic programmes in health profession education should be expanded. More studies are required to understand the causes and effects of low teaching competency among educators.

Conclusions

Classroom instructors and clinical preceptors had suboptimal teaching competency. Skills gaps were reported in using active learning methods, performance assessments, feedback, digital learning and gender among the significant proportions of educators. Many educators were young and had limited experience and training in teaching. Faculty development opportunities are critical. More studies on the causes and effects of low teaching competency are needed.

Data availability statement

Data are available upon reasonable request.

Ethics statements

Patient consent for publication

Ethics approval

We obtained ethical clearance from Johns Hopkins Bloomberg School of Public Health Institutional Review Board with IRB number 16606. The Oromia Regional Health Bureau and the training institutions approved the protocol and provided support letters to conduct the study. The study team met with deans, department heads and facility managers of the target institutions to explain the purpose of the study and data collection processes. Data collectors obtained oral informed consent from each study participant. Data on study participants’ names and other personal identifiers were not collected. We also placed the datasets in a secure place for keeping participants’ information confidential.

Acknowledgments

The authors would like to acknowledge Dr Tegbar Yigzaw and Dr Damtew W/Mariam for supporting the design and planning of the study. In addition, Mr Alemseged Woretaw, Ms Mintwab Gelagay and Mr Demeru Yeshitla contributed to the data collection and write-up of the study.

References

Supplementary materials

Footnotes

  • Contributors DD was the first author who contributed to the study concept and design, statistical analysis, result interpretation, and drafting, development and revision of the manuscript. DD was responsible for the overall content as the guarantor who has accepted full responsibility for the work and/or the conduct of the study, had access to the data, and controlled the decision to publish. The coauthors, JS and MV contributed to the statistical analysis, result interpretations, and drafting and revision of the manuscript. FA and YM, who are the coauthors, contributed to the study design, result interpretation and manuscript revision. All authors read and approved the final version of the manuscript.

  • Funding Jhpiego-Ethiopia under the Faculty Development Project with the donation from the GIZ (with award number of 90086390: GIZ) provided the financial resource for the study.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.