Introduction Oxygen is an essential medicine for children and adults. The current systems for its delivery can be expensive and unreliable in settings where oxygen is most needed. FREO2 Foundation Australia has developed an integrated oxygen system, driven by a mains-powered oxygen concentrator, with the ability to switch automatically between low-pressure oxygen storage device and cylinder oxygen in power interruptions. The aim of this study is to assess the clinical impact and cost-effectiveness of expanding this system to 20 community and district hospitals and level IV facilities in Western Uganda.
Methods and analysis This will be a phased implementation with preintervention and postintervention comparison of outcomes. Standardised baseline data collection and needs assessment will be conducted, followed by implementation of the FREO2 Oxygen System in combination with pulse oximetry in 1–2 facilities per month over a 16-month period, with a total 23-month data collection period. The primary outcome will be the proportion of hypoxaemic children receiving oxygen pre and post oxygen system. Secondary outcomes will assess clinical, economic and technical aspects. Pre and post oxygen system primary and secondary outcomes will be compared using regression models and standard tests of significance. Useability will be quantitatively and qualitatively evaluated in terms of acceptability, feasibility and appropriateness, using standardised implementation outcome measure tools.
Ethics and dissemination Ethics approval was obtained from Mbarara University of Science and Technology (MUREC 1/7) and the University of Melbourne (2021-14489-13654-2). Outcomes will be presented to the involved facilities, and to representatives of the Ministry of Health, Uganda. Broader dissemination will include publication in peer-reviewed journals and academic conference presentations.
Trial registration number ACTRN12621000241831.
- primary care
- public health
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.
Strengths and limitations of this study
We will evaluate the use of novel technology to overcome the oxygen access gap in resource constrained settings and add to the toolkit of available technology for affordable and sustainable oxygen access.
This expanded programme builds on previous implementation of the FREO2 system in Mbarara Regional Referral Hospital, Western Uganda, and will be managed by a multidisciplinary team of clinicians, engineers and health workers.
Implementation will be phased but not randomised. Outcomes are compared within and between facilities at different time points pre and post oxygen system. This allows assessment of the influence of confounders, including time.
The programme has a strong emphasis on strengthening the use of pulse oximetry, training and standardised clinical guidelines for oxygen therapy.
Pneumonia is the single largest infectious cause of death in children worldwide.1 Children who are poor, malnourished and living in remote areas are most at risk and the burden placed by pneumonia on families and health systems aggravates existing inequalities.2
Hypoxaemia—low oxygen levels—complicates respiratory and non-respiratory illness in newborns and children, and significantly increases the risk of a child dying.3 4 Pulse oximetry can non-invasively diagnose hypoxaemia, and has been shown to reduce mortality rates and improve measures of quality of care when implemented systematically.5 Oxygen systems—a suite of interventions aimed at improving the diagnosis and management of hypoxaemia—is a proven intervention shown to reduce pneumonia mortality by up to 35%–50%.6 7 Oxygen is included in WHO’s essential medicines list,8 and there is evidence that interventions aimed at detecting and treating hypoxaemia are economically competitive compared with other pneumonia interventions.9 10
However, the availability and use of oxygen and pulse oximetry continues to be limited globally. A survey of 231 health centres and hospitals in 12 African countries, found only 44% of facilities reporting uninterrupted oxygen access.11 In Nigeria, while 11/12 studied facilities had some access to oxygen, the majority of this was produced by faulty concentrators and below the recommended oxygen purity.12 In the same study, because of limitations in use of pulse oximetry, and substandard oxygen, 90% of children who had evidence of hypoxaemia did not receive appropriate oxygen therapy. Globally, there are insufficient detailed data on oxygen access and pulse oximetry to fully understand the breadth and depth of these problems.13
Oxygen concentrators, in appropriate settings, can improve the reliability, and reduce ongoing costs of oxygen when compared with cylinders.14 15 However, a systematic review of electricity supply in sub-Saharan facilities found that up to 72% of facilities do not have reliable access.16 Poor-quality grid electrical supply can damage concentrators and shorten their life span.17 More recent programmes have trialled solar-powered systems, demonstrating cost-effectiveness10 and mortality reductions in more rural and remote settings.18
As an additional tool to improve the applicability, cost and efficiency of concentrators, particularly in rural and isolated facilities, the FREO2 oxygen system (figure 1) combines a robust oxygen concentrator with a low-pressure oxygen storage (LPOS) device able to store 1400 L of oxygen.19 When the concentrator stops producing oxygen during a power cut the oxygen begins automatically flowing from the stored oxygen. Should the LPOS Store be emptied during a prolonged power cut, oxygen is automatically recruited from a high-pressure cylinder to continue supply. This control of oxygen source is achieved by a ‘Prioritizer device’: a pneumatic switch that can automatically switch between concentrator, LPOS and cylinder oxygen without additional intervention from health workers. A traffic light (Stack Lamp) display communicates the status of the system to nursing staff (green=concentrator oxygen, orange=LPOS oxygen, red=back up cylinder oxygen). The oxygen concentrator is connected to a PROTECT device, that conditions the mains power to meet the specific electrical requirements of the concentrator. This system has been recently field tested at the Mbarara Regional Referral Hospital in Uganda.20
The FREO2 oxygen system is designed to require a minimum of maintenance and no direct input from the health workers (other than controlling the flow rate of oxygen to individual patients).
The aim of this study is to expand and evaluate the FREO2 technology and sustainability model in 20 mid-level facilities in Western Uganda.
Methods and analysis
This protocol has been written in accordance with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) statement 2013.21
Health facilities will be selected based on a number of considerations: (1) oxygen availability in facilities can be improved; (2) facility oxygen needs are significant, and cannot be met sustainably and affordably with primary oxygen sources; (3) there is enthusiasm and supportive leadership within the facility for the programme; (4) geographical proximity to FREO2 Uganda base and (5) are representative of the type of facilities in Western Uganda (public, private not-for-profit and private for profit).
A facility-selection questionnaire will be sent out by email to 60 facilities, within 90 min driving distance from the FREO2 office (online supplemental appendix 1). Facility administrators are asked to provide information on case load, infrastructure, human resources and willingness to participate. Eligible facilities are visited, and a baseline assessment (online supplemental appendix 2), using a standardised tool is completed. The assessment collects more detailed information on admissions numbers, pneumonia burden, pre-existing oxygen supplies, access to pulse oximetry, oxygen costs, staffing and biomedical support. Selection and recruitment of facilities is unblinded and non-randomised.
Inclusion criteria and enrolment
All neonatal and paediatric (<12 years) admissions to selected health facilities will be included and screened with pulse oximetry. Information on oxygen therapy is collected for admitted children on oxygen. Hypoxaemia, and need for oxygen, is defined as oxygen saturation by pulse oximetry (SpO2) <90%, based on WHO clinical guidelines.22 Oxygen administration will follow local guidelines, based on WHO recommendations. We will not exclude children on the basis of age or diagnosis. We will however note when a child presents with a condition that causes non-oxygen responsive hypoxaemia (eg, cyanotic congenital heart disease).
The level of intervention is at a health facility level and not at an individual patient level, and all individual patient data are deidentified. Consent will be sought from the health facility administrator/director to eventually augment or replace the existing oxygen supplies with the FREO2 system. Plain language statements will be made available to all staff and patients using the system.
Phase 1: improved detection of hypoxaemia; use of pre-existing oxygen supplies
Figure 2 summarises the three project phases. Following baseline assessment, staff will receive refresher training in the diagnosis of hypoxaemia (±provision of pulse oximeters). Prior knowledge and training will be assessed, including a brief pretraining quiz with clinical questions on pulse oximetry and oxygen therapy based on WHO guidelines.23 Clinical data collection will commence following this training. A standardised admission form (online supplemental appendix 3) is completed by the admitting officer for all admissions (whether or not they require oxygen), with emphasis on documenting whether a child receives oxygen and why, and the presence of any oxygen and/or power interruptions. Collecting data on all admissions, rather than only for children receiving oxygen, will provide a denominator for calculating hypoxaemia prevalence (overall and disease specific) that can be used by facilities to estimate oxygen requirements moving forward. This phase will occur over the first 3 months for each enrolled facility, with allowance for an additional month for the first enrolled facility to allow learning and adjustment of the data collection tools.
Phase 2: FREO2 oxygen system and oxygen therapy training
The FREO2 oxygen system will then be installed in each facility. Timing will be staggered to accommodate resource constraints, and to allow for lessons to be learnt (figure 3), with roll-out in 1–2 facilities per month. The project team will combine installation with training in equipment use, refresher of pulse oximetry and oxygen therapy training, and training in data collection.
Equipment installation will be supported by study technicians working alongside health facility staff. The FREO2 oxygen system will be located away from the patient beds, with low pressure oxygen tubing piped to the bed-side of each patient. Flow is split, with individual patient flow metres at the bed-side, such that one FREO2 system can supply up to four children simultaneously. The number of systems required by facilities is determined by the case-load, and projected number of hypoxaemic admissions. Based on admission numbers of the level IV facilities in Uganda, and a hypoxaemic prevalence of 10% of all admissions, we expect that one system per facility will be sufficient.
Clinical data will continue to be collected for all admissions, using the standardised admission form. In addition, a previously described data acquisition system19 20 will be deployed at each health facility to enable remote monitoring of oxygen flow rate and purity, pressure within the LPOS and the backup oxygen cylinder, and temperature and humidity. Data will be uploaded to a remote server to assess system performance and facilitate preventative maintenance.
Phase 3: impact evaluation
Post oxygen system data will be collected for 3 months, in the same way as for the preintervention period, and will begin 2 weeks following equipment installation to account for a ‘wash-out’ period. The postintervention period for the last enrolled facility is expected to complete in November 2022 (figure 3).
In addition, usability assessments using the described standardised tools (online supplemental appendix 4), and semistructured interviews will be conducted in focused group interview format.24 Postintervention data collection will be accompanied by refresher training in oxygen therapy.
Data collection and management
Clinical data will be prospectively collected for each facility using the standardised patient admission form for the duration of the study. The form will be filled-in by attending clinicians on the day of admission. On discharge, study personnel will use routine medical records to complete a discharge section, which details discharge diagnosis, duration of oxygen therapy and frequency of pulse oximetry measurements.
Clinical data will be extracted from medical records, deidentified and entered and managed using Research Electronic Data Capture (REDCap) hosted at the University of Melbourne.25 26 Data are double entered and screened for data entry errors monthly by the study coordinator. Discrepancies are first investigated by referring to the paper form, and if required, by retrieving the child’s medical record. Deidentified paper forms (admission forms) will be stored in a central research facility in Uganda.
On completion the study, finalised, deidentified data will be available from the corresponding author (RS), on reasonable request.
There is evidence from large implementation trials for reductions in childhood mortality with implementation of pulse oximetry, and improved oxygen systems. This study does not aim to duplicate these, but rather test whether the FREO2 oxygen system can improve getting oxygen to children who need it. To test this hypothesis, the primary outcome will be the proportion of hypoxaemic children receiving oxygen pre and post oxygen system. Hypoxaemia is defined as SpO2 <90% either on admission or during hospital stay.
Secondary clinical outcomes will be compared pre and post oxygen system:
Overall, pneumonia and neonatal (age <28 days) mortality pre and post FREO2 oxygen system.
Duration of oxygen therapy per patient pre and post FREO2 oxygen system.
Length of stay pre and post FREO2 oxygen system.
Estimated amount of oxygen used per patient pre and post FREO2 oxygen system.
Technical and systems outcomes
Pre-FREO2 oxygen system:
Number and duration of power and/or oxygen outages or interruptions, and reasons.
Estimated oxygen use and amount of cylinders used.
Oxygen purity produced by concentrators.
Capacity for replenishment, maintenance and repair of existing oxygen supplies.
Post-FREO2 oxygen system:
Number and nature of failure events that could compromise oxygen access to a hypoxaemic child.
Frequency, extent and duration of power outages/overvoltage.
Amount of oxygen delivered from LPOS device.
Equipment malfunctioning, maintenance and repair.
Amount of oxygen use and estimated amount of cylinder oxygen use.
Delivered oxygen purity.
All costing data for each given facility will be logged to project-specific forms by the person making the expenditure at the time the expense is incurred and recorded. The project will aim to collate initial outlay, running costs, and incidental costs. The cost to avert one hypoxaemic child not receiving oxygen because of unavailability will be calculated by dividing the total cost of the system by the additional number of hypoxaemic children accessing oxygen.
Cost of oxygen per litre and per patient pre and post oxygen system.
Cost of oxygen per litre over time.
Standardised implementation outcome measure tools will be used: the acceptability of intervention measure, intervention appropriateness measure and the feasibility of intervention measure in the postintervention phase (online supplemental appendix 4).27
In addition, semistructured interviews will be conducted with health workers and health administrators in the post implementation period. Health worker interviews will capture user attitudes towards the intervention and the implementation model, including the training modules.
Although the study design is non-randomised, sample size and power calculations were based on methods for stepped wedge cluster randomised trials, using the Stata17 program ‘stepped wedge’ to calculate power based on our anticipated timeline.28 29 We assumed baseline oxygen deliver to at least 50% of hypoxaemic children and an improvement in this proportion to at least 80% post introduction of the FREO2 system. We conservatively assumed a baseline hypoxaemia prevalence of 10% in all paediatric and neonatal admissions, based on a previous systematic review and a prospective study from Nigeria.3 30 Recruitment of 4 hypoxaemic admissions per facility per month (or 40 total neonatal and paediatric admissions per month) would be able to detect a 30% improvement in oxygen access with a p value 0.01 and power 0.9. Preliminary facility data shows that these admissions numbers should be achievable.
We will use mixed-effects regression for primary and secondary analyses of effect of the oxygen system enabling comparison between facilities preintervention and postintervention and across time periods. We will analyse individual patient data, with fixed effects for time and intervention and random effects for facility and facility time interaction. Intervention effects will be expressed as an odds ratio with 95% confidence intervals. For the primary outcome, this analysis will aim to detect whether there has been a change in the proportion of hypoxaemic children receiving oxygen pre and post oxygen system. Similarly, we will analyse the impact on overall, pneumonia and neonatal mortality as secondary outcomes. For other economic and technical outcomes, pooled data from all facilities preintervention and postintervention will be compared using standard tests of significance.
Implementation will be led by an oxygen team, consisting of a paediatric nurse, biomedical engineer, doctor and programme manager. Training is coordinated by clinicians with the Babies and Mother Alive programme of the Brick by Brick Uganda group. Funding is provided to each facility to support clinical staff in assisting with data collection and management.
The study covers a period of 23 months. Data collection will end 3 months after implementation of the Oxygen System in the final facility (projected November 2022; figure 3).
Ethics and dissemination
Ethics approval was obtained from Mbarara University of Science and Technology (MUREC 1/7) and the University of Melbourne (2021-14489-13654-2).
Results will be shared with participating health facilities in the form of reports and presentations. Facility representatives will be involved in the publication of manuscripts. Outcomes will be presented to the involved facilities, and to representatives of the Ministry of Health. We will also aim for broader dissemination, including publication in peer-reviewed journals and academic conference presentations.
Patient and public involvement
Patients and the public were not involved in the study design. The Ministry of Health and facility leadership are involved in site selection. Regular informal contact between the study team and involved facilities (clinical and technician staff) will allow adaptation of training and implementation to meet specific needs.
There is a risk that the FREO2 oxygen system may displace existing oxygen systems (cylinders or concentrators) and deskill facility staff in routine upkeep and maintenance of these systems. To mitigate this, this project will prioritise facilities with poor baseline oxygen supplies, where the intervention is not detracting from already functioning oxygen systems. Pulse oximeters provided in the course of the programme will be the property of health facilities and available to them beyond the programme duration. The FREO2 system will be supported for an additional 12 months after project completion, while facilities (or the Ministry of Health) choose to either enter into an agreement with FREO2 Uganda to provide ongoing maintenance, training and support for a fee or transition to a different system.
The clinical data collected as part of this project represent information that is expected to be recorded in a thorough routine clinical assessment (eg, vital signs such as heart rate), and is therefore unlikely to represent additional workload on staff. On discharge, study personnel will extract relevant clinical data by chart review with no direct interaction with patients. Data collection forms will be deidentified when data are extracted, and all analysis and publication will use the data in deidentified form.
To study the risk of technology failure on oxygen availability, the FREO2 oxygen system has been trialled in Mbarara Regional Referral Hospital.20 It has proven safe and reliable. To add further layers of safety, embedded within the system is a back-up oxygen cylinder, and an automatic mechanism to shift between oxygen supplies.
Patient consent for publication
BS and DP are grateful for the in-kind support of Sensirion AG (Laubisruetistrasse 50, 8712 Staefa ZH, Switzerland) and Würth Australia.
HG and BS are joint senior authors.
HG and BS contributed equally.
Contributors SB, RS, BS and HG contributed to the conception and design of the evaluation. BS, DP, GM, SB and RR contributed to the funding application. SB, JM, DP, GM, RS, EN, DM and MS contributed to data acquisition. RS and BS wrote the initial draft of the manuscript. SB and RS contributed equally and share first authorship. All authors read, revised and approved the final manuscript.
Funding This work is supported by Grand Challenges Canada Transition to Scale programme, grant number TTS-2008-35961.
Competing interests BS, RR, DP are directors of FREO2 Foundation Australia.
Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.