Author/year | Hawker et al appraisal low/medium/high | Implementation outcome(s) | Implementation outcome achieved +*/-†/0‡ | Result of implementation and relation to the living lab approach |
Li,65 2019 | High | Acceptability | + | The intervention was highly acceptable by the participants based on the high overall attendance and satisfaction for the content and mean agreement. Acceptability was enhanced by the patient participatory approach for optimising the intervention content. |
Feasibility | + | Pilot data showed feasibility with regard to content, length of the programme and programme objectives. | ||
Morgan,57 2019 | High | Acceptability | – | Higher acceptability due to inclusion of the first link coordinator in the clinic assessment. |
Sustainability | – | Participants stated continuing the connection with the research team, involvement and informing all managers, having consistent leaders to ensure ongoing support, and increasing the community awareness of the service as contributing to sustainability of the intervention. | ||
Timmerman,48 2016 | High | Adoption | – | For future adoption and implementation willingness in using a telehealthcare system and using a single platform that integrates all functionalities is important. Healthcare professionals (HCPs) reported usability issues. Involvement of end-users is reported to be essential to contribute to adoption, compliance and implementation. |
Bolton,50 2016 | High | Acceptability | + | Intervention was acceptable to implement. Participants were able to make changes to the plan to suit their needs. Result of the Social Support Programme Acceptability Rating Scale were between the categories 2=quite a lot and 3=a great deal. Community engagement enhanced acceptability to the participants. |
Feasibility | + | It was feasible to devise and implement a community-led, community-level intervention providing social support to new mothers. | ||
Tsianakas,67 2015 | High | Acceptability | + | Intervention was acceptable to both carers and HCPs, they reported the intervention was educative and increased confidence. |
Feasibility | + | The recruitment rate of ten carers per month and low attrition proved feasible in the study setting. | ||
Gould,63 2019 | High | Acceptability | + | Evidence showed that the content education and training was acceptable to a wide range of the staff. 55% of women accepted (Nicotine replacement therapy). Taking into account cultural and other context aspects, and specific needs of the community contributed to the acceptability. |
Feasibility | + | Feasibility was shown by moderate to high retention (77% and 40%) and recruitment rates (47% and 54%). | ||
Engelen,62 2019 | High | Acceptability | + | Participants (94% of respondents) found the intervention informative and useful in conveying Move More Sit Less messages in an easily accessible format. The codesign assured culturally acceptable components and higher acceptability. |
Tatla,53 2017 | High | Acceptability | – | There were no significant changes in service delivery pre- and post-intervention (p<0.05). |
Feasibility | + | The programme was feasible to deliver and for the measurement of outcomes (processes of care and coaching skills or interprofessional learning outcomes). | ||
Bonner,66 2019 | High | Acceptability | + | Overall acceptability was rated 8.4/10. 88% intended to use the website over the next month suggesting acceptability. The user codesign of the intervention also made the intervention acceptable to the end-users (GPs). |
Feasibility | + | At the 1-month follow-up most GPs (73%) reported using the website. | ||
Williams,47 2016 | High | Fidelity | + | Environmental health practitioners delivered the risk audit as prescribed and it was easy to use. |
Adoption | + | The coproduction of the intervention proved important in facilitating adoption. | ||
Acceptability | + | The coproduction approach produced an acceptable intervention. | ||
Zamir,52 2018 | High | Acceptability | +/- | Sites where the intervention was accepted, embodied an activity led environment and staff were accustomed to dedicating their time to engage in activities. |
Feasibility | 0 | Feasibility is yet to be determined by making observations and evaluating outcomes. | ||
Magge,68 2019 | Medium | Acceptability | + | Acceptability was shown by the willingness of the federal ministry of health to dedicate employees full time to the initiative. |
Adoption | + | 35 quality improvement teams have been actively engaged with 83 change ideas demonstrating high levels of adoption. Aligning the collaborative design with the district-wide system was seen as instrumental for the integration into existing administrative structures. | ||
Fidelity | + | The collaboratives were completed and implemented as designed with few adaptations. | ||
Cameron,64 2019 | Medium | Acceptability | + | Acceptability increased by tailoring the tools and recourses to specific needs of the site. |
Sustainability | + | Sustainability increased by tailoring the tools and recourses to specific needs of the site. Sustainability was ensured by broadening the intervention and incorporating it into existing processes. | ||
Shah,58 2019 | Medium | Acceptability | + | It was stated that the intervention was well accepted by the patients. The codesign approach enabled clinical staff to have input into the content, the implementation and the resource material used. Involving different cultures, and the translation made the research culturally appropriate and likely increased participation. |
Feasibility | + | Responses to the feasibility of the intervention were mainly positive. GPs reported that it enabled patients to think about issues before their consultations. | ||
Easton,51 2019 | Medium | Acceptability | + | Results showed it was acceptable to receive support for self-management and acute exacerbations from an AI-based virtual agent. Codesigning the content and application of the virtual agent made the system acceptable to the target population. |
Grenha Teixeira,60 2019 | Medium | Adoption | + | User adoption numbers showed the intervention was well received by professionals, with more than 1.8 million citizens and 650 institutions that were registered in the Portuguese HER and an average of 100 000 healthcare practitioners daily accesses and 12 000 citizens accesses to the healthcare information. The participatory approach was used to address user adoption challenges. |
Kipping,56 2019 | Medium | Fidelity | + | Fidelity checks showed that units were converging to an average of 78%. Results suggest that the cocreation process is an effective implementation strategy for model fidelity. Staff and patient involvement in the design and creation of new practices within their local environment led to greater adherence to fidelity. |
Implementation cost | + | The implementation cost was US$80 974.14. | ||
Whitehouse,55 2013 | Medium | Acceptability | + | 100% of the professionals stated that the platform had an acceptable format and the use was easy. Youth acceptance of using the tool in the study was exceptional, demonstrating the importance of being responsive to user suggestions from inception. |
Feasibility | + | The professionals found the tool useful and it met their needs, uptake was 99%. | ||
Tolma,45 2019 | Medium | Feasibility | + | All of the eligible research participants met with the medical provider and 80% participated in the discussion groups. Using multiple level intervention targets at clinic and community settings through community-based participatory research (CBPR) are feasible. |
Fidelity | + | Most of the activities, including doctor-patient guided communication, breast cancer brochure, bulletin board poster and mammogram screening flowchart of the clinic-based component took place as planned except the physician’s recommendation letter. Most of the community components, the intergenerational group discussion and bracelets as a reward for getting a mammogram, took place as planned. | ||
McConnell,59 2018 | Medium | Acceptability | 0 | No results |
Feasibility | – | Participants reported that it may not be feasible to take on the living lab approach when they also have to be responsible for resourcing and capacity building for achieving long-term goals. | ||
Crosby,42 2017 | Medium | Acceptability | + | The iManage app prototype was rated as easy to use, beneficial for tracking sickle cell disease and participants liked that the app was tailored to their needs. |
Feasibility | + | The participants accessed the internet through devices and reported seeking information about their condition online (71%), which provides initial support for the feasibility of mobile health intervention. | ||
Voyer,54 2014 | Medium | Acceptability | + | Results suggest that the programme is acceptable to healthcare staff because of the internal support, effective clinician leadership, taking into account the internal culture and policies, fostering a sense of ownership and providing practical training in addition to the theory. |
Feasibility | + | Results suggest that the programme is feasible because of the internal support, the effective clinician leadership, taking into account the facility’s own internal culture and policies, fostering a sense of ownership among the users and providing practical training in addition to the theory. | ||
Berge,41 2016 | Medium | Feasibility | + | Over half of the families in the intervention group attended 75% of the events and 33% attended all events. Using local parks and elementary schools was highly feasible, also using social media to advertise the intervention was highly feasible. |
Sustainability | 0 | Not evaluated in results | ||
Dugan,40 2016 | Medium | Adoption | + | For the Kaizen Event Team interventions one was successful in terms of adoption two were unsuccessful and one is in progress For the Design Team interventions one was successful in terms of adoption, 1 did not occur and one is in progress |
Fidelity | + | For the Kaizen Event Team interventions one was successful in terms of fidelity, 1 was unsuccessful, 1 was not available and one is in progress. For the Design Team interventions one was successful in terms of fidelity, 2 are in progress and one did not occur. | ||
Implementation cost | + | For the Kaizen Event Team interventions one was successful in terms of cost effectiveness, 1 was unsuccessful, 1 is not available and one is in progress. For the Design Team interventions one was not available, 1 needs to be determined, 1 is in progress and one did not occur in terms of cost effectiveness | ||
Penetration | + | For the Kaizen Event Team interventions one was successful in terms of penetration, 1 was unsuccessful, 1 was not available and one is in progress and needs to be determined. For the Design Team interventions one was not available, 2 are in progress and need to be determined and one was successful in terms of penetration | ||
Sustainability | + | For the Kaizen Event Team interventions one was successful in terms of sustainability, 1 was unsuccessful, 1 was not available and one is in progress and needs to be determined. For the Design Team interventions one was not available, 2 are in progress and need to be determined and one was successful. | ||
Black,46 2018 | Medium | Acceptability | + | Staff reported the video’s and online programme were helpful and easy to administer. |
Feasibility | + | Youth were able to complete the seven chapters rooted in (American Indian and Alaska Native) beliefs of the intervention with little assistance and the online format provided flexibility that accommodated inconsistent attendance. Contributions of two community partners groups in the implementation ensured that the intervention was compatible and feasible. | ||
Chávez,69 2019 | Low | Fidelity | + | A high fidelity prototype was developed. |
Prochaska,44 2011 | Low | Acceptability | + | Participants responded positive to the acceptability measures and strong use of computers made the computer-delivered intervention an acceptable way to implement the programme. Collaborative involvement of key stakeholders can enable the continued development of an acceptable and feasible programme, enabling thereby the programme of research to be translated to practice. |
Feasibility | + | Ease and speed of the recruitment with exceeding the goal of 50 women to 87 in 3 weeks, the ability of participants to complete the programme within 20–30 min and high participation rate (all women agreed to participate) showed the feasibility of incorporating the programme at health centres. | ||
Horne,49 2016 | Low | Acceptability | 0 | Results of evaluation of acceptability not shown. |
Feasibility | 0 | Results not shown. | ||
Sustainability | + | Sustainability was ensured by secured future funding, contracting, a protocol to update the website content, and clinical facilitation of the forum and the messaging system. The website was tailored and developed by a multidisciplinary team and sustainable. |
*+ means that the implementation outcome was successful.
†- means that the implementation outcome was not successful.
‡0 means that the implementation outcome was not reported or evaluated.