Article Text
PDF
Abstract
Objectives Chronic kidney disease (CKD) is common; therefore, coordination of care between primary care and nephrology is important. Ontario Renal Network’s KidneyWise toolkit was developed to provide guidance on the detection and management of people with CKD in primary care (www.kidneywise.ca). The aim of this study was to evaluate the impact of the April 2015 KidneyWise toolkit release on the characteristics of primary care referrals to nephrology.
Design and setting The study was a prospective pre-post design conducted at two nephrology sites (community site: Trillium Health Partners in Mississauga, Ontario, Canada, and academic site: St Joseph’s Healthcare in Hamilton, Ontario, Canada). Referrals were compared during the 3-month time period immediately prior to, and during a 3-month period 1 year after, the toolkit release.
Primary and secondary outcome measures The primary outcome was the change in proportion of referrals for CKD that met the KidneyWise criteria. Additional secondary referral and quality of care outcomes were also evaluated. Multivariable logistic regression was used to evaluate preselected variables for their independent association with referrals that met the KidneyWise criteria.
Results The proportion of referrals for CKD among people who met the KidneyWise referral criteria did not significantly change from pre-KidneyWise to post-KidneyWise implementation (44.7% vs 45.8%, respectively, adjusted OR 1.16, 95% CI 0.85 to 1.59, p=0.36). The proportion of referrals for CKD that provided a urine albumin-creatinine ratio significantly increased post-KidneyWise (25.8% vs 43.8%, adjusted OR 1.45, 95% CI 1.06 to 1.97, p=0.02). The significant independent predictors of meeting the KidneyWise referral criteria were academic site, increased age and use of the KidneyWise referral form.
Conclusions We did not observe any change in the proportion of appropriate referrals for CKD at two large nephrology centres 1 year after implementation of the KidneyWise toolkit.
- chronic kidney disease
- knowledge translation
- proteinuria
- primary care
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Strengths and limitations of this study
A prospective study conducted in two large nephrology centres.
Prespecified primary and secondary objectives using multiple imputation to account for incomplete data.
Relatively short time period (1 year) in which to observe changes in referral characteristics.
No information available on patients who were not referred.
Background
Chronic kidney disease (CKD), defined by the persistence of an estimated glomerular filtration rate (eGFR) of less than 60 mL/min/1.73 m2 and/or albuminuria (urine albumin-creatinine ratio (ACR) greater than 3.0 mg/mmol), affects 10%–12% of adults in Canada.1 A number of guidelines make recommendations on the timing of referral of persons with CKD from primary care to nephrology, although it is unclear how familiar primary care providers are with these.2–6 Late referral may lead to unplanned initiation of renal replacement therapy and other adverse outcomes.7 8 Conversely, early referral may not be feasible when considering the availability of nephrology services and, furthermore, may be unnecessary and/or may not improve outcomes.9–12 Regardless of the timing of referrals, enhanced CKD care and improved coordination between primary care and nephrology are important for people with CKD.
The Ontario Renal Network’s (ORN) KidneyWise (www.kidneywise.ca; online supplementary appendix)2 13 toolkit was developed in 2015 in an effort to provide succinct guidance for the detection and management of CKD in the primary care setting, incorporating recommendations from a number of relevant guideline documents.3 14 15 We implemented knowledge translation strategies to coincide with the release of the toolkit to promote uptake, including development of a web-based platform and mobile application, presentations at accredited local, provincial and national primary care medical conferences, as well as dissemination from regional nephrology primary care programme to referring primary care providers. Embedded within the toolkit is a standardised referral form which mirrors the nephrology referral criteria outlined in the toolkit.
Supplemental material
The objective of this study was to evaluate the impact of the KidneyWise toolkit release on referral characteristics and quality of care at two sites in Ontario, Canada. We hypothesised that dissemination of the toolkit would lead to (1) an increased proportion of referrals which met KidneyWise referral criteria for CKD (low eGFR or proteinuria); and (2) improvement in the quality of CKD-relevant care in people with CKD who had been referred.
Methods
KidneyWise toolkit
The ORN, a provincial agency, oversees and funds kidney care services in Ontario. There are 27 regional programmes that provide general nephrology, multidisciplinary kidney care clinics and dialysis services to those in need in their respective regions. One of its priorities is to improve quality and coordination of CKD care in primary care which, through the efforts of a small working group of nephrologists and primary care providers, led to the development of the KidneyWise toolkit.2 13 Embedded within the KidneyWise toolkit are recommended criteria for referral to nephrology, adapted from several existing guidelines, with an emphasis on the Canadian Society of Nephrology (CSN) recommendation.3 5 6 As a result, an eGFR less than 30 mL/min/1.73 m2 or urine ACR greater than 60 mg/mmol were two key referral criteria that were common to KidneyWise and the CSN recommendations. Concerns were raised by the working group that some patients may be at higher risk of progression but who would not meet either criteria. Therefore, KidneyWise also recommended referral for those with an eGFR of 30–44 mL/min/1.73m2 and urine ACR of 30–59 mg/mmol. Finally, with respect to evidence of rapid progression, we noted substantial variation in the guidelines, ranging from a 53 to a 15 mL/min/1.73 m2 decline over 1 year.6 Balancing out the need for more timely referral for those with evidence of rapid progression, while avoiding an excessive volume of referrals, we recommended referral for those with an eGFR less than 60 mL/min.173m2 and a decline of at least 5 mL/min/1.73 m2 over 6 months.
Study design and population
The study was a prospective pre-post design. Nephrology referrals received at two sites (Trillium Health Partners (THP) in Mississauga, Ontario, Canada, and St Joseph’s Healthcare Hamilton (SJHH) in Hamilton, Ontario, Canada) were evaluated during two 3-month time periods. The first time period occurred from January to March 2015, immediately prior to the toolkit release. The second period occurred 1 year after the toolkit release (April–June 2016). THP is a community-based centre and is the sole nephrology provider in Mississauga, a city with a population of 713 000. SJHH, an academic centre affiliated with McMaster University, is similarly the sole provider for a city with a population of about 537 000. Both centres have an estimated referral base of about 1 million people. At SJHH, all referrals are triaged centrally at a single location; therefore, all referrals were captured during the conduct of the study. Conversely, at THP, referrals could either go to a central location at the hospital or directly to private nephrologist offices. In this study, only the central location referrals at THP were captured.
Toolkit dissemination
Dissemination of the toolkit incorporated a number of passive and active strategies to promote uptake. At a provincial and national level, one of the authors (AKG) presented KidneyWise at a number of accredited primary care medical conferences; additionally, a paper version of the toolkit was handed out to conference attendees. Physician leaders from each of the regional nephrology programmes in the province were informed in person of the contents of KidneyWise and were encouraged to promote its dissemination in their local regions. A web-based platform and mobile application were also developed and their use encouraged at the same conferences. At both sites, a copy of the toolkit was sent to referring physicians encouraging use of the KidneyWise referral form with future requests. Many of the nephrologists at the two sites also embedded statements within their consultation letters that encouraged use of the KidneyWise toolkit. Finally, KidneyWise was frequently promoted by two authors (KSB and AKG) on Twitter.
Outcomes
Relevant data were extracted from referrals onto paper case report forms. The primary outcome was the change in the proportion of referrals for CKD (low eGFR and/or proteinuria) meeting the KidneyWise criteria before and after the toolkit introduction. Although the KidneyWise toolkit recommends two eGFR and ACR values at least 3 months apart to confirm chronicity, the primary outcome for the purposes of this study was based on a single value. The rationale for this was the observed high background referral rate providing only a single eGFR and/or proteinuria measure. A sensitivity analysis was also performed for the primary outcome using the stricter requirement for two qualifying values.
Prespecified secondary referral outcomes include (1) change in the proportion of appropriate referrals for low eGFR (<30 mL/min/1.73 m2); (2) change in the proportion of appropriate referrals for proteinuria (urinary ACR>60 mg/mmol); (3) change in the proportion of appropriate referrals for low eGFR or proteinuria which provided at least one urine ACR value (actual, not estimated); (4) change in the proportion of appropriate referrals for low eGFR or proteinuria which provided at least one urinalysis; and (5) change in the proportion of late referrals (defined here as eGFR<15 mL/min/1.73 m2 and/or a 2-year kidney failure risk14 (KFRE2)>10%).
Secondary prespecified quality of care outcomes which aligned with the recommendations in the toolkit were as follows: (1) change in the proportion of persons referred who were on an ACE inhibitor or angiotensin receptor blocker (all referrals and those with an indication (eg, ACR > 3 mg/mmol with diabetes mellitus, ACR > 30 mg/mmol without DM)); and (2) change in the proportion of persons referred who were on a statin (all referrals and those with a primary prevention indication (eg, CKD with DM, CKD without DM and ≥50 years of age)).
Statistical analysis
Assuming that the baseline proportion of referrals that met the KidneyWise criteria was 50% (based on a previous audit conducted at the SJHH site) and that the toolkit would lead to a relative 20% increase in this proportion (ie, to an absolute value of 60%), 519 referrals would be required during each time period to detect a significant difference (alpha 0.05) with 90% power. Assuming that more than 2000 referrals are received at the two sites over a 1-year period (the SJHH site received ~2000 referrals the previous year), a 3-month collection period before and after toolkit introduction was considered sufficient to achieve the required sample size.
Continuous variables were described as means and SD or medians and IQRs and categorical variables expressed as proportions. Where required, urine protein based on dipstick or 24-hour urine protein was converted to approximate urine ACR as previously described.16 17 Data were assumed to be missing at random for logistic regression analyses; multiple imputation was performed (set of 15) using Markov chain Monte Carlo procedures assuming a multivariate normal distribution. A two-sided p value<0.05 was regarded as significant without adjustment for multiple comparisons. For the primary and secondary outcomes, the pre-post difference in proportion of categorical variables was assessed by calculating the OR and its associated 95% CI using logistic regression, adjusted for referral site. An additional analysis conducted for the primary outcome using mixed effects logistic regression (site as a random intercept) did not materially change the original estimates and are therefore not reported here. The differences between normally and non-normally distributed continuous variables were assessed using the Student’s t-test and Wilcoxin rank-sum test, respectively.
Multivariable analysis of predictors of a referral meeting the KidneyWise criteria were carried out using the following preselected variables based on clinical plausibility: age, sex, presence of DM, referral site, time period (pre vs post) and use of the KidneyWise referral form (the latter during the second time period only). All statistical analyses were performed using Stata V.15.1.
Patient and public involvement
Patients were not directly involved in this study.
Results
There were 1043 referrals combined over the two time periods; 69.2% were at the academic site (SJHH) and 40.2% during the first time period (table 1). The mean age of persons referred was 63 years and was significantly higher at the academic site compared with the community site (64±18.2 vs 60±20.2; p=0.001). The proportion with DM was similar at the two sites (43.0% overall) with greater ethnic diversity at the community site. Overall, the severity of CKD in people referred was higher at the academic site with a lower eGFR (low eGFR referrals: median 33.1 vs 40.4 mL/min/1.73 m2, p<0.001), higher ACR (proteinuria referrals: 59.0 vs 31.7 mg/mmol, p=0.044) and higher KFRE5 (low eGFR referrals: 5.0% vs 1.8%; p<0.001). The differences noted between the two time periods in the demographics of people referred, as well as the referral indication, were driven by the substantial increase in referrals from the community site during the post-KidneyWise time period (see online supplementary table S1). Sixty-three of 624 referrals (10.1%) used the KidneyWise referral form post-KidneyWise, all at the academic site.
Baseline characteristics of the patients referred
Primary outcome
The proportion of referrals for CKD that met the KidneyWise referral criteria between the two time periods did not significantly change from pre-KidneyWise to post-KidneyWise implementation (44.7% vs 45.8%, respectively, adjusted OR 1.16, 95% CI 0.85 to 1.59, p=0.358; table 2). Using the stricter requirement for two eGFR and/or ACR values meeting the referral criteria did not alter the conclusions, although the proportion meeting the criteria was substantially lower during both time periods (21.4% vs 24.5%, respectively, adjusted OR 1.26, 95% CI 0.87 to 1.82, p=0.237).
Primary and secondary referral outcomes of patients referred
Secondary outcomes
The proportion of referrals for proteinuria with a urine ACR>60 mg/mmol significantly increased post-KidneyWise implementation (32.6% vs 45.7%, adjusted OR 2.04, 95% CI 1.06 to 4.01, p=0.032, table 2). The proportion of referrals for CKD that provided a urine ACR also significantly increased post-KidneyWise (25.8% vs 43.8%, adjusted OR 1.45, 95% CI 1.06 to 1.97, p=0.0179). An exploratory analysis conducted by forcing use of the KidneyWise referral form into the model suggested that this effect was largely explained by the latter (post-KidneyWise time period: adjusted OR 1.20, 95% CI 0.88 to 1.63, p=0.255; KidneyWise referral form: adjusted OR 4.24, 95% CI 2.13 to 8.44, p<0.001). There were no significant differences in any of the other referral outcomes between the two time periods (table 2).
The proportion of people referred who were on an ACE inhibitor or angiotensin receptor blocker and had an indication was 75.3% overall (table 3) and was not significantly different before and after KidneyWise implementation (76.4% vs 74.8%, adjusted OR 0.96, 95% CI 0.52 to 1.73, p=1.000). Similarly, the proportion of those on a statin with an indication did not significantly change from preimplementation to postimplementation (71.0% vs 65.8%, respectively, adjusted OR 0.77, 95% CI 0.54 to 1.10, p=0.158).
Quality of care outcomes at the time of referral
The significant independent predictors of received referrals meeting the KidneyWise criteria were academic site, increased age and use of the KidneyWise referral form (table 4). Referrals that used the KidneyWise referral form had a lower eGFR, higher ACR and higher kidney failure risk compared with those that did not use the form (table 5).
Multivariable predictors of a referral meeting the KidneyWise referral criteria.
Referral form characteristics and use of ORN referral form
Discussion
Implementation of the KidneyWise toolkit was not associated with an increased proportion of referrals that met the KidneyWise referral criteria or improvement in quality of CKD care delivered in primary care. Utilisation of the KidneyWise referral form, a surrogate measure of KidneyWise awareness, appeared to be restricted to the academic site’s catchment area.
It is uncertain which criteria, if any, primary care providers considered when determining whether a patient required referral prior to KidneyWise implementation. In the Canadian context, the Canadian Society of Nephrology (CSN) published a commentary on the Kidney Disease International Guideline Organisation (KDIGO) which included referral recommendations.5 These recommendations were similar to KidneyWise: eGFR less than 30 mL/min/1.73 m2 or urine ACR greater than 60 mg/mmol, but differed with respect to decline in kidney function (abrupt 20% drop vs 5 mL/min/1.73 m2 decline over 6 months). While the similarities between the two referral guidelines might suggest that dissemination of KidneyWise would have a limited effect on referral patterns, it should be noted that the proportion of referrals for low eGFR or proteinuria that met these common referral recommendations was low. Furthermore, the authors are unaware of prior local efforts to promote the CSN referral criteria which had been published in a nephrology rather than primary care journal.
A number of studies have examined the characteristics of primary care referrals to nephrology, including the appropriateness of referrals.18–22 In many of these studies, the introduction of automated eGFR has led to an increased volume of referrals, many deemed perhaps unnecessary. Similar to the present findings, Akbari and colleagues found that at an academic centre in Ottawa, Ontario, only 55% of referrals were considered necessary using similar criteria to those used in KidneyWise (eGFR<30 mL/min/1.73 m2, ACR>60 mg/mmol, or 20% decline in eGFR over 1 year).18 Another study found that despite the implementation of an educational intervention prior to eGFR reporting, referral volume increased.19 Conversely, a targeted educational intervention in nine primary care and five nephrology practices demonstrated an increase in the proportion of patients with an eGFR<,30 mL/min/1.73 m2 who were referred to nephrology.23
Interventions in primary care to influence physician behaviour have had mixed results. A previous systematic review found that the use of structured referral forms and the involvement of consultants in educational activities, both techniques employed here, improved referral appropriateness.24 More recent trials have found that the use of performance feedback methods, including peer comparison with active choice framing and audit and feedback reporting, as well as accountable justification, increased appropriate prescribing behaviour in primary care.25–27 The knowledge translation strategies employed here were primarily passive and may have been less effective than more active strategies.28 29 It should be noted that CKD severity was higher at the academic site and, similarly, utilisation of the KidneyWise referral form was only observed at the academic site. There may be local differences in referral patterns of primary care providers and/or the earnestness and methods with which nephrologists encouraged appropriate referral at the two sites.
We observed that the proportion of referrals for proteinuria meeting the KidneyWise criteria increased postimplementation, as did the proportion of CKD referrals that provided an ACR. The effect size was large and the time interval between the two time periods was relatively short, suggesting that this observation is likely due to dissemination of KidneyWise rather than other secular phenomena. The finding that use of the KidneyWise referral form was a strong predictor of CKD referrals including an ACR supports this hypothesis.
Feedback from referring primary care providers at a number of KidneyWise presentations indicated that incorporation of KidneyWise into their office-based electronic medical record (EMR) systems to facilitate appropriate and timely referrals would be vital to changing their behaviour and improving workflow. To that end, work has been completed to facilitate KidneyWise incorporation into one of the major EMR systems in Canada.30
Appropriate utilisation of ACE inhibitors or angiotensin receptor blockers in patients referred to nephrology was already quite high at baseline, similar to what has been previously described in a Canadian jurisdiction.31 On the other hand, use of statins was more modest, again consistent with previous work.31 32 While we did not see any change in the use of statins post-KidneyWise, there would appear to be an opportunity to improve statin utilisation in those with increased cardiovascular risk.
This study has limitations that require consideration. Although the total number of referrals exceeded projections for the sample size determination, only 73% of the referrals were for low eGFR and proteinuria. A post hoc analysis indicates that we had 78% power to detect the original estimated effect size, suggesting the study may have been underpowered. However, based on the observed effect size, it seems unlikely that a larger sample size would have changed our conclusions. We do not have information on patients who may have met the KidneyWise referral criteria but were not referred. Only two sites were included in this study; however, they both have large catchment areas and are likely to be representative of other urban centres in Ontario. As already outlined, the strategies employed to promote uptake of KidneyWise may have been ineffective despite evidence that a majority of primary care providers were aware of KidneyWise.33 Additional time may have been required to realise the full impact of the KidneyWise toolkit on referral patterns. A follow-up 1-month audit (September 2018) at the SJHH site revealed that 68% of referrals for CKD met the KidneyWise criteria, up from 44.6% previously. Additionally, 23% of referrals during this time period used the KidneyWise referral form, implying increased awareness of the toolkit over time. Nevertheless, interventions such as electronic decision support tools that promote desired behaviours may be required to substantially improve referral practices and/or quality of CKD care.34 Finally, a large increase in referral number was observed at the community site, reflecting local changes in how referrals were directed to the central location, rather than necessarily a substantial overall increase in the number of referrals received.
In summary, we did not observe any change in the proportion of referrals for CKD that met the KidneyWise referral criteria at two large nephrology centres in Ontario, Canada, 1 year after implementation of the toolkit. We did, however, observe an increase in referrals for proteinuria that met the KidneyWise criteria, suggesting some impact of KidneyWise dissemination on referral patterns. Future efforts, including incorporation of KidneyWise into EMR systems, will require careful evaluation to determine whether such strategies may prove effective in improving the appropriateness of primary care referrals to nephrology.
References
Footnotes
Twitter @S_brimble
Contributors KSB, PB, AKG and DP conceived the study. KSB and AOM drafted the manuscript. AOM, DMN and AXG contributed substantially to the analytical approach. KSB conducted the data analyses. AA and PGB contributed to the interpretation of the data. All authors contributed substantially to the revision of the manuscript and provide final approval of this version.
Funding Funding was provided by the Ontario Renal Network.
Competing interests KSB is a paid Provincial Medical Lead at the Ontario Renal Network (ORN). AGK is a former paid Provincial Medical Lead at the ORN. PGB is a paid Provincial Medical Director of the ORN. DP has received research support from Amgen, Otsuka, Pfizer, Sanofi, Servier and Bausch Health; speaking fees/honoraria from Ardeane Healthcare Solutions; and consulting fees from Amgen, Otsuka, Pfizer, Sanofi and Servier. PB, AOM, DMN, AXG, AA and DP do not have any competing interests to declare.
Patient consent for publication Not required.
Ethics approval The study protocol was approved by the Hamilton Integrated Research Ethics Board (Study ID3: 14-847-C) and the Trillium Health Partners Research Ethics Board (ID#: 682).
Provenance and peer review Not commissioned; externally peer reviewed.
Data availability statement Data are available on reasonable request. Deidentified data (csv file) can be made available on reasonable request from readers by emailing the corresponding author at brimbles@mcmaster.ca.