Objectives The International Cancer Benchmarking Partnership (ICBP) is a collaboration between 6 countries and 12 jurisdictions with similar primary care-led health services. This study investigates primary care physician (PCP) behaviour and systems that may contribute to the timeliness of investigating for cancer and subsequently, international survival differences.
Design A validated survey administered to PCPs via the internet set out in two parts: direct questions on primary care structure and practice relating to cancer diagnosis, and clinical vignettes, assessing management of scenarios relating to the diagnosis of lung, colorectal or ovarian cancer.
Participants 2795 PCPs in 11 jurisdictions: New South Wales and Victoria (Australia), British Columbia, Manitoba, Ontario (Canada), England, Northern Ireland, Wales (UK), Denmark, Norway and Sweden.
Primary and secondary outcome measures Analysis compared the cumulative proportion of PCPs in each jurisdiction opting to investigate or refer at each phase for each vignette with 1-year survival, and conditional 5-year survival rates for the relevant cancer and jurisdiction. Logistic regression was used to explore whether PCP characteristics or system differences in each jurisdiction affected the readiness to investigate.
Results 4 of 5 vignettes showed a statistically significant correlation (p<0.05 or better) between readiness to investigate or refer to secondary care at the first phase of each vignette and cancer survival rates for that jurisdiction. No consistent associations were found between readiness to investigate and selected PCP demographics, practice or health system variables.
Conclusions We demonstrate a correlation between the readiness of PCPs to investigate symptoms indicative of cancer and cancer survival rates, one of the first possible explanations for the variation in cancer survival between ICBP countries. No specific health system features consistently explained these findings. Some jurisdictions may consider lowering thresholds for PCPs to investigate for cancer—either directly, or by specialist referral, to improve outcomes.
- HEALTH SERVICES ADMINISTRATION & MANAGEMENT
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/
Statistics from Altmetric.com
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.
Strengths and limitations of this study
A novel, large and logistically complicated study using a validated survey.
Data were analysed from 2795 primary care physicians (PCPs) across 11 jurisdictions.
Response rates were suboptimal (ranging from 5.5% in England and British Columbia to 45.6% in Manitoba) and respondents were not totally representative of the PCPs in all jurisdictions.
It is difficult to assess the effect of these weaknesses on the interpretation of results but sensitivity analyses and the literature suggest it would not be large.
Significant differences in cancer survival have been demonstrated between countries with similar health systems.1 Poor outcomes may arise from late presentation, diagnostic delays and treatment differences, or combinations of these.1–6 There is some evidence that delay between presentation and diagnosis (the diagnostic interval)7 is associated with poorer outcomes,8–11 but the factors involved are complex and the strength of the relationship is unclear. Detailed knowledge about how the diagnostic interval is managed in health systems may explain these differences in survival.
The International Cancer Benchmarking Partnership (ICBP) is a collaboration across 6 countries (Australia, Canada, Denmark, Norway, Sweden and the UK) and 12 jurisdictions of comparable wealth and universal access to healthcare, established to examine international differences in cancer outcomes and identify possible causes. Cancer survival is higher in Australia, Canada and Sweden, intermediate in Norway, and lower in Denmark and the UK.1 Differences between the countries in the proportion of patients diagnosed with the cancer at an early stage, suggest that differences in the period prior to diagnosis contribute to the international variation in cancer survival, along with other potential factors, such as access to treatment and the quality of treatments.2–6
Public awareness of signs and symptoms, and beliefs about cancer, appear to be quite similar across jurisdictions and are therefore unlikely to account for much of the variation seen between countries. However, differences in perceived barriers to seeing the general practitioner (GP) have been reported.12 Differences in the way cancer symptoms are recognised and managed in primary care may contribute to the observed survival differences. For example, European intercountry differences in clinical diagnostic practice have been reported for gastrointestinal disorders.13 A stronger ‘gatekeeper’ role—whereby primary care physicians (PCPs) manage entry to specialist care and investigations—is also associated with worse cancer survival.14 This ‘gatekeeper issue’ is exemplified by the finding that higher rates of endoscopy referrals within individual UK general practices are associated with a lower mortality from oesophagogastric cancer.15 There are many system factors that will influence a PCPs decision to act, including guidelines, access to investigations, and culture of collaboration between primary and secondary care, and these will all contribute to PCP behaviour.16
The aims of this study were to describe the readiness of PCPs to consider investigation or referral for symptoms possibly indicative of cancer, and to relate this to international differences in primary care structure and practice. Our hypothesis was that there is a positive correlation between the proportion of PCPs who would investigate a specific symptom set for cancer and survival rates (for the given cancer) across jurisdictions. We also investigated whether the readiness of PCPs to investigate these cases could be explained by differences in primary care structure or PCP characteristics.
We conducted an international vignette survey among a sample of PCPs in participating jurisdictions.
We developed an online survey of PCPs exploring differences in their behaviours, attitudes, knowledge and skills relating to cancer diagnosis. Development involved iterative discussion with international partners at every stage of development. The overall validation was initially undertaken in England, with two rounds of validation, using a cognitive interviewing technique with PCPs following completion of the draft survey. Validation of the completed survey was tested in all jurisdictions, particularly to ensure that translation had not altered meaning. There were two questions relating to access to tests and internal consistency was measured by comparison of the answers to these questions. The development and validation has been described in detail elsewhere.17
The survey was in two parts: first, direct questions consisting of demographic details of the respondents and questions relating to service provision, access to investigations and waiting times following secondary care referrals; and second, vignettes on management choices for a patient presenting with symptoms suggestive of either lung (two vignettes), colorectal (two vignettes) or ovarian cancer (one vignette). Respondents were randomly presented with two vignettes (of different cancer sites), and were asked to complete the survey relating to their own practice rather than perceived best practice. Respondents were aware that the survey was part of a study linked to cancer.
Each vignette had two or three phases: phase 1 represented the first patient presentation; phases 2 and 3 represented subsequent visits, where the patient's symptoms had developed; each phase had a predefined positive predictive value (PPV) for the cancer, based on previous work, to ensure a defined increase in cancer risk at each phase (table 1).18–20 Respondents were not informed of the PPV for each set of symptoms and signs in the survey. However, specifying the PPVs in the analysis at each phase enabled a comparison of the readiness to act within vignettes and between vignettes of the same cancer. The response of primary interest was opting to identify possible cancer either by referral to secondary care or by undertaking a definitive diagnostic investigation in primary care: requesting either of these ended that vignette. The definitive tests were determined by an expert panel and included chest X-ray or lung CT for lung vignettes, colonoscopy or abdominal CT for colorectal vignettes and abdominal CT or abdominal or transvaginal ultrasound for the ovarian vignette.17
The final survey
The survey was completed in 11 jurisdictions: New South Wales and Victoria (Australia), British Columbia, Manitoba, Ontario (Canada), England, Northern Ireland, Wales (UK), Denmark, Norway and Sweden. All surveys were completed online.
Each jurisdiction decided on a method of sampling and approach to potential participants (by post or email), depending on local conditions and the availability of databases with PCP contact details, and participation incentives. While variation in sampling methods and approaches might be expected to introduce sample bias, and to affect response rates, there are no observable trends that would suggest that this is true (see online supplementary table S1).
Participants were PCPs working predominantly in clinical practice, including locums; retired PCPs and those in training were not eligible. Considering all jurisdictions, the online surveys were completed between May 2012 and July 2013; the start dates and end dates in each jurisdiction varied.
The representativeness of each sample was assessed by comparing gender, age and place of qualification between respondents, and data for all PCPs in each jurisdiction.
All participants gave their consent for their data to be used by completing the online survey. Approvals to conduct this study were sought from ethics committees in each jurisdiction (see online supplementary table S2).
Each jurisdiction aimed to recruit at least 200 respondents. This provided a 95% CI ±7% for equally distributed responses (eg, 50% responding ‘yes’), and ±6% CI for less equally distributed responses (eg, 20% responding ‘yes’).
Direct questions relating to demographics and primary care structure factors were analysed using descriptive statistics. The questions relating to average waiting times for tests and results were analysed by estimating the mean time from ordering a test to receiving the results by using the midpoint of each waiting time category.
Analysis of the vignettes was undertaken in two stages. Our hypothesis was explored by comparing the cumulative proportion of PCPs opting to investigate or refer at each phase for each vignette using percentage 1-year survival rates in each jurisdiction for the relevant cancer.
Linear correlations were estimated between the proportions opting to investigate at each phase and survival rates.
When comparing between jurisdictions, weighted linear regression was used to adjust for different sample sizes in each jurisdiction, based on the total number of respondents for each vignette. A regression model was fitted for each phase and each vignette using 1-year survival as the outcome, with the number of PCPs acting at each phase as a single explanatory variable. The weights were the inverse of the variance of the proportion at a given phase for each jurisdiction. No weighted regression models were possible for jurisdictions where all PCPs had opted to investigate at a given phase.
Logistic regression: multilevel model
Weighted regression did not allow us to explore if individual PCP characteristics and access to tests (within each jurisdiction) were associated with opting to investigate. Therefore, in the second stage of the analysis, we fitted separate multilevel logistic regression models using opting to investigate as the outcome and estimated the association with (A) PCP characteristics, (B) access to tests, (C) jurisdiction level survival (1-year and conditional 5-year survival) as reported by Coleman et al,1 and (D) a full model including PCP characteristics and access to tests. This last model only included those variables significantly associated in models (A) and (B) to reduce the chances of identifying spurious associations.
We identified variables that might influence opting to investigate in models (A) and (B), as well as the expected direction of effect (see online supplementary table S3). As with the weighted regression, analyses were performed by vignette as explanatory variables were different for each cancer. These variables are not independent and therefore some basic model selection (based on statistical significant associations p value <0.05) was used to determine the choice of variables included in model (C).
Previous studies comparing survival rates between England or the UK to other countries suggested that later diagnosis could be a factor contributing to poorer outcomes: thus, opting to investigate or refer later in the process of clinical presentation would contribute to the delay in diagnosis in poorer performing jurisdictions.1 ,19 Both 1-year and conditional 5-year survival on surviving at least 1 year (conditional 5-year survival) could reflect a longer diagnostic interval due to delays, including in primary care, but neither are a perfect measure of this.21 We chose 1-year survival as the primary outcome measure as we anticipated that it more directly reflects activity in primary care. We then undertook sensitivity analysis using conditional 5-year survival to check that our findings were also confirmed using this outcome.
Denmark has substantially changed its primary care referral procedures since the latest reported comparative survival figures.22 ,23 This change in procedures was apparent in the results, with Denmark appearing as an outlier in vignettes 3 and 4 related to the diagnosis of colorectal cancer; analyses of these two vignettes were repeated excluding Denmark.
Australia oversampled rural PCPs to ensure the views of this minority were adequately represented. A post hoc sensitivity analysis was undertaken to address this: we formed a data set with a sample of rural PCPs so that this was representative of the rural/urban split in Australia and compared these with the results of the whole data set.
At all stages, the methodology, sampling and analysis were discussed with four separate working groups: the module lead of each jurisdiction, the Programme Board overseeing the whole ICBP programme, an academic steering group comprising the module chair and three academic PCPs with an interest in cancer (PWR, GR, WH, PV) and an academic reference group comprising primary care academics from within and outside ICBP jurisdictions.
The online survey was completed by 2795 PCPs. Almost all jurisdictions received at least 200 responses; only the Northern Ireland response (the smallest total population) was below this target but with a GP population of 1165 clinicians their crude response rate amounted to 11.2%. Crude response rates (most jurisdictions stopped the survey when the sample size was reached) varied between jurisdictions, from 5.5% in England and British Columbia to 45.6% in Manitoba (see online supplementary appendix table 1).
Characteristics of respondents are summarised in see online supplementary table S4. There were significantly more women PCPs in the samples from Victoria, Ontario and British Columbia and fewer from Norway, when compared with their national data. The samples from England, Wales, Northern Ireland, New South Wales, Victoria, Sweden, Norway and Ontario had fewer doctors who had qualified outside the country, and Manitoba had more (for Canadian provinces and Australian states this meant training outside Canada and Australia, respectively). Respondents from England and Norway were older, whereas respondents from New South Wales and all Canadian provinces were younger, compared with national data. Acknowledging that confidence intervals would be wider than anticipated, Northern Ireland was included for completeness.
In 4 of the 5 vignettes, there was a statistically significant correlation (p<0.05) between opting to investigate for cancer in a jurisdiction at phase 1 and the cancer survival in that jurisdiction (figure 1). Only phase 1 results are presented; nearly all PCPs had taken action to refer or investigate for a potential diagnosis of cancer by the end of phase 2.
Vignette 1 (lung cancer) was the only vignette that did not show any statistically significant correlations. In this vignette, the estimated PPV for lung cancer for the symptoms presented at phase 1 was 0.9% (although this was not explicitly presented in the vignette) and yet the range of respondents opting to investigate at this phase between jurisdictions was 40–80% (table 1). The estimated PPV for lung cancer in phase 1 of vignette 2 was higher at 3.6% and yet the range of respondents opting to investigate at this phase was 4–52%.
The lung and ovarian cancer vignettes were usually completed by the use of a test (chest X-ray for lung cancer, ultrasound for ovarian cancer) rather than by specialist referral. In contrast, more than half of the colorectal vignettes were completed by referral.
Consistent with the correlation results, statistically significant associations were found using weighted regression between the 1-year survival and readiness to investigate at phase 1 for vignettes 2, 3, 4 (after Denmark was excluded) and 5. For the sensitivity analysis based on the conditional 5-year survival, this association was found at phase 1 for vignettes 2, 3 and 4 (after Denmark was excluded; table 1).
Logistic regression analysis
No factors (PCP characteristics, access to tests or length of time from ordering test to receiving results) showed a consistent association with the readiness to investigate. The only two PCP characteristics associated with the outcome were that doctors who trained outside their jurisdiction were more likely to refer or investigate cases earlier in vignettes 3 and 4 (both colorectal) and older doctors were more likely to refer or investigate cases earlier in vignette 4. The former association was investigated further using data from Manitoba (the only jurisdiction to have more doctors trained outside of the jurisdiction); within this data set there was no association found between place of training and readiness to investigate. The latter association was no longer statistically significant when excluding Denmark as part of the sensitivity analysis; while training outside was still significant (data not shown).
Similarly, adjusting for rural/urban split among Australian PCPs did not significantly affect the results.
Direct questions: access to diagnostics and secondary care advice
Similarities and differences in primary care system factors are reported between jurisdictions. Reported direct access to blood tests for cancer diagnosis, plain X-rays and ultrasound was greater than 70% across all jurisdictions (table 2). Access to other tests was variable. Direct access to endoscopy was less common in Canada. The UK and Denmark had comparatively low levels of direct access to CT and MRI scanning.
With the exception of plain X-rays, the total wait from request to receipt of report for imaging or endoscopy was reported to be over 4 weeks in most jurisdictions and over 12 weeks in some. Total wait between a referral for a suspected cancer and a patient's first specialist appointment was between 2 and 3 weeks for all jurisdictions (table 3). Most PCPs reported they could expedite access to tests if cancer was suspected. With the exception of the UK, most PCPs reported ready access to secondary care advice about investigation or referral of suspected cancer (table 4).
While there was variation across jurisdictions in terms of access to diagnostics and secondary care advice, none of these factors were associated with PCP readiness to act.
Using an online survey in 11 jurisdictions, we have demonstrated a correlation that suggests a relationship between the readiness of PCPs to investigate or refer for suspected cancer and cancer survival in each jurisdiction. This is the first time that readiness to investigate cancer—either directly or by referral to secondary care—has been shown to correlate with cancer survival. Evidence suggests that variations between healthcare systems have an impact on health outcomes.24 There is significant variation between jurisdictions in PCP's access to diagnostic tests. Whether greater access to tests improves outcomes depends on the sensitivity of the test and how the waiting time for test results compares with the waiting time if a referral is made. PCPs may not be aware of the fastest way to diagnose cancer: referral or primary care investigation. Our data indicate significantly long waits in some jurisdictions for the results of tests undertaken in primary care. However, access to tests was not associated with readiness to investigate or refer. Further research is required in this complex area.
Strengths and weaknesses
This was a novel, large, logistically complex survey using a validated tool in 11 jurisdictions with primary care-based health systems. Once respondents engaged in the online survey, the proportion who went on to complete it was high. The vignettes had face validity; they directly reflected clinical practice and were universally applicable.17 Moreover, since the study was completed, the vignettes have been adopted as part of a GP education programme in the UK, in light of their applicability to primary care. There is evidence that using vignettes in a survey correlates well to clinical practice.25 Vignettes have also been used recently in a similar context.26 While surveys using hypothetical vignettes are not ideal, we chose vignette-based surveys as a cost-effective way to maintain consistency across all jurisdictions.
The readiness of PCPs to act consists of personal attributes (eg, knowledge and attitudes about cancer as well as perceptions about the role of PCPs) and system features (eg, guidelines, availability of tests/referral and waiting time for results). A multiple regression analysis did not find a significant association with any of these factors.
This study used an ecological outcome, which makes the risk of an ecological fallacy important. We do not know whether the correlation with readiness and survival is causal or simply an indicator of other factors. Therefore, this study raises the potential of an interaction between the PCPs’ readiness and the system in which they act. These results add to the science pointing towards this important implication.
The poor response rates in some jurisdictions and the lack of representativeness of the respondents in several jurisdictions (based on demographic data) are weaknesses. It is difficult to assess whether and by how much these two factors would affect the interpretation of the results. Two jurisdictions achieved a response rate of over 25%; in other jurisdictions, response rates ranged from 5.5% to 18.7%. A significant obstacle to achieving better response rates in some jurisdictions was limited availability of comprehensive and up-to-date email addresses for PCPs. The response rates achieved are broadly in line with lower response rates for online surveys generally.27 Furthermore, response rates in physician surveys have been declining in recent years.28
Those responding were not wholly representative of their local PCP population, but the differences in gender and country of qualification were bidirectional. Evidence from Australia suggests that while respondents had more positive views about cancer compared to non-responders, the magnitude of this difference is the same irrespective of incentives (conditional or otherwise).29 In addition, respondents were aware the survey was part of a study linked to cancer for ethical reasons; responses might have been different in a blinded study. Taken together, these biases tend to underestimate the possible variation, and our results are thus minimum estimates of the correlation between readiness to investigate and survival. In jurisdictions where respondents were less representative of the local PCP population, respondents were in general more likely to be women, to have qualified in that country and to be younger. Although training outside the country was associated with opting to act earlier in the colorectal vignettes, sensitivity analysis using Manitoba data suggested this is unlikely to have substantially affected overall results. A systematic review of studies of primary care referrals suggested that less than 10% of the observed variation in referral rates could be accounted for by practice and GP characteristics.30 It is therefore unlikely that the minor unrepresentativeness of some samples has materially altered the findings. Other hidden confounders may have influenced the results, but they are unlikely to have been major.
Earlier diagnosis could lead to perceived better outcomes through two mechanisms: earlier stage at diagnosis or lead time bias. Our correlations were significant for both 1-year and conditional 5-year survival, suggesting that lead time bias is less of an issue.
The vignettes all described hypothetical patients with symptoms that have been shown to be significantly associated with the given cancer.
The survey was conducted in 2012/2013 and therefore reflects clinical practice at that time. The latest comparative survival data for the three cancers in participating jurisdictions is from 2007. The jurisdictions had no major changes to cancer diagnostic pathways during that time, with the exception of Denmark, which in 2009, introduced significant reforms to improve diagnostic access for PCPs. Consequently, Denmark was often an outlier in the analyses: sensitivity analyses including and excluding Denmark strengthened our findings.
Comparison with other research
An analysis of the health systems in the ICBP jurisdictions showed few significant differences.15 Poorer outcomes have been correlated with the strength of the ‘gatekeeping’ role of PCPs in different health systems13: our findings broadly support this. Denmark has deliberately reorganised cancer diagnostic services to reduce the gatekeeping role by enabling PCPs to undertake timely investigation of patients with alarming as well as vague symptoms.23 Our results suggest that Danish PCPs now behave more similarly to PCPs in jurisdictions with better cancer outcomes. Gatekeeping may encourage PCPs to overuse other diagnostic strategies, such as the ‘test of time’, which could contribute to longer diagnostic intervals.31 Other possible reasons to account for our results include PCPs’ knowledge and PCPs’ relationships with specialists.
In this study, PCPs opted to investigate at low levels of risk, possibly reflecting bias, because this was a survey relating to cancer. However, recent work suggests that patients prefer to be investigated when cancer is a possibility even at low-risk levels.25 If risk thresholds at which symptoms are investigated were to be lowered, health economic considerations would need to be taken into account. The use of risk prediction tools32 ,33 may aid PCPs in this respect. Our findings also suggested that PCPs were not necessarily aware of the PPVs of groups of symptoms. Across all jurisdictions, the speed of referral was inversely related to the PPV for lung cancer in the two lung vignettes. However, these counterintuitive responses are consistent with referral guidelines in some of the jurisdictions. Variation in readiness to investigate or refer to secondary care by PCPs for patients with a differential diagnosis of cancer might explain some of the variation in cancer survival between ICBP jurisdictions. It is unlikely that a single solution to this variation will work across all jurisdictions. However, solutions are likely to include initiatives that empower PCPs towards earlier investigation of cancer and to reduce the barriers that inhibit specialist referral. Such changes are likely to require changes in local policy leading to increased access to investigations and diagnostics, more efficient referral pathways and the redrafting of local referral guidelines, to facilitate referral at risk levels below those currently mandated.
The study supports the ecological findings that there is a correlation between the healthcare system and the way PCPs perform clinical diagnosis. Therefore, it seems appropriate to perform studies to assess which factors affect the readiness of a PCP to investigate or refer, for example, changed access to investigations, the nature and recommendations of clinical guidelines, access to rapid diagnostics and referral, and the nature of relationships between primary and secondary care. Further studies on using alternate outcome measures such as stage distribution, and cohort studies on survival and mortality, could provide additional insights into these factors.
The authors would like to thank Kate Aldersey, Martine Bomb and Catherine Foot of Cancer Research UK for managing the ICBP programme, along with Brad Groves and Samantha Harrison who have been key to bringing about the development of this paper. John Archibald at Sigmer Technologies Ltd for hosting the online survey. Alice Fuller for help with data management. The authors would also like to acknowledge and thank our ICBP clinical committee members and working group members in each jurisdiction who were not part of the central team, but who contributed to the review of our results and this paper. Programme Board: Ole Andersen (Danish Health and Medicines Authority, Copenhagen, Denmark), Søren Brostrøm (Danish Health and Medicines Authority, Copenhagen, Denmark), Heather Bryant (Canadian Partnership Against Cancer, Toronto, Canada), David Currow (Cancer Institute New South Wales, Sydney, Australia), Dhali Dhaliwal (Cancer Care Manitoba, Winnipeg, Canada), Anna Gavin (Northern Ireland Cancer Registry, Queens University, Belfast, UK), Gunilla Gunnarsson (Swedish Association of Local Authorities and Regions, Stockholm, Sweden), Jane Hanson (Welsh Cancer National Specialist Advisory Group, Public Health Wales, Cardiff, UK), Todd Harper (Cancer Council Victoria, Carlton, Australia), Stein Kaasa (University Hospital of Trondheim, Trondheim, Norway), Nicola Quin (Cancer Council Victoria, Carlton, Australia), Linda Rabeneck (Cancer Care Ontario, Toronto, Canada), Michael A Richards (Care Quality Commission, London, UK), Michael Sherar (Cancer Care Ontario, Toronto, Canada), Robert Thomas (Department of Health Victoria, Melbourne, Australia). Academic Reference Group: Jon Emery, Professor of Primary Care Cancer Research, University of Melbourne and Clinical Professor of General Practice, University of Western Australia, Australia. Niek de Wit, Professor of General Practice, Julius Centre for Health Sciences and Primary Care, University Medical Centre, Utrecht, The Netherlands. Roger Jones, Editor, British Journal of General Practice and Emeritus Professor of General Practice, King’s College, London, UK. Jean Muris, Associate Professor in Family Medicine, Maastricht University, The Netherlands. Frede Olesen, Professor, Research Unit for General Practice, Department of Public Health, University of Aarhus, Denmark.
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
- Data supplement 1 - Online tables
Twitter Follow Greg Rubin at @GregRubin4
Collaborators Module 3 Working Group*—Andriana Barisic, Research Associate, Department of Prevention and Cancer Control, Cancer Care Ontario, Toronto, Ontario, Canada. MD, Head, Department of Family Practice, University of British Columbia, Vancouver, British Columbia, Canada. Diana Dawes, Research Associate, Department of Family Practice, University of British Columbia, Vancouver, British Columbia, Canada. Mark Elwood, School of Population Health, University of Auckland, Auckland, New Zealand. Kirsty Forsdike, Senior Research Assistant, Department of General Practice, Carlton Victoria, Australia. EG, Director, Knowledge Translation Research Network Health Services Research Program, Ontario Institute for Cancer Research; Professor and Vice Chair Research Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada. NH, Clinical Senior Lecturer, School of Medicine, Dentistry and Biomedical Sciences—Centre for Public Health, Queen’s University Belfast 2013, UK. Breann Hawryluk, Project Planning Coordinator, Department of Patient Navigation, Cancer Care Manitoba, Winnipeg, Manitoba, Canada. GK, Associate Professor, Department of Family Medicine, University of Manitoba Winnipeg, Manitoba, Canada. Anne Kari Knudsen, Administrative leader, Department of Cancer Research and Molecular Medicine, Norwegian University of Science and Technology, Trondheim. Magdalena Lagerlund, Department of Learning, Informatics, Management and Ethics, Karolinska Institute, Stockholm, Sweden. Claire McAulay, Research Officer, Public Health, School of Public Health, D02-QE11 Research Institute for Mothers and Infants, University of Sydney Australia. Jin Mou, Postdoctoral Fellow, Department of Family Practice, Research Office, Department of Family Practice, University of British Columbia, Vancouver, British Columbia, Canada. RDN, Professor of Primary Care Medicine and Director, North Wales Centre for Primary Care Research, Bangor University, Wrexham Technology Park, Wrexham, UK. Marie Pirotta, Primary Health Care Research Evaluation and Development Senior Research Fellow, Department of General Practice, Carlton Victoria, Australia. Jeffrey Sisler, Associate Dean, Division of Continuing Professional Development and Professor, Department of Family Medicine, University of Manitoba, Winnipeg, Manitoba, Canada. BST, PhD Research Fellow, Research Unit for General Practice, Department of Public Health, Aarhus University, Bartholins Allé 2, Aarhus C, Denmark. HT, Associate Professor, Lund University, Lund, Sweden. PV, Professor, Research Unit for General Practice, Department of Public Health, Aarhus University, Bartholins Allé 2, Aarhus C, Denmark. David Weller, James Mackenzie Professor of General Practice, Centre for Population Health Sciences, University of Edinburgh, Medical Quad Teviot Place, Edinburgh, UK. JY, Professor in Cancer Epidemiology, Public Health, School of Public Health, D02-QE11 Research Institute for Mothers and Infants, The University of Sydney, Australia.
Contributors PWR, GR, RP-S, SSA, AB, MD, EG, NH, RDN, MP, JS, GK, BST, HT, JY, WH and the ICBP Module 3 Working Group contributed to the manuscript, the study design, data collection, data interpretation, review process; reading and considering the analysis, being involved in discussion and contributing variously to the iterative writing and commenting process. PWR wrote the original manuscript.
Funding This work was supported by Canadian Partnership Against Cancer; Cancer Care Manitoba; Cancer Care Ontario; Cancer Council Victoria; Cancer Institute New South Wales; Danish Health and Medicines Authority; Danish Cancer Society; Department of Health, England; Department of Health, Victoria; Northern Ireland Cancer Registry; The Public Health Agency, Northern Ireland; Norwegian Directorate of Health; South Wales Cancer Network; Swedish Association for Local Authorities and Regions; Tenovus; British Columbia Cancer Agency; and the Welsh Government.
Competing interests WH is the clinical lead for the ongoing revision of the NICE 2005 guidance on investigation of possible cancer, CG27.
Ethics approval NRES Committee South Central—Berkshire.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement Additional data can be accessed via the Dryad data repository at http://datadryad.org/ with the reference is: http://dx.doi.org/10.5061/dryad.bg2h0/1.