Article Text

This article has a correction. Please see:


Is a high level of general practitioner consultations associated with low outpatients specialist clinic use? A cross-sectional study
  1. Trygve S Deraas1,2,
  2. Gro R Berntsen2,3,
  3. Toralf Hasvold2,
  4. Unni Ringberg2,
  5. Olav Helge Førde2
  1. 1Center of Clinical Documentation and Evaluation, Northern Norway Regional Health Authority, Tromsø, Norway
  2. 2Department of Community Medicine, University of Tromsø, Tromsø, Norway
  3. 3Norwegian Centre for Integrated Care and Telemedicine, University Hospital of North Norway, Tromsø, Norway
  1. Correspondence to Dr Trygve S Deraas; trygve.deraas{at}


Objective To examine if increased general practice activity is associated with lower outpatient specialist clinic use.

Design Cross-sectional population based study.

Setting All 430 Norwegian municipalities in 2009.

Participants All Norwegians aged ≥65 years (n=721 915; 56% women—15% of the total population).

Main outcome measure Specialised care outpatient clinic consultations per 1000 inhabitants (OPC rate). Main explanatory: general practitioner (GP) consultations per 1000 inhabitants (GP rate).

Results In total, there were 3 339 031 GP consultations (57% women) and 1 757 864 OPC consultations (53% women). The national mean GP rate was 4625.2 GP consultations per 1000 inhabitants (SD 1234.3) and the national mean OPC rate was 2434.3 per 1000 inhabitants (SD 695.3). Crude analysis showed a statistically significant positive association between GP rates and OPC rates. In regression analyses, we identified three effect modifiers; age, mortality and the municipal composite variable of ‘hospital status’ (present/not present) and ‘population size’ (small, medium and large). We stratified manually by these effect modifiers into five strata. Crude stratified analyses showed a statistically significant positive association for three out of five strata. For the same three strata, those in the highest GP consultation rate quintile had higher mean OPC rates compared with those in the lowest quintile after adjustment for confounders (p<0.001). People aged ≥85 in small municipalities had approximately 30% lower specialist care use compared with their peers in larger municipalities, although the association between GP-rates and OPC-rates was still positive.

Conclusions In a universal health insurance system with high GP-accessibility, a health policy focusing solely on a higher activity in terms of GP consultations will not likely decrease OPC use among elderly.

Statistics from

Article summary

Article focus

  • The majority of ecological studies suggest that proxies for higher primary healthcare (PHC) accessibility such as primary care physician (PCP) density and PCP/specialist ratio are associated with lower hospital use.

  • Studies on the association between PHC utilisation and secondary healthcare utilisation are lacking.

  • The present cross-sectional study examines the association between general practice utilisation and secondary care outpatient clinics utilisation among the elderly.

Key messages

  • Higher general practice consultation rate is associated with more outpatient secondary care use in a public financed healthcare system with low out-of-pocket expenses.

  • Legal and practical access to the existing individual-level and system-level healthcare unit data are needed to examine the role of PHC for secondary care utilisation.

Strengths and limitations of this study

  • Complete national age and sex stratified data of all GP consultations and secondary care outpatient clinic consultations among elderly over 65 is a strength of the study.

  • Aggregated data allowing for analysis and conclusions to be drawn at the municipal level where PHC is administered is a study strength.

  • Analyses were adjusted for several municipal level confounders, but lack of individual-level data made it impossible to adjust for individual-level confounders, such as morbidity, which is a limitation.


Future healthcare utilisation might escalate as a consequence of biomedical innovations, more informed patients and population ageing, which leads to a higher proportion of chronically ill individuals. Specialist healthcare (SHC) uses a major and increasing proportion of healthcare budgets, so rationing of these services is a priority in most countries. Governments,1 ,2 the WHO3 and the US employers4 argue for a strengthening of primary healthcare (PHC) to enhance chronic care and to better control healthcare expenditure.

Historically, Norway has a well-developed PHC in a universal health insurance system.5 Nevertheless, variations in hospital use,6 general practitioner (GP) referral rates7 and consultation costs8 are reported at physician, municipality and regional levels. A patient list system was introduced in 2001, partly to strengthen access to GPs and in connection with the newly implemented coordination reform it has been suggested to increase the number of GP's to ease pressure on the hospitals. Early detection of disease, and improved monitoring, care and treatment in general practice may decrease or increase the patient need for outpatient clinic (OPC) or private specialist appointments.9 This depends on GPs’ threshold for referrals, reflecting the diagnostic, organisational and therapeutic armamentarium in their local primary care setting.

The Norwegian coordination reform assumes that care for chronically ill, elderly people can be less fragmented and less expensive through the substitution of hospital use by enhanced primary care.10 The main measures are increase in GP capacity and reorganisation of the cooperation both within and between the levels of healthcare.

An OPC is by far the most frequent form of contact between GPs and hospitals in Norway, because the OPC consultations outnumber the hospital admission rate by a factor close to five.11 Findings, mostly from American ecological, macro-level studies, indicate that in large geographical areas (countries and states) proxies for PHC accessibility, is associated with better overall access to healthcare, lower healthcare expenses and hospital use and improved health outcomes.12 ,13 However, primary care seems to have more impact in societies with higher social inequalities and at higher levels of aggregation.13–15 We have not identified any previous studies investigating the association of direct measures of GP activity on secondary care utilisation. Thus, the question of whether GP-consultation rates are associated with lower OPC-consultation rates, which is the most common entry into secondary care, is currently unknown.

In the current study we had access to a national database including all GP consultations and all OPC consultations in Norway in 2009, which was the first year with almost complete data from private specialists.

The aim of this cross-sectional study was to examine the hypothesis that more general practice visits are associated with reduced use of specialised care by (1) exploring the association between rates of GP and OPC consultations among people aged >65 in Norway and (2) studying the effect modification of case-mix factors (age, sex and mortality) and barriers to secondary care (travel time to hospital and municipal hospital status).



This 1-year, total population-based, cross-sectional study included all Norwegians aged ≥65 years (n=721 915; 56% women—15% of the total population) in 2009. As we had no access to individual-level data, we chose to use aggregated data which was grouped according to Norwegian municipality of residence (n=430), sex and the following age groups: 65–69, 70–74, 75–79, 80–84, 85–89 and ≥90. This was the highest data granularity available from public registries. One of the principal aims of the research was to examine the effect of age on associations. Hence, rather than calculate age-standardised rates, a dataset was generated of 5145 units of observation, based on the 430 municipalities multiplied by 12 age/sex groupings. Analysis of the data using this structure allowed us to examine the effect modification of age and sex, something which is not possible with age-standardised and sex-standardised data which is common in this field. Information on GP consultation rates was missing for 46 rows (706 individuals). We linked data from the following:

  1. The Norwegian Patient Registry: OPC rate defined as the total number of both public and private OPC consultations in 2009 per 1000 inhabitants for each unit of analysis;

  2. Statistics Norway: mortality, socioeconomic variables;

  3. The Norwegian Health Economics Administration (HELFO): GP rate defined as the total number of GP office and out-of-hours casualty clinic consultations per 1000 inhabitants in 2009, in each unit of analysis.

The data were checked by hospitals and the Norwegian Patient Registry and underwent an internal quality check mainly based on comparisons with the previous year's data and internal consistency. The different data from Statistics Norway are derived from national public registries of all the citizens living in Norway.

Statistical methods

The outcome variable (OPC rate) had a Poisson distribution that approximates a normal distribution when the probability for the outcome is high (>5%). Thus, we manually built a linear regression model in SPSS (Statistical Package for Social Sciences) V.16 and SAS (Statistical Analysis System) V.9.2. To obtain as many percentile groups as possible to visualise threshold effects, while avoiding unstable results due to small numbers in each group, we classified our main explanatory variable, GP rate into quintiles. GP quintile 1 represented the lowest 20% and GP quintile 5 the highest 20% of the GP rate within each age group, thereby making age adjustment in analyses unnecessary. Table 1 describes the exact operationalisation and impact of several variables known to influence healthcare use.16

Table 1

Description and role in analyses of explanatory variables

Where bivariate correlation between the adjustment variables had a Pearson correlation coefficient ≥0.7, the variables were included as a joint composite variable. In the final model trends in the outcome across GP quintiles were tested by comparing the difference in annual Least Square means between the first and last quintiles using independent samples t test.

The number of individuals (n) falling within the 5145 units of analysis varied between 1 and 10 414 (mean 140.5). To ensure that those units containing few individuals did not have an unduly large influence on the results, all analyses were weighted by n. We did the analysis using a formalised evaluation of effect modification based on both statistical significance and policy relevance, in line with previous work.17 Policy relevance was a priori defined as a more than 15% change (365 OPC consultations per 1000 inhabitants) compared with the reference. Confounding was defined as a change in the predicted least square means of the relationship between the main explanatory and outcome variable of >10%.18

The estimates of both GP and OPC rates in the 12 sex and age groups were expected to correlate within each municipality. To account for this, we adjusted for municipality by adding it to the model as a random effect variable. Finally, we checked that the distribution of the standardised residuals for both the intermediate model (main variables, age and sex) and the final model were normally distributed.


In total, there were 3 339 031 GP consultations (56% women) and 1 757 864 OPC consultations (53% women) over the 12-month period. The mean GP rate was 4625.2 GP consultations per 1000 inhabitants (SD 1234.3) and the mean OPC rate was 2434.3 per 1000 inhabitants (SD 695.3). The national distribution of population, GP rates and OPC rates by five GP quintiles and strata is given in table 2.

Table 2

Descriptives of outcome, explanatory and stratifying variables

In crude analysis, there was a statistically significant positive relationship between GP rates and OPC rates (data not shown).

The association between the GP rate and the OPC rate was modified by age, mortality and the composite variable of municipal ‘hospital status’ (present/not present) and ‘population size’ (small, medium, large). We stratified manually by these effect modifying variables, resulting in five strata (figure 1). Crude stratified analyses showed (figure 2), a statistically significant positive t for the ‘Age group 65–84 small to medium & large non-hospital municipalities’-stratum, the 'Age group 85+ small, no hospital-stratum, and for the 'Age-group 85+ medium-large’-stratum. For the remaining two strata, the association was also positive, but not statistically significant.

Figure 1

Diagram of stratification by age, the composite variable of municipal ‘hospital status’ and ‘population size’ and mortality.

Figure 2

Crude (above) and adjusted (below) associations between general practitioner consultation and outpatient consultation rates. Stratified by age, the composite variable of municipal ‘hospital status’ and ‘population size’ and mortality. First quintile group represents the 20% lowest percentage in each 5-year age group. Accounted for repeated measures within municipality. Adjusted for sex, travel time to hospital and repeated measures within municipality. Norwegian population aged ≥65 years. 2009.

We then identified two significant confounders: (1) sex and (2) travel time to hospital. In the fully adjusted model (figure 2 and table 3), the three strata with statistically significant positive association in crude stratified analysis showed a statistically significant positive trend comparing top and bottom quintiles (p<0.0001).

Table 3

Outpatient consultations per 1000 inhabitants (OPC rate) by general practitioner consultations per 1000 inhabitants (GP rate) quintiles stratified by age and municipality type†

The 85+ stratum with medium and large municipalities and the highest mortality now became a negative but still non-significant association (p<0.07). The 85+ stratum for small municipalities without a hospital had a considerably lower OPC rate than all the other groups. This was between 24% and 39% lower than the OPC-rates of the stratum aged 85+ living in medium/larger municipalities.


The principal finding was a moderate positive association between GP consultation rates and rates of OPC use among elderly people in Norway in 2009. The main explanatory variable showed effect modification with age, mortality and the composite of hospital status and municipality population size. The positive association remained when the analysis was adjusted for the two confounding variables—sex and travel time to hospital—except in the oldest age group with the highest mortality in medium–large municipalities. Socioeconomic variables did not influence the association, and were not included in the final analysis.

Strengths and limitations

In Norway, the gate keeping principle requires that GPs send most referrals, in the first instance, to an OPC or private specialist for a specialist evaluation, where further decisions about diagnostic procedures, treatments, follow-up and referrals to other specialised personnel are made. About 90% of referrals to public OPCs and most referrals to private specialists are non-urgent, and the large OPC volume shows geographical variation.11 Consequently, the use of OPCs and specialists is a reliable indicator of the total healthcare use resulting from GP activities. Our comprehensive and high-quality, 1-year dataset offers a suitable base to study associations between explanatory factors and OPC use for older people in a universal healthcare system. By developing regression models using municipality, age and sex specific strata, we were able to examine age and sex effect modification in the age group mostly focused, namely elderly people. Available geographical, socioeconomic and demographic variables known to influence healthcare use made it possible to adjust for municipality and population characteristics.

As the Norwegian healthcare system has given PHC a high priority over the last decade, the findings have relevance for other countries planning to strengthen their PHC. Norway's 430 municipalities (2009) are well-defined administrative units, most frequently used in public statistics and responsible for the provision of PHC, including GPs. The municipalities are responsible for and provide the financial and organisational framework for primary care in Norway. Thus, the municipality level of aggregation allows us to draw conclusions at the healthcare unit level, but not at the individual level. GPs send their consultation data to the Norwegian Health Economics Administration (HELFO) for financial reimbursement. As 99.6% of the population are registered by a GP as list patients, data on GP consultations are considered complete and of acceptable quality. In addition, the dataset comprises the total number of consultations from almost all casualty clinics.

In Norway, specialist care is offered within a hospital setting that is both publicly funded and organised (‘public’), and among private specialists that is privately organised but predominately publicly funded (‘private’). The hospital OPC data include both ‘public’ and ‘private’ specialist consultations.

Due to data restrictions we undertook this analysis at an aggregate level, and therefore our results might by limited by the ecological fallacy if the area based associations we observed do not hold at the individual level. Nevertheless the hypothesis that we were testing is area based in nature as we are interested in exploring associations at system level that equates to that at which policies are implemented, so we argue that such aggregate analysis is appropriate in this case. A further limitation is that we only had data for a single time point, and hence interpretation of our findings should be made in light of the limitations of cross-sectional analyses for the determination of causality.

As no information of morbidity was available, we utilised all-cause mortality as a proxy for morbidity. This has limitations, as have other studies in this field,13 while some present only crude analyses.19 Some authors who have adjusted for morbidity in their analyses found little or no effect of morbidity adjustment on the association between GP volume and utilisation measures.8 ,20 ,21 We therefore believe that further adjustment of morbidity in our analyses would not have materially changed our findings.

Except for the highest GP quintile, mortality did not increase with GP quintiles, which is perhaps surprising. Nevertheless, while mortality was an effect modifier, the fact that it did not confound the associations we observed that its use in place of information on morbidity is unlikely to have introduced any significant bias into our analysis.

Over 90% of the ‘private’ specialists have delivered their consultation data for 2009. As 30% of all OPC consultations are ‘private’ in the dataset, the total OPC rates are slightly underestimated. We have no reason to believe that non-reporting of private OPCs is in any way related to GP consultation rates. Thus, we believe that this data error is random, although it may cause an underestimate of the observed positive relationships.

Overall, we believe that the limitations listed above do not threaten the conclusions in this study.

Previous research

Two American studies found a non-significant negative association between OPC use and the primary care physician:specialist ratio (PCP-ratio) or primary care physician density, respectively.14 ,15 In the USA several specialists (internists, family practitioners (GPs), paediatricians, obstetricians and gynaecologists) work as primary care physicians. About 44% of the consultations inside US PHC in 2007 were estimated to take place at specialists in family medicine/general practice, who are shown to have different values and goals from other specialists inside PHC.22 ,23 Hence, the US studies on the association between PHC and hospital use might be difficult to translate into European or Norwegian contexts, where GPs are the only primary care physicians. The PCP-ratio and ‘physician density’, used mostly in the American studies as explanatory variables for hospital use, are indirect primary care measures. Whether they are reliable proxies for the primary care activity is unclear. As variations in geography and demography influence both the coverage of GPs and the PCP-ratio, we have instead used a direct measure of the primary care delivered, namely the GP consultation rate (GP rate). Other studies have rarely focused specifically on the use of OPCs, which is the measure that we believe is the ‘gate’ leading to most of the other non-urgent specialist care activities in the Norwegian setting.

A Danish study, including referrals from 141 GPs to specialists, showed that a higher consultation rate was associated with more overall hospital use.24 In contrast to this, a Swedish cross-sectional study from four hospital districts including 52 health centres showed that high rates of GP visits were associated with reduced hospitalisation.25 These studies were undertaken in health systems that have many similarities with the Norwegian system, but the sample sizes were small. Kronman et al26 showed, in an American study of end-of-life primary care visits, that six or more GP visits had a possibly preventive effect on hospital use, thus indicating a GP effect above a certain threshold.

Interpretation of the results

The major finding is that higher GP activity is associated with higher OPC activity among people 65 years and older. This contradicts other studies demonstrating an overall more efficient healthcare system in countries where GPs are gatekeepers to specialised healthcare.27 Whether the strengthened bond between GPs and patients due to the patient list system has led to an even stronger GP emphasis on the patient advocate role at the expense of the gate keeper role is currently under debate.8 ,28 ,29 A study from Danish healthcare, highly comparable to the Norwegian healthcare system, reports an significant higher GP propensity to refer to secondary care in 2009 compared with 1993, mostly to OPC.30

Probably, both medical and technical development, increased comorbidity with age,31 a stronger population risk awareness,32 ,33 a growing tendency towards disease mongering34 and defensive medicine,35 ,36 indicating more intensive therapeutic examinations and/or follow-up37 are all factors that probably influence both the GP and the OPC activity and hence the studied association.

Strengthening the supply of and access to a GP may replace specialist care in societies with deficits and inequalities in healthcare. However, above a certain level, for example, in Norway with relatively high rates for both GPs and OPCs, there might be no further substitution effect of increasing GP availability without more clearly defining the organisation and content of the services. This must include a consideration on how GPs could be used more effectively, and how GPs can be included in chronic care management.

The absolute level of OPC use is substantially lower in the smaller and more distant municipalities (mean travel time approximately 1 h) for all age groups (table 2). We hypothesise that distance may be a barrier to secondary care. Whether this reflects an adequate pattern of use is unknown, but it is likely that these municipalities organise and integrate the total PHC system for elderly people differently. Two Canadian studies support such an interpretation.38 ,39 One Canadian qualitative study indicated that lower referral rates from distant municipalities can mostly be explained by access to local resources and corresponding practice styles that influence the local ecology of total healthcare use.40

The OPC utilisation differences between the highest and lowest GP percentiles are between 10% and 15%, highest for the oldest groups. The difference is close to what we a priori defined as relevant to policy, although we are not able to define the optimal level of the OPC-rate. Whether this reflects a quality improvement potential among some GPs, is outside the scope of the study. However, a recently published English report states that albeit a general good-quality, wide variation in performance and quality of care indicate an opportunity for quality improvement in general practice.41

The negative association found for the 85+ group with the highest mortality might illustrate that a higher GP presence meets the patient needs in this group better when in cooperation with municipal long-term care. Also, patients with a high morbidity might be referred directly to hospital inpatient care instead of an OPC. As the 85+ group with high mortality consists of 1.1% of the population of the dataset, we cannot exclude that the finding is a result of unstable data (table 2).

Further research

Characteristics of the healthcare system, case-mix and living conditions (geographical, cultural and socioeconomic) have an impact on the small area variations in healthcare use.42 In Norway, with moderate socioeconomic and mortality inequalities, we find that the variability in use of specialist care is explained by both differences in case-mix and variations at the municipal and healthcare level. There is a need for data that allow the analysis of individuals and higher level units simultaneously, preferably over time. This analysis necessitates adequate statistical frameworks, such as multilevel modelling. In addition we need legal and practical access to existing data sources at the individual and GP level, including information on multimorbidity and referrals that facilitates research on patient trajectories.

We conclude that more of the same GP service will hardly ease the pressure on secondary care in a setting with universal healthcare coverage and high GP-accessibility. A reduction in secondary care utilisation may be a joint product of both high GP access and a reorganisation of care, according to new principles of chronic care management. If so, health workers, including GPs and specialists, should consider to reorganise, redistribute and delegate some of their clinical work43 and participate or take the lead in collaborative care networks in partnership with some of their patients. However, implementing models for integrated chronic care is hard work,44 and might suffer from single disease-orientated rather than person-focused models, as many patients are multimorbid.45 ,46 Complex daily practices,47 interprofessional attitudes48 and insufficient management skills,49 are challenges which need to be focused both in development of such teams and in education and continued training for health personnel in the future.50 As such models are not necessarily transferable, they have to be developed and evaluated multidimensionally in a Scandinavian setting. How this will influence the utilisation and costs of primary and secondary care is a subject for research.


A high GP consultation rate in Norway is associated with increased use of specialised outpatient healthcare. This finding suggests that, in a universal health insurance system with high GP-accessibility, it is unlikely that a health policy focusing only on a higher volume of GP consultations will decrease pressure on SHC use among elderly people.


The authors would like to thank researcher Erik R Sund, Regional Health Authority of Northern Norway and Professor Andy Jones, University of East Anglia, for valuable comments to the manuscript.


View Abstract


  • Contributors TSD and GB initiated and designed the study. TSD collected the data. TSD and GB carried out the data analyses. TSD drafted the paper, and all authors contributed to the writing of the manuscript and read and approved the final manuscript. GB is the guarantor of the study.

  • Funding This work was supported by Regional Health Authority of Northern Norway, and the National Centre of Rural Medicine, Tromsø, Norway.

  • Competing interests None.

  • Ethics approval The study was approved by the Privacy Ombudsman for Research in Norway in accordance with the Personal Data Act and Health Registry Act (project number 17869).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement No additional data are available.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Linked Articles

  • Correction
    British Medical Journal Publishing Group