General paper
Using administrative databases to evaluate the quality of medical care: A conceptual framework

https://doi.org/10.1016/0277-9536(94)00275-XGet rights and content

Abstract

Health care is consuming an ever larger share of national resources in the United States. Measures to contain costs and evidence of unexplained variation in patient outcomes have led to concern about inadequacy in the quality of health care. As a measure of quality, the evaluation of hospitals through analysis of their discharge databases has been suggested because of the scope and economy offered by this methodology. However, the value of the information obtained through these analyses has been questioned because of the inadequacy of the clinical data contained in administrative databases and the resultant inability to control accurately for patient variation. We suggest, however, that the major shortcoming of prior attempts to use large databases to perform across-facility evaluation has resulted from the lack of a conceptual framework to guide the analysis. We propose a framework which identifies component areas and clarifies the underlying assumptions of the analytic process. For each area, criteria are identified which will maximize the validity of the results. Hospitals identified as having unexpectedly high unfavorable outcomes when our framework is applied will be those where poor quality will most likely be found by primary review of the process of care. We outline the following criteria for the selection of disease-outcome pairs to be studied in large administrative database analysis: (1) disease entities or clinical states selected should be well defined and easily diagnosed; (2) if diagnostic classification systems are used, disease groups should be homogeneous as to the clinical states they contain; (3) the disease entities should be prevalent; (4) a plausible link should exist between the quality (process) of care and the frequency of the outcome; (5) types of care which conform to acceptable practice standards but still lead to variation in the outcome of interest should be excluded from the analysis; (6) the outcomes should be prevalent; (7) constraints of the ICD-9 coding system should be understood such that only those disease-outcome pairs least affected by these limitations are selected for analysis; (8) constraints of the structure of the database should be considered when the analysis is performed; and (9) disease-outcome pairs should be chosen where there is agreement on the processes of care that affect the outcome of interest, either favorably or unfavorably.

References (55)

  • C.E. Lewis

    Variations in the incidence of surgery

    N. Engl. J. Med.

    (1969)
  • P.M. Ellwood

    A technology of patient experience

    N. Engl. J. Med.

    (1988)
  • J.E. Wennberg et al.

    Hospital use and mortality among Medicare beneficiaries in Boston and New Haven

    New Engl. J. Med.

    (1989)
  • J.E. Wennberg et al.

    Variations in medical care among small areas

    Scient. Am.

    (1982)
  • J.E. Wennberg et al.

    A test of consumer contribution to small area variations in health care delivery

    J. Maine med. Ass.

    (1977)
  • J.E. Wennberg et al.

    Health care delivery in Maine, part II: conditions explaining hospital admissions

    J. Maine med. Ass.

    (1975)
    J.E. Wennberg et al.

    Health care delivery in Maine, part II: conditions explaining hospital admissions

    J. Maine med. Ass.

    (1975)
  • J.E. Wennberg et al.

    Small area variations in health care delivery

    Science, N.Y.

    (1973)
  • L.F. McMahon et al.

    Variation in hospital admissions among small areas: a comparison of Maine and Michigan

    Med. Care

    (1989)
  • F.A. Connell et al.

    Clinical correlates of small area variation in the admission rates for diabetics

    Med. Care

    (1984)
  • M. Gornick

    Medicare patients: geographic differences in hospital discharge rates and multiple stays

    Soc. Secur. Bull.

    (1977)
  • J. Wennberg et al.

    Health care delivery in Maine, part I: patterns of use of common surgical procedures

    J. Maine med. Ass.

    (1975)
    J. Wennberg et al.

    Health care delivery in Maine, part I: patterns of use of common surgical procedures

    J. Maine med. Ass.

    (1975)
  • J.P. Bunker

    Surgical manpower: a comparison of operations and surgeons in the United States and in England and Wales

    N. Engl. J. Med.

    (1970)
  • A.M. Gittelsohn et al.

    On the risk of organ loss

    J. chron. Dis.

    (1976)
  • J.A. Glover

    The incidence of tonsillectomy in school children

  • K. McPherson et al.

    Small-area variations in the use of common surgical procedures: an international comparison of New England, England, and Norway

    N. Engl. J. Med.

    (1982)
  • N.P. Roos

    Hysterectomy: variations in rates across small areas and across physicians' practices

    Am. J. publ. Hlth

    (1984)
  • T. Sofer et al.

    Hysterectomy in Manitoba—1970–1978: patterns of practice and changes over time

    Can. J. publ. Hlth

    (1983)
  • M.R. Chassin et al.

    Does inappropriate use explain geographic variations in the use of health care services?

    J. Am. med. Ass.

    (1987)
  • J.E. Wennberg

    Small area analysis and the medical care outcome problem

  • J.E. Wennberg et al.

    An assessment of prostatectomy for benign urinary tract obstruction: geographic variations and the evaluation of medical care outcomes

    J. Am. med. Ass.

    (1988)
  • N.P. Roos et al.

    Mortality and reoperation after open and transurethral resection of the prostate for benign prostatic hyperplasia

    N. Engl. J. Med.

    (1989)
  • P.D. Henteleff et al.

    Indications for tonsillectomy: a 4-yr follow-up evaluation

    Clin. Invest. Med.

    (1981)
  • G.L. Goyert et al.

    The physician factor in cesarean birth rates

    N. Engl. J. Med.

    (1989)
  • D.M. Eddy

    Variations in physician practice: the role of uncertainty

    Hlth Aff.

    (1984)
  • L.M. Koran

    The reliability of clinical methods, data, and judgments—(first of two parts)

    N. Engl. J. Med.

    (1975)
  • L.M. Koran

    The reliability of clinical methods, data, and judgments—(second of two parts)

    N. Engl. J. Med.

    (1975)
  • J.E. Wennberg et al.

    Professional uncertainty and the problem of supplier-induced demand

    Soc. Sci. Med.

    (1982)
  • Cited by (0)

    View full text