An R-squared measure of goodness of fit for some common nonlinear regression models

https://doi.org/10.1016/S0304-4076(96)01818-0Get rights and content

Abstract

For regression models other than the linear model, R-squared type goodness-of-fit summary statistics have been constructed for particular models using a variety of methods. We propose an R-squared measure of goodness of fit for the class of exponential family regression models, which includes logit, probit, Poisson, geometric, gamma, and exponential. This R-squared is defined as the proportionate reduction in uncertainty, measured by Kullback-Leibler divergence, due to the inclusion of regressors. Under further conditions concerning the conditional mean function it can also be interpreted as the fraction of uncertainty explained by the fitted model.

References (33)

  • L.A. Baxter et al.

    Applications of linear models in motor insurance

  • A. Buse

    Goodness of fit in generalized least squares estimation

    The American Statistician

    (1973)
  • A.C. Cameron et al.

    R-squared measures for count data regression models with applications to health care utilization

    Journal of Business and Economic Statistics

    (1996)
  • R. Christensen

    Log-linear models

    (1990)
  • J. Cragg et al.

    The demand for automobiles

    Canadian Journal of Economics

    (1970)
  • R.D. Cook

    Assessment of local influence

    Journal of the Royal Statistical Society B

    (1986)
  • B. Efron

    Regression and ANOVA with zero-one data: Measures of residual variation

    Journal of the American Statistical Association

    (1978)
  • C. Gourieroux et al.

    Pseudo maximum likelihood methods: Theory

    Econometrica

    (1984)
  • T. Hastie

    A closer look at the deviance

    The American Statistician

    (1987)
  • J.A. Hauser

    Testing the accuracy, usefulness, and significance of probabilistic choice models: An information-theoretic approach

    Operations Research

    (1978)
  • J.T. Kent

    Information gain and a general measure of correlation

    Biometrika

    (1983)
  • S. Kullback

    Information theory and statistics

    (1959)
  • T. Laitila

    A pseudo-R2 measure for limited and qualitative dependent variable models

    Journal of Econometrics

    (1993)
  • J.M. Landwehr et al.

    Graphical methods for assessing logistic regression models

    Journal of the American Statistical Association

    (1984)
  • E. Maasoumi

    A compendium to information in economics and econometrics

    Econometric Reviews

    (1993)
  • G.S. Maddala

    Limited dependent and qualitative variables in econometrics

    (1983)
  • Cited by (0)

    The authors are grateful to Richard Blundell, Shiferaw Gurmu, and two anonymous referees for their helpful comments.

    View full text