Skip to main content
Log in

Assessing Functional Impairment and Social Adaptation for Child Mental Health Services Research: A Review of Measures

  • Published:
Mental Health Services Research

Abstract

The need for assessing impairment in functioning as an integral part of child mental health services research is discussed. Methodologic difficulties related to problems in case definition, the conceptual definition of impairment and social adaptation, and the assessment of the construct across cultures are also addressed. In addition, a critical review of existing child impairment measures with published psychometric properties is presented. The measures are divided into three types: measures of global impairment, domain-specific measures, and symptom-specific measures. The paper concludes that the choice of the measure to use in health services research needs to be determined according to the main goals of the study, the population in which the instrument is going to be used, and the interviewer's knowledge of the child. Other characteristics of the measures of impairment that the researcher should consider are also discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  • Achenbach, T. M. (1991). Manual for the Child Behavior Checklist/4–18 and 1991 Profile. Burlington, VT: University of Vermont Department of Psychiatry.

    Google Scholar 

  • Achenbach, T. M., Bird, H. R., Canino, G., Phares, V., Gould, M. S., & Rubio-Stipec, M. (1990). Epidemiological comparisons of Puerto Rican and U.S. mainland children: Parent, teacher, and self reports. Journal of the American Academy of Child and Adolescent Psychiatry, 29, 84–93.

    PubMed  Google Scholar 

  • American Psychiatric Association. (1980). Diagnostic and Statistical Manual of Mental Disorders (DSM-III). Washington, DC: American Psychiatric Association

    Google Scholar 

  • American Psychiatric Association. (1994). Diagnostic and Statistical Manual of Mental Disorders (DSM-IV). Washington, DC: American Psychiatric Association.

    Google Scholar 

  • Anastasi, A. (1950). The concept of validity in the interpretation of test scores. Journal of Psychology and Educational Measures, 67–78.

  • Anastasi, A. (1986). Evolving concepts of test validation. Annals of Developmental Psychology, 37, 1–15.

    Google Scholar 

  • Angold, A., Costello, E. J. (1995). A test re-test reliability study of child-reported psychiatric symptoms and diagnoses using the Child and Adolescent Psychiatric Assessment (CAPAC). Psychological Medicine, 25, 755–762.

    PubMed  Google Scholar 

  • Angold, A., Costello, E. J. (in press). The Child and Adolescent Psychiatric Assessment. Journal of the American Academy of Child and Adolescent Psychiatry.

  • Angold, A., Costello, E. J., Farmer, E. M. Z., Burns, B. J., & Erkanli, A. (1999). Impaired but undiagnosed. Journal of the American Academy of Child and Adolescent Psychiatry, 38, 129–137.

    PubMed  Google Scholar 

  • Angold, A., Prendergast, M., Cox, A., Harrington, R., Simonoff, E., & Rutter, M. (1995). The Child and Adolescent Psychiatric Assessment (CAPA). Psychological Medicine, 25, 739–753.

    PubMed  Google Scholar 

  • Beiser, M., Lancee, W., Gotowiec, A., Sack, W., & Redshirt, R. (1993). Measuring self-perceived role competence among first nations and non native children. Canadian Journal of Psychiatry, 38, 412–419.

    Google Scholar 

  • Bickerton, W. L., Vostanis, P., Cumella, & Chung, M. C. (1995). Adaptive functioning and behaviour of children with special needs: comparison between ethnic groups. Mental Handicap Research, 8, 156–167.

    Google Scholar 

  • Bickman, L., Guthrie, P., Foster, E., M., Lambert, E., W., Summerfelt, W. T., Breda, C., & Heflinger, C., A. (1995). Evaluating Managed Mental Health Services: The Fort Bragg Experiment. New York: Plenum.

    Google Scholar 

  • Bickman, L., Lambert, E., W., Karver, M., & Andrade, A. R. (1998). Two low cost measures of child and adolescent functioning for services research. Evaluation and Program Planning, 21, 263–275.

    Google Scholar 

  • Biederman, J., Newcon, J., & Sprich, S. (1991). Comorbidity of attention deficit hyperactivity disorder with conduct, depressive, anxiety and other disorders. American Journal of Psychiatry, 148, 564–577.

    PubMed  Google Scholar 

  • Bird, H. R., Andrews, H., Schwab-Stone, M., Goodman, S., Dulcan, M., Richters, J., Rubio-Stipec, M., Moore, R. E., Chiang, P. H., Hoven, C., Canino, G., Fisher, P., & Gould, M. S. (1996). Global measures of impairment for epidemiologic and clinical use with children and adolescents. International Journal of Methods in Psychiatric Research, 6, 295–307.

    Google Scholar 

  • Bird, H., Canino, G., Rubio-Stipec, M., & Ribera, J. (1987). Further measures of the psychometric properties of the Children's Global Assessment Scale. Archives of General Psychiatry, 44, 821–825.

    PubMed  Google Scholar 

  • Bird, H., Canino, G., Rubio-Stipec, M., Gould, M. S., Ribera J., Sesman, M., Woodbury, M., Huertas-Goldman, S., Pagán, A., Sánchez-Lacay, A., & Moscoso, M. (1988). Estimates of the prevalence of childhood maladjustment in a community survey in Puerto Rico. Archives of General Psychiatry, 45, 1120–1126.

    PubMed  Google Scholar 

  • Bird, H., Davies, M., & Fisher, P. (in preparation). How specific is specific impairment?

  • Bird, H. R., Shaffer, D., Fisher, P., Gould, M. S., Staghezza, B., Chen, J. Y., & Hoven, C. (1993). The Columbia Impairment Scale (CIS): Pilot findings on a measure of global impairment for children and adolescents. International Journal of Methods and Psychiatric Research, 3, 167–176.

    Google Scholar 

  • Bird, H. R., Yager, T. J., Staghezza, B., Gould, M. S., Canino, G., & Rubio-Stipec, M. (1990). Impairment in the epidemiological measurement of childhood psychopathology in the community. Journal of the American Academy of Child and Adolescent Psychiatry, 29, 796–803.

    PubMed  Google Scholar 

  • Burns, B. J., Costello, E. J., Angold, A., Tweed, D., Stangl, D., Farmer, E. M. Z., & Erkanli, A. (1995). Children's mental health service use across service sectors. Health Affairs, 14, 147–159.

    PubMed  Google Scholar 

  • Canino, G., & Canino, I. (1982). Family therapy: A culturally syntonic approach for Hispanics. Hospital Community Psychiatry, 33, 299–303.

    PubMed  Google Scholar 

  • Chronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.

    PubMed  Google Scholar 

  • Cicchetti, D. V., Sparrow, S. S., & Carter, A. S. (1991). Development and validation of two Vineland adaptive behavior screening instruments. Paper presented at the annual American Psychological Association, San Francisco, CA.

  • Costello, E. J., Angold, A., Burns, B. J., Erkanli, A., Stangl, D. K., & Tweed, D. L. (1996). The Great Smoky Mountains Study of Youth: Functional impairment and severe emotional disturbance. Archives of General Psychiatry, 53, 1137–1143.

    PubMed  Google Scholar 

  • Costello, E. J., Messer, S. C., Bird, H. R., Cohen, P., & Reinherz, H. Z. (1999). Prevalence of Serious Emotional Disturbance: A reanalysis of community studies. Journal of Child and Family Studies, 7, 411–432.

    Google Scholar 

  • Costello, E. J., Angold, A., Burns, B. J., Erkanli, A., Stangl, D. K., & Tweed, D. L. (1996). The great smoky mountain study of youth: Functional impairment and severe emotional disturbance. Archives of General Psychiatry, 53, 1137–1143.

    PubMed  Google Scholar 

  • Endicott, J., Spitzer, R. L., Fleiss, J. L., & Cohen, J. (1976). The Global Assessment Scale (GAS). Archives of General Psychiatry, 33, 766–771.

    PubMed  Google Scholar 

  • Epstein, M. H., & Sharma, J. (1977). Behavioral and Emotional Rating Scale (BERS): A strength-based approach to assessment. Austin: PRO-ED.

    Google Scholar 

  • Federal Register. (1993, May 20) no. 58:29425, Substance Abuse and Mental Health Services Administration (notices).

  • Goodman, S. H., Hoven, C. W., Narrow, W. E., Cohen, P., Fielding, B., Alegria, M., Leaf, P. J., Kandel, D., Horowitz, S. M., Bravo, M., Moore, R., & Dulcan, M. K. (1998). Measurement of risk for mental disorders and competence in a psychiatric epidemiologic community survey: The NIMH methods for the epidemiology of child and adolescent mental disorders (MECA) study. International Journal of Methods in Psychiatric Research, 33, 162–173.

    Google Scholar 

  • Gulliksen, H. (1950). Intrinsic validity. American Psychologist, 5, 511–517.

    PubMed  Google Scholar 

  • Harwood, R. L., Miller, J. G., & Irizarry, N. (1995). Culture and attachment: Perceptions of the child in context. New York: Guilford.

    Google Scholar 

  • Hoagwood, K, Jensen, P., Petti, T., & Burns, B. (1996). Outcomes of mental health care for children and adolescents: I. A comprehensive conceptual model. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 1055–1063.

    PubMed  Google Scholar 

  • Hodges, K., McKnew, D., Cytryn, L., Ster, L., & Kline, J. (1982). The Child Assessment Schedule (CAS) Diagnostic Interview: A report on reliability and validity. Journal of the American Academy of Child and Adolescent Psychiatry, 21, 468–473.

    Google Scholar 

  • Hodges, K., & Wong, M. M. (1996). Psychometric characteristics of a multidimensional measure to assess impairment: The Child and Adolescent Functional Assessment Scale. Journal of Child and Family Studies, 4, 445–467.

    Google Scholar 

  • Hodges, K., & Wong, M. M. (1997). Use of the Child and Adolescent Functional Assessment Scale to predict service utilization and cost. Journal of Mental Health Administration, 24, 278–290.

    PubMed  Google Scholar 

  • Jenkins, J. G. (1946). Validity for what? Journal of Consulting Psychology, 10, 93–98.

    Google Scholar 

  • Jensen, P. D., & Hoagwood, K. (1997). The Book of Names: DSM-IV in Context? Development Psychopathology, 231–249.

  • John, K., Davis, G., Prusoff, B. A., & Warner, V. (1987). The Social Adjustment Inventory for Children and Adolescents (SAICA): Testing of a new semi-structured interview. Journal of the American Academy of Child and Adolescent Psychiatry, 26, 898–911.

    PubMed  Google Scholar 

  • Katsching, H. (1983). Methods for measuring social adjustment. In T. Helgason (Ed.), Methodology in evaluation of psychiatric treatment (pp 205–218). New York: Cambridge University Press.

    Google Scholar 

  • Lahey, B. B., Flagg, E. W., Bird, H. R., Schwab-Stone, M., Canino, G., Dulcan, M. K., Leaf, P. J., Davies, M., Brogan, D., Bourdon, K., Horwitz, S. M., Rubio-Stipec, M., Freeman, D. H., Lichtman, J., Shaffer, D., Goodman, S. H., Narrow, W. E., Weissman, M. M., Kandel, D. B., Jensen, P. S., Richters, J. E., & Regier, D. A. (1996). The NIMH methods for the epidemiology of child and adolescent mental disorder (MECA) study: Background and methodology. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 855–864.

    PubMed  Google Scholar 

  • Peak, H. (1953). Problems of Objective Observation. In L. Festinger & D. Katz (eds), Research methods in the behavioral sciences (pp 243–300). New York: Dryden.

    Google Scholar 

  • Shaffer, D., Gould, M. S., Brasic, J., Ambrosini, P. J., Fisher, P. W., Bird, H. R., & Aluwahlia, S. (1983). A Children's Global Assessment Scale (C-GAS). Archives of General Psychiatry, 40, 1228–1231.

    PubMed  Google Scholar 

  • Shaffer, D., Fisher, P., Dulcan, M., Davis, D., Piacentini, J., Schwab-Stone, M., Lahey, B., Bourdon, K., Jensen, P., Bird, H., Canino, G., & Regier, D. (1996). The NIMH Diagnostic Interview Schedule for Children Version 2.3 (DISC 2.3): Description, acceptability, prevalences, and performance in the MECA study. Journal of the American Academy of Child and Adolescent Psychiatry, 35, 865–877.

    PubMed  Google Scholar 

  • Sparrow, S. S., Balla, D. A., & Cicchetti, D. V. (1984). Vineland adaptive behavior scales: Interview edition-survey form manual. Circle Pines, MN: American Guidance Service.

    Google Scholar 

  • Spitzer, R, L., Fleiss, J. L., & Endicott, J. (1978). Problems of classification: Reliability and validity. In M. A. Lipton, A. DiMascio, & K. F. Killam (eds.) Psychopharmacology: A Generation of Progress. New York: Raven.

    Google Scholar 

  • Wallace, S., R. (1965). Criteria for what? American Psychologist. 16, 228–231.

    Google Scholar 

  • Williams, J. B. W. (1985a). The multiaxial system of DSM-III: Where did it come from and where should it go? I. Its origins and critiques. Archives General Psychiatry. 42, 75–180.

    Google Scholar 

  • Williams, J. B. W. (1985b). The multiaxial system of DSM-III: Where did it come from and where should it go? II. Empirical studies, innovations, and recommendations. Archives General Psychiatry. 42, 181–186.

    Google Scholar 

  • Wing, J. K., Bebbington, P., & Robins, L. N. (1981). What is a Case? London: Grant McIntyre, Ltd.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Canino, G., Costello, E.J. & Angold, A. Assessing Functional Impairment and Social Adaptation for Child Mental Health Services Research: A Review of Measures. Ment Health Serv Res 1, 93–108 (1999). https://doi.org/10.1023/A:1022334303731

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1022334303731

Navigation