Elsevier

Evaluation and Program Planning

Volume 18, Issue 4, October–December 1995, Pages 333-341
Evaluation and Program Planning

Article of general interest
Open systems evaluation and the logic model: Program planning and evaluation tools

https://doi.org/10.1016/0149-7189(95)00034-8Get rights and content

Abstract

This paper describes two case management projects and efforts to evaluate outcomes. Lessons learned from the first effort suggest that a tool referred to as the logic model and a particular approach to evaluation called the “open systems” model might be useful to planners and program evaluators. The logic model provides a means of presenting conditions a program is intended to address, activities that constitute a program, short term outcomes resulting from program activities and long term impacts. The open systems perspective emphasizes evaluation as a tool to be used to achieve program objectives as opposed to establishing cause and effect relationships. This paper also describes how the logic model and open systems evaluation were used to facilitate the development of an evaluation plan for a project designed to assist homeless, substance abusing, pregnant women.

References (17)

  • D.A. Julian et al.

    A strategic planning model for human services: Problem solving at the local level

    Evaluation and Program Planning

    (1992)
  • E. Alexander

    Planning theory

  • M. Berry

    An evaluation of family preservation services: Fitting agency services to family needs

    Social Work

    (1992)
  • W. Broughton

    Qualitative methods in program evaluation

    American Journal of Health Promotion

    (1991)
  • A.Y. Cohen et al.

    The basics of open systems evaluation: A resource paper

    (1993)
  • E. Guba et al.

    Effective evaluation: Improving the usefulness of evaluation results through responsive and naturalistic approaches

    (1981)
  • S.D. Hoffman

    Dependency and welfare review: An empirical review

    (1987)
  • K.L. Kumpfer et al.

    Measurements in prevention

    (1993)
There are more references available in the full text version of this article.

Cited by (63)

  • Evaluating impact from research: A methodological framework

    2021, Research Policy
    Citation Excerpt :

    Although they tend to be used ex-ante to plan for impacts, they can also be used in evaluation to compare actual impacts to those that were planned. A logic model (also, called logical framework, Julian et al., 1995) or Theory of Change (Stachowiak, 2013) is typically developed at the start of a research project, working back from the ultimate benefits (in the case of a Theory of Change) or working forwards from impact goals (in the case of a logic model). It consists of mapping out the steps that would be necessary to move from the planned research activities, to the generation of research outputs, intermediate outcomes, short-term impacts and the ultimate benefits that are sought (Alvarez et al., 2010).

  • A utilisation focussed and viable systems approach for evaluating technology supported learning

    2017, European Journal of Operational Research
    Citation Excerpt :

    It has therefore been slightly simplified for reproduction in the more restricted format of this paper. Attempt was made to address some of the criticisms of traditional linear models by including elements to describe its coupling with its wider environment (Hummelbrunner, 2011; Julian, Jones, & Deyo, 1995). This was in terms of the outcomes and factors outside the team's direct control that might be influence direction and success (Funnell & Rogers, 2011).

  • Evaluating midwifery-led antenatal care: Using a programme logic model to identify relevant outcomes

    2014, Midwifery
    Citation Excerpt :

    This would need to be considered in the evaluation, for example in conducting sub-group analysis to compare outcomes between individual midwives' clinics. The process of developing the programme logic model was deliberatively inclusive, the importance of which is highlighted in the literature (Julian et al., 1995; Afifi et al., 2011), particularly in relation to building consensus and a common understanding amongst key stakeholders (Julian et al., 1995). Stakeholders were sought to bring different perspectives on programme goals, activities and outcomes.

  • Enterprise policy evaluation: Is there a 'new' way of doing it?

    2011, Evaluation and Program Planning
    Citation Excerpt :

    Their paper addresses Hart's (2007) criticism that existing evaluation methodologies do not indicate to policymakers the causal mechanisms leading from intervention to economic impact. Lynch et al. (2009) demonstrate that the logic model framework has the potential to help policymakers consider linkages between problems/conditions, activities, outcomes and impacts of a programme (Julian, Jones & Devo, 1995). As Wren (2007) outlines, well-constructed logic models recognise external effects occurring elsewhere in input and output markets; linkage effects; feedback long-run impacts in direct markets; and multiplier effects.

View all citing articles on Scopus

Work on this project was partially supported by grant number 1-HS4-T100573-01 from the Center for Substance Abuse Treatment, Department of Health and Human Services.

View full text