Participation of marginalized groups in evaluation: Mission impossible?
Section snippets
Participation of ‘marginalized groups’ in evaluation
The participation and ownership of multiple stakeholders in evaluation is increasingly being promoted (Cousins and Whitmore, 1998, King, 2007). Involving multiple stakeholders, including those with ‘marginalized’ or ‘silenced’ voices, is a challenging task for evaluators due to unequal power relationships (Abma, 2001, French and Swain, 1997, Koch, 2000, McDonald, 2008, Mertens, 1995, Mertens et al., 1994, VanderPlaat, 1999, Widdershoven, 2001) and the risk of conflict (Markiewicz, 2005, Owen,
Background and goals
We were asked by a residential care and nursing home organization in the south of the Netherlands to evaluate how the participation of client councils in policy processes was experienced, and how it could be improved. Our evaluation thus aimed to bring forth recommendations for practical improvement of the participation of client councils in decision-making processes. However, it rapidly emerged that the client councils felt that they were not taken seriously by managers. The empowerment of the
Case example: stakeholder issues and learning processes
In this section we describe the main stakeholder issues that arose. The frustrations between managers and client councils can be understood by examining the underlying divergence of value stances among these stakeholders concerning their practices (Abma, 2000a, Abma, 2000b, Greene, 2001, Schwandt, 2008). In responsive evaluation, these underlying values and tensions are brought to light through the dialogical process. Only then can differences be recast as vehicles for learning.
Discussion and conclusions
This project provides insights into how the participation of client councils in residential care and nursing homes might be improved. We can conclude that there is more to the participatory practice of client councils than just having a say and negotiating. Rather, the participation of client councils is a dynamic process. Room should be given to hermeneutic dialogue as well as horizontal and deliberative communication. Further, abstract policy issues do not invite client councils and managers
Lessons learned
Like the stakeholders, responsive evaluators are part of the social learning process as well (Abma and Widdershoven, 2008, Wadsworth, 2001). In carrying out our project, we learned some lessons that we feel may be valuable to others involved in responsive evaluation and the participation of marginalized groups. Responsive evaluation is generally an intensive and time-consuming evaluation methodology. However, we conducted our evaluation in just six months, indicating that it is actually
Acknowledgements
First of all, we would like to acknowledge all the people involved in this research project for their openness and trust. We would also like to thank the organization for supporting this work in financial and practical terms. An earlier version of this paper was presented at the EES Conference in Lisbon in October 2008. We would like to thank Jennifer Greene and Thomas Schwandt from the University of Illinois, USA, for their useful comments and profound feedback on that earlier version of this
Vivianne E. Baur, MA, is PhD student in the Department of Medical Humanities of the EMGO Institute for Health and Care Research, VU University Medical Center, The Netherlands. Her research projects focus on improving the participation of older people in policy processes within the setting of residential elderly care.
References (54)
Stakeholder conflict: A case study
Evaluation and Program Planning
(2000)Responding to ambiguity, responding to change the value of a responsive approach to evaluation
Evaluation and Program Planning
(2000)Responsive evaluation: Its meaning and special contribution to health promotion
Evaluation and Program Planning
(2005)- et al.
Reflections on the use of narrative in evaluation
American Journal of Evaluation
(2003) - et al.
Changing disability research: Participatory and emancipatory research with disabled people
Physiotherapy
(1997) Evaluation as advocacy
American Journal of Evaluation
(1997)Evaluation extrapolations
American Journal of Evaluation
(2001)Revisiting a theory of negotiation: The utility of Markiewicz (2005) proposed six principles
Evaluation and Program Planning
(2008)- et al.
Diverse voices in evaluation practice: Feminists, minorities, and persons with disabilities
Evaluation Practice
(1994) Sharing power, facing ambiguity
Opening thoughts
Evaluation
Learning by telling: Storytelling workshops as an organizational learning intervention
Management Learning
The practice and politics of responsive evaluation
American Journal of Evaluation
Social relations of evaluation
Situated learning in communities of practice: Evaluation of coercion in psychiatry as a case
Evaluation
Zeggenschap in wetenschap. Patiëntenparticipatie in theorie en praktijk
Patients as partners in responsive research: Methodological notions for collaborations in mixed research teams
Qualitative Health Research
Stake's responsive evaluation: Core ideas and evolution
Sharing stories: Narrative and dialogue in responsive nursing evaluation
Evaluation and the Health Professions
Responsieve methodologie: Interactief onderzoek in de praktijk
Evaluation and/as social relation
Evaluation
Dialogical nursing ethics: The quality of freedom restrictions
Nursing Ethics
A ladder of citizen participation
Journal of the American Institute of Planners
Patient participation in decision making on biomedical research: Changing the network
Science, Technology and Human Values
Framing participatory evaluation
Beyond tokenistic involvement of older people in research—A framework for future development and understanding
International Journal of Older People Nursing in Association with Journal of Clinical Nursing
Why can’t more people have a say? Learning to work with older people
Ageing and Society
Cited by (44)
Pragmatic trials in long-term care: Challenges, opportunities, recommendations
2022, Geriatric NursingPragmatic Trials in Long-Term Care: Implementation and Dissemination Challenges and Opportunities
2022, Journal of the American Medical Directors AssociationCommunity participation in general health initiatives in high and upper-middle income countries: A systematic review exploring the nature of participation, use of theories, contextual drivers and power relations in community participation
2018, Social Science and MedicineCitation Excerpt :It is apparent that the public health interventions described in these papers borrowed from general community participation principles and approaches in guiding their initiatives, for instance through the use of deliberative approaches to community engagement (Gregory et al., 2008) and public consultation design principles (Abelson et al., 2004). One study described the use of a participatory evaluation approach to assess client councils in policy processes focusing on the value of hermeneutic dialogue in addressing challenges of working with parties in unequal relationships (Baur et al., 2010). Table 1 presents a list of the papers and a description of the theory, framework or underlying approach used.
MOVING BEYOND POSITIVISM: Integrating Transformative Perspectives in Health Professions Education and Evaluation
2023, Assessment, Evaluation, and Accountability in Adult EducationPragmatic Trials in Long-Term Care: Implementation and Dissemination Challenges and Opportunities
2022, Journal of the American Geriatrics Society
Vivianne E. Baur, MA, is PhD student in the Department of Medical Humanities of the EMGO Institute for Health and Care Research, VU University Medical Center, The Netherlands. Her research projects focus on improving the participation of older people in policy processes within the setting of residential elderly care.
Tineke A. Abma, PhD, is an associate professor and research coordinator of the research program Autonomy and Participation in Chronic Care, Department of Medical Humanities of the EMGO Institute for Health and Care Research, VU University Medical Center, The Netherlands.
Guy A.M. Widdershoven, PhD, is a professor of medical philosophy and ethics and Head of the Department of Medical Humanities of the EMGO Institute for Health and Care Research, VU University Medical Center, The Netherlands.