Theory and applications of the Delphi technique: A bibliography (1975–1994)

doi:10.1016/S0040-1625(96)00094-7

Technological Forecasting and Social Change

Volume 53, Issue 2, October 1996, Pages 185-211

https://doi.org/10.1016/S0040-1625(96)00094-7 Get rights and content

Abstract

Delphi is a popular, long-range, qualitative forecasting technique that has been extensively applied to a wide variety of problems in different domains. Since the method was conceived in the early 1950s at the Rand Corporation, different variations of Delphi have evolved in an effort to meet the unique forecasting needs of different decision makers. This bibliographic study surveys the literature on the methodology and applications of Delphi over a period of two decades (1975–1994). A total of 463 papers were identified out of which 254 papers treat Delphi as a primary subject while the remaining 209 papers treat Delphi as a secondary subject. The study concludes with a brief commentary on the Delphi technique that may be useful for researchers and practitioners in qualitative forecasting.

References (255)

L. Adams
Delphi Forecasting: Future Issues in Grievance Arbitration
Technological Forecasting and Social Change
(1980)
L. Albertson et al.
Delphi and the Image of the Future
Futures
(1976)
H. Azani et al.
Analytic Delphi Method (ADM): A Strategic Decision Making Model Applied to Location Planning
Engineering Costs and Production Economics
(1990)
G. Baldwin
The Delphi Technique and the Forecasting of Specific Fringe Benefits
Futures
(1982)
M.J. Bardecki
Participants Response to the Delphi Method: An Attitudinal Perspective
Technological Forecasting and Social Change
(1984)
M. Benarie
Delphi and Delphi-like Approaches with Special Regard to Environmental Standard Setting
Technological Forecasting and Social Change
(1988)
R. Bijl
Delphi in a Future Scenario Study on Mental Health and Mental Health Care
Futures
(1992)
W. Brockhaus et al.
An Analysis of Prior Delphi Applications and Some Observations on its Future Applicability
Technological Forecasting and Social Change
(1977)
J. Cesta
Speeding Solar Energy Commercialization: A Delphi Research of Marketplace Factors
Journal of Business Research
(1978)
W. Chaffin et al.
Individual Stability in Delphi Studies
Technological Forecasting and Social Change
(1980)

Y. Cho et al.

A Delphi Technology Forecasting Approach using a Semi-Markov Concept

Technological Forecasting and Social Change

(1991)

J. Coates

In Defense of Delphi: A Review of Delphi Assessment: Expert Opinion, Forecasting, and Group Process

Technological Forecasting and Social Change

(1975)

W.W. Cundiff

Interactive Software for the Capture, Management and Analysis of Data in Delphi Inquires: Defined Functions in APL

Technological Forecasting and Social Change

(1988)

J. Dajani et al.

Stability and Agreement Criteria for the Termination of Delphi Studies

Technological Forecasting and Social Change

(1979)

J. de Haan et al.

Technology: Toys or Tools? Results of a Dutch Delphi Study

Information and Management

(1993)

T. Dietz

Methods for Analyzing Data from Delphi Panels: Some Evidence from a Forecasting Study

Technological Forecasting and Social Change

(1987)

G.W. Fischer

When Oracles Fail—A Comparison of Four Procedures for Aggregating Subjective Probability Forecasts

Organizational Behavior and Human Performance

(1981)

D. Ford

Shang Inquiry as an Alternative to Delphi: Some Experimental Findings

Technological Forecasting and Social Change

(1975)

A. Fusfeld et al.

The Delphi Technique: Survey and Comment

Business Horizons

(1971)

V. Garde et al.

Technological Forecasting for Power Generation: A Study Using the Delphi Technique

Long Range Planning

(1985)

H. Green et al.

Application of the Delphi Technique in Tourism

Annals of Tourism Research

(1990)

S. Hakim et al.

The Delphi Process as a Tool for Decision Making: The Case of Vocational Training of People with Handicaps

Evaluation and Program Planning

(1993)

O. Helmer

Problems in Futures Research—Delphi and Causal Cross Impact Analysis

Futures

(1977)

K. Hill et al.

Methodological Worth of Delphi Forecasting Technique

Technological Forecasting and Social Change

(1975)

M. Abdallah et al.

Educational Planning for a Urologic Physician's Assistant Program by the Delphi Method

Journal of Allied Health

(1975)

R. Adams

Components of a Model Adolescent AIDS/Drug Prevention Program: A Delphi Study

Family Relations

(1992)

J. Ang

Generating Cash Flow Estimates: An Actual Study Using the Delphi Technique

Financial Management

(1979)

J. Annison

The Future Forms of Residential Services for Mentally Retarded People in Australia: A Delphi Study

Australian Journal of Developmental Disabilities

(1980)

Machine Vision: A Delphi Forecast to 1990

Engineering Digest

(1987)

Delphi Study on Industrial Automation Points to Needs, Stumbling Blocks

American Machinist and Automated Manufacturing

(1987)

M. Bardecki

Wetland Conservation Policies in Southern Ontario: A Delphi Approach

(1984)

S. Basu et al.

Incorporating Judgments in Sales Forecasts: Application of the Delphi Method at American Hoist and Derrick

Interfaces

(1977)

P.G. Benson et al.

Manufacturing Systems of the Future: A Delphi Study

Production and Inventory Management

(1982)

R. Best

An Experiment in Delphi Estimation in Marketing Decision Making

Journal of Marketing Research

(1974)

D. Bethea

Delphi Study Tracts Insurance Trends

National Underwriter

(1988)

G. Bolongaro

Delphi Technique Can Work for New Product Development

Marketing News

(1994)

S. Breiner et al.

Technology Foresight using a Delphi Approach: A Japanese-German Co-operation

R&D Management

(1994)

G.S. Brooks

Determining Priorities for Decision Making in Continuing Education in Two and Four Year Colleges in Georgia: A Modified Delphi Study

B. Brown et al.

The Delphi Method II: Structure of Experiment

(1975)

A. Buck et al.

Using the Delphi Process to Analyze Social Policy Implementation: A post hoc Case from Vocational Rehabilitation

Policy Sciences

(1993)

P. Buriak et al.

Mission, Initiatives, and Obstacles to Research in Agricultural Education: A National Delphi using External Decision-makers

Journal of Agricultural Education

(1989)

D. Butts

Priorities for Research in Science Education: A Delphi Study

Journal of Research in Science Teaching

(1978)

R. Carpenter

Emotional Disturbance/Behavioral Disorders and a Delphic Approach to the Future

Behavioral Disorders

(1985)

K. Cassino

Delphi Panel: A Practical ‘Crystal Ball’ for Researchers

Marketing News

(1984)

V. Cavalli-Sforza et al.

Delphi Forecasts of Land Use: Transportation Interactions

Journal of Transportation Engineering

(1984)

D. Chai

Future of Leisure: A Delphi Application

Research Quarterly

(1977)

T. Chambers

The Development of Criteria to Evaluate College Student Leadership Programs: A Delphi Approach

Journal of College Student Development

(1992)

S. Changnon et al.

Shifts in Perceptions of Climate Change: A Delphi Experiment Revisited

Bulletin of the American Meteorological Society

(1992)

Y. Chen et al.

Applications of the Delphi Method in China

Technological Forecasting and Social Change

(1990)

S. Cicarelli

The Future of Economics: A Delphi Study

Technological Forecasting and Social Change

(1984)

Cited by (390)

Gender gap and gender data gap in futures research: Focusing on the studies employing the Delphi technique
2024, Futures
The gender gap in futures research, rooted in male dominance, results in limited visibility of female futurists and neglect of women's issues. This study focuses on the gender data gap as an indicator of the existing gender gap in futures research and analyze the literature employing the Delphi technique—a widely employed research method in this field. When societal gender gaps influence data collection and utilization, a gender data gap arises, leading to underrepresentation of women's perspectives and experiences. The Delphi method, operates on the principle of expertise, may inadvertently exclude women experts whose expertise tends to be underrecognized. Our analysis, based on Temin and Roca (2016)’s definition of gender data, shows the gender data gap in the futures research literature. The gender gap in futures research, demonstrated by gender data gap, not only colonizes women's futures, but also impedes the potential for planning, social decision-making, and policies aimed at fostering a gender-equitable future. Futures research holds the potential to serve as a tool for decolonization. To achieve a future free of gender disparities, it’s imperative to address issues directly relevant to women but also crucial for humanity as the main challenges of futures research and ensure women’s participation.
Examining the association between healing environments and work performance
2024, Journal of Building Engineering
The sudden COVID-19 outbreak in 2020 has significantly affected global health security and socio-economic development. The healing environment (HE) concept has been proven to positively impact environmental, physical, and mental health. Within a post-epidemic era, people's expectations and demands for workplace environments have increased. Although HE is used in healthcare for therapeutic purposes, it is less commonly applied to general workplace environments. The present study investigates the association between the quality of HE and work performance. To construct evaluation criteria and weights for office environments, we employed the fuzzy delphi method (FDM) based on three design principles: natural/symbolic environments, built environments, and social environments. The individual work performance questionnaire (IWPQ) was used to assess employees' work performance in two different office settings. Finally, 60 university students were invited to evaluate their future workplace preferences for different HE office settings. The results indicate that greater healing office settings help people perform better, particularly in terms of task performance (TP) and contextual performance (CP). Counterproductive work behavior (CWB) indicates differences in the employees' educational levels. Additionally, university students prefer office settings with higher HE. The findings suggest that promoting HE can enhance psychological recovery, maintain employee job satisfaction and performance, and increase organizations' competitiveness.
Transformation to a renewable electricity system in Austria: Insights from an integrated model analysis
2024, Renewable Energy
We analyse the (techno- and macro-)economic and distributive effects of a transformation to a renewable electricity system in Austria by 2030, as stipulated by the Austrian government. For the analysis, the macroeconomic model DYNK and ATLANTIS, a partial model of the electricity market, were expanded and linked. Four transformation scenarios conforming with the 100% renewable electricity target in Austria on a national balance are examined, integrated into a consistent scenario for the development of the European electricity system. Additionally, sensitivity analyses with respect to the gas price are performed. Although all scenarios achieve 100% renewable electricity on a national balance, the analysis shows that electricity from gas-fired power plants will still be needed in 2030 to balance variable renewable generation, to avoid grid congestion, and for heat generation from combined heat and power plants in winter months. Another main conclusion from the simulations is that the transition towards a renewable electricity sector is almost neutral from a socio-economic perspective. It does neither reveal harmful impacts nor lead to high multiplier effects from additional investment. With high natural gas prices in the sensitivity scenarios a decrease in GDP and household income, which might motivate redistributive policies, can be observed.
Developing a novel energy-based approach for measuring mental workload
2024, Heliyon
Minimal research has been conducted to develop non-invasive processes for quantifying and evaluating worker mental workload - a critical concern - at the task level in the construction industry. One reason for this gap in research is the complex and dynamic nature of the construction process, which makes construction work more complicated to measure and predict compared to work in other industries. This paper presents a novel approach and corresponding conceptual model to quantify and evaluate construction worker perception of mental workload at the task level using the energy concept. A conceptual process for assessing mental workload (MWL), i.e., the feeling of stress, pressure, and being overwhelmed due to the task nature, factors, conditions, and resources that accompany the performance of the task, was developed from extant research and interviews. The Delphi method was utilized to characterize the energy-based model and provide initial verification. The results from the literature review, expert insight, and four rounds of the Delphi survey revealed 14 constituents, 51 components, and one metric for each component to measure the level of MWL felt by a worker. These constituents, components, and metrics were used to develop a model for measuring construction worker MWL. This study contributes to knowledge by developing a novel non-invasive method for assessing potential task-level MWL using an energy-based model. The energy-based assessment model contributes to practice by providing a tool that could be used to measure the potential impact of construction tasks on workers perceived mental workload.
Delphi-based visual scenarios: An innovative use of generative adversarial networks
2023, Futures
In the Futures Studies context, the Delphi-based scenario (DBS) is a valuable method for setting future-oriented strategies and actions by gathering expert opinions in multiple iterative rounds, in order to make better decisions in the present. However, one of the main challenges is to find a suitable representation of the scenarios both for evaluation and decision-making. The development of future scenarios requires high creativity and simple textual descriptions could not be enough to grab the attention of the experts and decision-makers, due to a probable lack of communication and/or technical language. Since the textual descriptions concern the future, the human mind may have difficulty imagining events that have not already happened. With the spread of AI models, different implementations can support the DBS process, such as the use of Generative Adversarial Networks (GANs) to generate specific images starting from the narratives of the scenarios. In this paper, we propose a new method for the development of Delphi-based Visual Scenarios (DBVS) adopting GANs, with the aim to support the experts and decision-makers in planning and communication, in order to have immediate images of what the future could be like. We apply this method with regard to the future of Italian families.
How to identify and interpret weak signals of change in the forest bioeconomy
2023, Forest Policy and Economics
Weak signals, the first signs of a potentially emerging issue that could disrupt current trends and megatrends, are hidden among disconnected pieces of information. Analyzing weak signals can help decision makers generate preparedness and a rapid-response capacity for possible systemic changes in the forest bioeconomy, where weak signals have not been studied extensively. This exploratory study sought to understand how to identify and interpret weak signals of change that may have an impact on the forest bioeconomy. An international panel of experts in the forest bioeconomy and in foresight provided their views through a two-stage Real-Time Delphi method which utilized the multiple rounds of traditional Delphi and the instantaneous feedback of the Real-Time Delphi method. This study introduces four conceptual frameworks to use when searching for weak signals: Internal/external operating environment, the Multi-level perspective, the Three Horizons Framework, and Complexity theory. These conceptual frameworks were applied in the analysis of collected data with the aim of developing the theory and practice on how to identify and interpret weak signals. According to the results, observations beyond the traditional dominating operating environment and a combination of observations from various sources could help to identify weak signals that may affect the forest bioeconomy. The Real-Time Delphi insights suggest that weak signal analysis becomes stronger via collaboration and interaction between futures specialists and forest bioeconomy experts.

View all citing articles on Scopus

View full text

Theory and applications of the Delphi technique: A bibliography (1975–1994)

Abstract

Technological Forecasting and Social Change

Futures

Engineering Costs and Production Economics

Futures

Technological Forecasting and Social Change

Technological Forecasting and Social Change

Futures

Technological Forecasting and Social Change

Journal of Business Research

Technological Forecasting and Social Change

Technological Forecasting and Social Change

Technological Forecasting and Social Change

Technological Forecasting and Social Change

Technological Forecasting and Social Change

Information and Management

Technological Forecasting and Social Change

Organizational Behavior and Human Performance

Technological Forecasting and Social Change

Business Horizons

Long Range Planning

Annals of Tourism Research

Evaluation and Program Planning

Futures

Technological Forecasting and Social Change

Educational Planning for a Urologic Physician's Assistant Program by the Delphi Method

Journal of Allied Health

Components of a Model Adolescent AIDS/Drug Prevention Program: A Delphi Study

Family Relations

Generating Cash Flow Estimates: An Actual Study Using the Delphi Technique

Financial Management

The Future Forms of Residential Services for Mentally Retarded People in Australia: A Delphi Study

Australian Journal of Developmental Disabilities

Machine Vision: A Delphi Forecast to 1990

Engineering Digest

Delphi Study on Industrial Automation Points to Needs, Stumbling Blocks

American Machinist and Automated Manufacturing

Wetland Conservation Policies in Southern Ontario: A Delphi Approach

Incorporating Judgments in Sales Forecasts: Application of the Delphi Method at American Hoist and Derrick

Interfaces

Manufacturing Systems of the Future: A Delphi Study

Production and Inventory Management

An Experiment in Delphi Estimation in Marketing Decision Making

Journal of Marketing Research

Delphi Study Tracts Insurance Trends

National Underwriter

Delphi Technique Can Work for New Product Development

Marketing News

Technology Foresight using a Delphi Approach: A Japanese-German Co-operation

R&D Management

Determining Priorities for Decision Making in Continuing Education in Two and Four Year Colleges in Georgia: A Modified Delphi Study

The Delphi Method II: Structure of Experiment

Using the Delphi Process to Analyze Social Policy Implementation: A post hoc Case from Vocational Rehabilitation

Policy Sciences

Mission, Initiatives, and Obstacles to Research in Agricultural Education: A National Delphi using External Decision-makers

Journal of Agricultural Education

Priorities for Research in Science Education: A Delphi Study

Journal of Research in Science Teaching

Emotional Disturbance/Behavioral Disorders and a Delphic Approach to the Future

Behavioral Disorders

Delphi Panel: A Practical ‘Crystal Ball’ for Researchers

Marketing News

Delphi Forecasts of Land Use: Transportation Interactions

Journal of Transportation Engineering

Future of Leisure: A Delphi Application

Research Quarterly

The Development of Criteria to Evaluate College Student Leadership Programs: A Delphi Approach

Journal of College Student Development

Shifts in Perceptions of Climate Change: A Delphi Experiment Revisited

Bulletin of the American Meteorological Society

Applications of the Delphi Method in China

Technological Forecasting and Social Change

The Future of Economics: A Delphi Study

Technological Forecasting and Social Change