Publications
What is wrong with evidence based policy, and how can it be improved? Journal Article
Saltelli, Andrea; Giampietro, Mario
In: Futures, 91 , pp. 62–71, 2017, ISSN: 00163287.
Abstract | Links | BibTeX | Tags: Evidence based policy, PNS, Post-normal science, Quantitative story telling, Science and technology studies, Science for governance, STS
@article{Saltelli2017,
title = {What is wrong with evidence based policy, and how can it be improved?},
author = {Andrea Saltelli and Mario Giampietro},
url = {https://linkinghub.elsevier.com/retrieve/pii/S0016328717300472},
doi = {10.1016/j.futures.2016.11.012},
issn = {00163287},
year = {2017},
date = {2017-08-01},
journal = {Futures},
volume = {91},
pages = {62--71},
abstract = {textcopyright 2017 The Authors The present crisis of science's governance, affecting science's reproducibility, scientific peer review and science's integrity, offers a chance to reconsider evidence based policy as it is being practiced at present. Current evidence based policy exercises entail forms of quantification \textendash often in the form of risk analysis or cost benefit analyses \textendash which aim to optimize one among a set of policy options corresponding to a generally single framing of the issue under consideration. More cogently the deepening of the analysis corresponding to a single view of what the problem is has the effect of distracting from what could be alternative readings. When using evidence based policy those alternative frames become a kind of ‘uncomfortable knowledge' which is de facto removed from the policy discourse. All the more so when the analysis is supported by extensive mathematical modelling. Thus evidence based policy may result in a dramatic simplification of the available perceptions, in flawed policy prescriptions and in the neglect of other relevant world views of legitimate stakeholders. This use of scientific method ultimately generates \textendash rather than resolving \textendash controversies and erodes the institutional trust of the involved actors. We suggest an alternative approach \textendash which we term quantitative story-telling \textendash which encourages a major effort in the pre-analytic, pre-quantitative phase of the analysis as to map a socially robust universe of possible frames, which represent different lenses through which to perceive what the problem is. This is followed by an analysis where the emphasis in not on confirmatory checks or system optimization but \textendash the opposite \textendash on an attempt to refute the frames if these violate constraints of feasibility (compatibility with processes outside human control); viability (compatibility with processes under human control), and desirability (compatibility with a plurality of normative considerations relevant to the system's actors).},
keywords = {Evidence based policy, PNS, Post-normal science, Quantitative story telling, Science and technology studies, Science for governance, STS},
pubstate = {published},
tppubtype = {article}
}
textcopyright 2017 The Authors The present crisis of science's governance, affecting science's reproducibility, scientific peer review and science's integrity, offers a chance to reconsider evidence based policy as it is being practiced at present. Current evidence based policy exercises entail forms of quantification – often in the form of risk analysis or cost benefit analyses – which aim to optimize one among a set of policy options corresponding to a generally single framing of the issue under consideration. More cogently the deepening of the analysis corresponding to a single view of what the problem is has the effect of distracting from what could be alternative readings. When using evidence based policy those alternative frames become a kind of ‘uncomfortable knowledge' which is de facto removed from the policy discourse. All the more so when the analysis is supported by extensive mathematical modelling. Thus evidence based policy may result in a dramatic simplification of the available perceptions, in flawed policy prescriptions and in the neglect of other relevant world views of legitimate stakeholders. This use of scientific method ultimately generates – rather than resolving – controversies and erodes the institutional trust of the involved actors. We suggest an alternative approach – which we term quantitative story-telling – which encourages a major effort in the pre-analytic, pre-quantitative phase of the analysis as to map a socially robust universe of possible frames, which represent different lenses through which to perceive what the problem is. This is followed by an analysis where the emphasis in not on confirmatory checks or system optimization but – the opposite – on an attempt to refute the frames if these violate constraints of feasibility (compatibility with processes outside human control); viability (compatibility with processes under human control), and desirability (compatibility with a plurality of normative considerations relevant to the system's actors).
AGAUR Grant ID 2017 SGR 230 / Copyright © 2023