Risk-Based Decision-Making Fallacies: Why Present Functional Safety Standards are Not Enough

Andreas Johnsen, Gordana Dodig Crnkovic, Kristina Lundqvist, Kaj Hanninen, Paul Pettersson
<span title="">2017</span> <i title="IEEE"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/l3ginrxcajdlti2wyxqwgkjkea" style="color: black;">2017 IEEE International Conference on Software Architecture Workshops (ICSAW)</a> </i> &nbsp;
Functional safety of a system is the part of its overall safety, understood as freedom from unacceptable/unreasonable risks that depends on a system operating correctly in response to its inputs. Functional safety elements are examined at every stage of the software development life cycle, including requirement specification, design, implementation, verification, validation and deployment. Acceptability of risks is judged within a framework of analysis with contextual and cultural aspects by
more &raquo; ... ividuals who may introduce subjectivity and misconceptions in the assessment. While functional safety standards elaborate much on the avoidance of unreasonable risk, little is addressed on the issue of avoiding unreasonable judgments of risk. Through the studies of common fallacies in risk perception and ethics, we present a moral-psychological analysis of functional safety standards and propose plausible improvements of the involved risk-related decision making processes, with a focus on the notion of an acceptable residual risk. As a functional safety reference model, we use the functional safety standard ISO 26262, addressing potential hazards caused by malfunctions of hardware and software systems within road vehicles, and defines safety measures that are required to achieve an acceptable level of safety. Analysis points out the critical importance of a robust safety culture with developed countermeasures to the common fallacies in risk perception, which are not addressed by contemporary functional safety standards. We argue that functional safety standards should be complemented with the analysis of potential hazards caused by fallacies in risk perception, their countermeasures, and the requirement that residual risks must be explicated, motivated, and accompanied by a plan for their continuous reduction. This approach becomes especially important in contemporary developed autonomous vehicles with increasing computational applications. I.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/icsaw.2017.50">doi:10.1109/icsaw.2017.50</a> <a target="_blank" rel="external noopener" href="https://dblp.org/rec/conf/icsa/JohnsenCLHP17.html">dblp:conf/icsa/JohnsenCLHP17</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/tgy42tjtf5gjtjrd4jbllxruya">fatcat:tgy42tjtf5gjtjrd4jbllxruya</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20200319075140/http://publications.lib.chalmers.se/records/fulltext/253206/local_253206.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] <div class="menu fulltext-thumbnail"> <img src="https://blobs.fatcat.wiki/thumbnail/pdf/b5/f3/b5f374ef4adc3ee5930f596a7790847cae3cf501.180px.jpg" alt="fulltext thumbnail" loading="lazy"> </div> </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/icsaw.2017.50"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> ieee.com </button> </a>