Please use this identifier to cite or link to this item:
Main Title: Matters of Ethics, Trust, and Potential Liability for Autonomous Systems
Author(s): Brill, J. Christopher
Bliss, James P.
Hancock, Peter A.
Manzey, Dietrich
Meyer, Joachim
Vredenburgh, Alison
Type: Article
Language Code: en
Abstract: The objective of this panel was to discuss issues related to the development and use of autonomous systems, with specific focus on the overriding themes of ethical considerations and potential liability for Human Factors and Ergonomics (HF/E) professionals who are involved in their development. Chris Brill provided opening remarks to frame the discussion and introduce the panelists. James Bliss discussed legal implications related to our collective penchant for developing conservative, false-alarm prone automation. Peter Hancock advocated for human-centered constraints on autonomous systems, as they may, one day, pose an existential threat to humanity. Dietrich Manzey discussed ethical considerations for autonomous systems, including how design can encourage ethical user behavior. Joachim Meyer argued that HF/E professionals have an obligation to help designers understand the ethical implications of poor design, particularly in the context of autonomous systems. Lastly, Alison Vredenburgh provided thoughts on potential liability for HF/E professionals, particularly in light of the relative newness of autonomous systems. The panel then turned to facilitated discussion with panelists and audience members. Specific themes included the boundaries of our responsibilities as HF/E professionals for ill-conceived or morally-objectionable systems, potential implications of manipulating user trust through design, cross-cultural perspectives on public acceptance and legal peril, and how concerns might differ by domain (e.g., medical vs. combat vs. manufacturing). The session concluded with panelists summarizing how ethics influence design and recommendations for how HF/E professionals can potentially protect themselves from legal liability for mishaps involving autonomous systems they helped develop.
Issue Date: 2016
Date Available: 8-Jan-2019
DDC Class: 610 Medizin und Gesundheit
Subject(s): autonomous system
Human Factors and Ergonomics
Journal Title: Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Publisher: SAGE Publications
Publisher Place: Washington, DC
Volume: 60
Issue: 1
Publisher DOI: 10.1177/1541931213601070
Page Start: 308
Page End: 312
EISSN: 1541-9312
ISSN: 1071-1813
Notes: Dieser Beitrag ist mit Zustimmung des Rechteinhabers aufgrund einer (DFG geförderten) Allianz- bzw. Nationallizenz frei zugänglich.
This publication is with permission of the rights owner freely accessible due to an Alliance licence and a national licence (funded by the DFG, German Research Foundation) respectively.
Appears in Collections:FG Arbeits-, Ingenieur- und Organisationspsychologie » Publications

Files in This Item:
File Description SizeFormat 
Brill_et_al_2016.pdf961.8 kBAdobe PDFThumbnail

Items in DepositOnce are protected by copyright, with all rights reserved, unless otherwise indicated.