Download full text
(222.2Kb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://doi.org/10.34669/wi.cp/5.6
Exports for your reference manager
The Problem of the Automation Bias in the Public Sector: A Legal Perspective
[conference paper]
This document is a part of the following document:
Proceedings of the Weizenbaum Conference 2023: AI, Big Data, Social Media, and People on the Move
Corporate Editor
Weizenbaum Institute for the Networked Society - The German Internet Institute
Abstract The automation bias describes the phenomenon, proven in behavioural psychology, that people place excessive trust in the decision suggestions of machines. The law currently sees a dichotomy - and covers only fully automated decisions, and not those involving human decision makers at any stage of the... view more
The automation bias describes the phenomenon, proven in behavioural psychology, that people place excessive trust in the decision suggestions of machines. The law currently sees a dichotomy - and covers only fully automated decisions, and not those involving human decision makers at any stage of the process. However, the widespread use of such systems, for example to inform decisions in education or benefits administration, creates a leverage effect and increases the number of people affected. Particularly in environments where people routinely have to make a large number of similar decisions, the risk of automation bias increases. As an example, automated decisions providing suggestions for job placements illustrate the particular challenges of decision support systems in the public sector. So far, the risks have not been sufficiently addressed in legislation, as the analysis of the GDPR and the draft Artificial Intelligence Act show. I argue for the need for regulation and present initial approaches.... view less
Keywords
discrimination; labor market; data protection; artificial intelligence; algorithm; decision making
Classification
Technology Assessment
Law
Free Keywords
AI bias; GDPR
Collection Title
Proceedings of the Weizenbaum Conference 2023: AI, Big Data, Social Media, and People on the Move
Conference
5. Weizenbaum Conference "AI, Big Data, Social Media, and People on the Move". Berlin, 2023
Document language
English
Publication Year
2023
City
Berlin
Page/Pages
p. 1-11
Status
Primary Publication; peer reviewed