Combatting automation bias

INTRODUCTION

Artificial Intelligence and Algorithmic Systems continue to proliferate. Enamored of efficiency, statistics, and sheer power of processing, corporations, designers, developers, and now end users (ChatGpt) continues at a breakneck pace to deploy these systems into increasing human tasks and the result is that their impact on individuals is increasing. As these tools proliferate, the need is rising to combat Automation Bias (defined as “occurring when a human decision maker disregards or does not search for contradictory information in light of a computer-generated solution which is accepted as correct”), especially as the users of these systems are increasingly amateur operators who are oblivious to the risks, inaccuracy, and unintended consequences associated with these tools. Left unchecked and without robust mitigations, the AI hype train increases Automation Bias and endangers three inherently precious human values: redemption, forgiveness, and the right/ability to change.

Scroll to Top