Awad E., Levine S., Anderson M., Anderson SL., Conitzer V., Crockett MJ., Everett JAC., Evgeniou T., Gopnik A., Jamison JC., Kim TW., Liao SM., Meyer MN., Mikhail J., Opoku-Agyemang K., Borg JS., Schroeder J., Sinnott-Armstrong W., Slavkovik M., Tenenbaum JB.
Technological advances are enabling roles for machines that present novel ethical challenges. The study of 'AI ethics' has emerged to confront these challenges, and connects perspectives from philosophy, computer science, law, and economics. Less represented in these interdisciplinary efforts is the perspective of cognitive science. We propose a framework - computational ethics - that specifies how the ethical challenges of AI can be partially addressed by incorporating the study of human moral decision-making. The driver of this framework is a computational version of reflective equilibrium (RE), an approach that seeks coherence between considered judgments and governing principles. The framework has two goals: (i) to inform the engineering of ethical AI systems, and (ii) to characterize human moral judgment and decision-making in computational terms. Working jointly towards these two goals will create the opportunity to integrate diverse research questions, bring together multiple academic communities, uncover new interdisciplinary research topics, and shed light on centuries-old philosophical questions.