ABSTRACT

Defining the principles that advanced AI systems should follow is no trivial task. There are many plausible candidates, such as complying with users' preferences, following the law, or doing what is ethical. While each of these proposals has its attractions, they all face limitations as well, and may come into conflict with each other. This chapter explores these questions and considers what it would mean to design an AI system that promotes the wellbeing of users and of society as a whole. It also discusses how AI systems should deal with situations where there is uncertainty about the right course of action.