ABSTRACT

This chapter provides a framework for understanding bias in computer systems. From an analysis of actual computer systems, the chapter presents three categories: preexisting bias, technical bias, and emergent bias. Preexisting bias has its roots in social institutions, practices, and attitudes. Technical bias arises from technical constraints or considerations. Emergent bias arises in a context of use. Critics also have been concerned with two other problems. One is that the interface design compounds the bias in the reservation systems. A second problem arises from the travelers' perspective. When computer systems embody biases that exist independently, and usually prior to the creation of the system, then we say that the system embodies preexisting bias. Preexisting biases may originate in society at large, in subcultures, and in formal or informal, private or public organizations and institutions.