ABSTRACT

Automation has been key to Amazon's e-commerce dominance, be it inside warehouses or driving pricing decisions. The company's experimental hiring tool used artificial intelligence to give job candidates scores ranging from one to five stars - much like shoppers rate products on Amazon. In effect, Amazon's system taught itself that male candidates were preferable. It penalized resumes that included the word “women's,” as in “women's chess club captain.” And it downgraded graduates of two all-women's colleges, according to people familiar with the matter. Amazon's experiment began at a pivotal moment for the world's largest online retailer. Machine learning was gaining traction in the technology world. The American civil liberties union is currently challenging a law that allows criminal prosecution of researchers and journalists who test hiring websites' algorithms for discrimination.