ABSTRACT

Search engines have become faster and more accurate, even as the web has exploded in size. AI is now used to rank results, and Google uses BERT to understand search queries better. This chapter presents Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext. Google is designed to crawl and index the Web efficiently and produce much more satisfying search results than existing systems.” Search engines are also not good at responding to queries that require answers drawn from multiple sources. Language models today are also skewed toward English, which would leave non-English parts of the web underserved.