ABSTRACT
With the rapid development of information and communication technology, the amount of global data is increasing explosively. With the continuous progress of computer storage level, network transmission capacity, and computer computing performance, people increasingly find that data is an important economic asset for human development. Effective data analysis and mining will promote the efficient and sustainable development of national enterprises and even the whole society. From the research and application of big data technology in various countries, its influence is no less than the previous two informatisation waves. Therefore, many people think that we are in the era of promoting the third informatisation wave with big data technology. According to Gerstner, the former CEO of IBM, the IT field will usher in a major change every 15 years. Around 1980, personal computers began to popularise, making computers enter enterprises and households, greatly improving social productivity and ushering in the first wave of information technology. Intel, IBM, Apple, Microsoft, Lenovo, and other enterprises are the signs of this period. Then, around 1995, human beings began to enter the Internet era in an all-round way. The popularity of the Internet turned the world into a ‘global village’, and everyone could freely roam in the ocean of information. As a result, mankind ushered in the second wave of informatisation, which also created Internet giants such as Yahoo, Google, Alibaba, and Baidu. After 15 years, around 2010, the rapid development of cloud computing, big data, and the Internet of Things has opened the curtain of the third wave of informatisation. The era of big data has come, and several new market benchmark enterprises will emerge. This chapter will introduce the concept and development process of big data, analyse the historical inevitability of the advent of the big data era, introduce some technologies currently used in big data, and finally analyse some problems existing in big data technology.
