ABSTRACT

In this chapter, the authors introduce structured data and unstructured data as well as, how can they process these data, particularly in real-time, given the amount and size of provided at big data volume. Data processing by super artificial intelligence (SAI) within Real-Time or sub-second interval processing is where man and machine connect with each other, and work side-by-side of each other even though the man is the creator of such intelligent SAI. Of course, if it was possible or feasible to instantly transform unstructured data to structured data, then creating intelligence from unstructured data would be easy. Harvesting a platform that provides a robust solution for collecting both structured and unstructured data from the Internet, we need to take a unique approach to “connecting” those unconnected strands of information through the use of metadata. The need for big data velocity imposes unique demands on the underlying compute infrastructure.