Data Profiling over Big Data Area: A Survey of Big Data Profiling: State-of-the-Art, Use Cases and Challenges
Author : Bahaa Eddine Elbaghazaoui, Mohamed Amnai & Abdellatif Semmouri Volume: volume 1344 issue: Advances in Intelligent Systems and Computing Year: 2021 Views : 344
Abstract:
Before consuming datasets for any application, we need to understand the dataset at hand and its metadata. Discovering metadata process known as data profiling. Data profiling focus on examining the data sets and collecting metadata such as statistics or informative summaries about that data. In this chapter, we will discuss the importance of data profiling and shed light on the area of data profiling in big data. In addition, we will detail data profiling use cases and reviewing the state-of-the-art data profiling systems and techniques. Finally, we conclude with directions and challenges for future research in the area of data profiling.
