ABSTRACT

The purpose of the Market Basket Extract, Transform, and Load (ETL) application is specifically to populate a Market Basket BI Table. The first requirement of the Market Basket ETL is to extract data from the data warehouse and load that data in the Market Basket BI Table. The Market Basket ETL application that extracts data from the data warehouse must be able to control the data such that each set of data and each row of data are allowed to pass through to the Market Basket Table only once. Metadata comes in two forms: Static Metadata and Dynamic Metadata. Static Metadata is the descriptions and definitions of the structures of the data warehouse and the processes of the ETL application. Data quality is assessed by one of two methods: looking for something that should be there, or looking for something that should not be there.