Chapter 9.9, Problem 9.3ARQ

Explanation of Solution

Need and Functions of Data Warehouses:

Data Warehouse:

A Data Warehouse is an architecture that is used to gather and collect all the non volatile, subject oriented and integrated data using which analysts in an organization can study and take informed decisions.

Data Mart:

In order to address a particular functional or business area, a small part of Data Warehouse is used which is called Data Mart.

• Data Marts only contain functionally related data and it gets its data from data warehouses.

Need of data warehouse and data marts:

• There is a concern for security and control to use operational data by analysts.
• Operational data is not suited for Business Intelligence (BI) analysis, as there will be reduced system performance, as BI Analysis requires considerable processing.
• Due to these reasons most organizations extract operational Data and in order to manage the organizations data there is need for a Data Warehouse.

Functions of data Warehouse and data marts:

• Obtain and integrate all the incoming data from various data sources.
• Gather all the data and cleanse them by finding out the errors and correcting them.
• Transform the cleaned data into warehouse format, organize, and relate those using Data Transformation techniques.
• Catalog the data by sorting, summarizing and building indices and partition for the data present in the data warehouse.

Role of Data Warehouse Components:

• Data Cleaning and Data Extraction Tools:
• First the data from Operational Databases and other internal and external data are extracted and are cleaned using data cleaning tools and prepare those data for BI Processing.
• Data Warehouse Database Management System (DBMS):
• The data which is prepared for BI Processing is stored in a data warehouse.
• The data warehouse database management system contains data from data warehouse metadata and data warehouse database.
• Business Intelligence Tools:
• The Business Intelligence users are usually specialists in data analysis who use business intelligence tools on the data stored on the data warehouse.

Problems in data used for Data Mining and Sophisticated Reporting:

Curse of Dimensionality:

• The Curse of Dimensionality is the observation that is observed that problem arises when one analyzes and organizes the data in high dimensional spaces...