Data warehousing
Banner
Banner
Banner
Data warehousing PDF Print E-mail
Written by Administrator   
Sunday, 12 April 2009 23:14

The transactional or routine systems in a business are designed to support fast data entry and retrieval of the basic information to progress the day to day, hour by hour work of the company. They are not usually designed to produce in depth analysis and consolidation reports.
A business or organization has usually three levels of Activities:

  • Transaction or Routine or Production processes e.g. order taking
  • Tactical processes e.g. operational planning
  • Strategic processes e.g. business and market planning

The following diagram which shows these systems, time frames, data flows and where a data warehouse would fit in.


Data warehouses offer organizations the ability to gather and store enterprise information in a single conceptual enterprise repository. Basic data modeling techniques are applied to create relationship associations between individual data elements or data element groups. These associations, or “models,” often take the form of entity relationship diagrams (ERDs). More advanced techniques include the star schema and snowflake data model concepts. Regardless of the technique chosen, the goal is to build a metadata model that conceptually represents the information usage and relationships within the organization.

Leveraging the metadata model, enterprise users can then apply elementary data analysis techniques to gather business knowledge. For example, ad hoc queries can be run against the data warehouse to extract enterprise-level information. These queries would supply information that was impossible to obtain under the legacy system of disparate information silos.
Reasons for a Data Warehouse
There are a few more reasons why a data warehouse should exist:

  1. You want to integrate data across functions or systems to provide a complete picture of the data subject e.g. customer orders, customer complaints, salespersons. To do this on the fly or run, would be time coming and performance of your BI system would be poor.
  2. You do not want to interfere with the fast performing transaction systems by running large computer resource queries and reports whilst routine users and possibly customers are executing the essential business transactions.
  3. You want to reorganize the data to support fast reporting and querying.
  4. You want to clean up the quality of the data to give consistency and data integrity. Many systems do not have strict input validation and garbage gets in ... duplicates e.g. same customer entered more than once. Also there often different definitions for the same subject or entity within the business e.g. customer, client, prospect.

Components of a Data Warehousing solution

  • Data Modeling: Creating a fact-dimension model or a normalized scheme to support Business Intelligence (BI) and analytics tools.
  • Extract, Transform and Load (ETL): Loading data and transforming data based on business and data management rules.
  • Business Intelligence (BI): Generation of reports, dashboards, data mining paradigms to present and understand data better.
Last Updated ( Thursday, 23 April 2009 18:18 )