Why do we need Data Warehouse models?
Drazen Orescanin
Enabler of digital privacy for global leaders and expert for privacy-enhancing technologies. Serial entrepreneur and founder at Legit (Data Privacy Manager), Poslovna Inteligencija and BIRD AI Incubator
This is the first blog from my new series about Data Warehouse models and modeling. In this series I will cover the reasons for modeling and use of standard industry models, best practice and recommendations for creation and implementation of Data Warehouse model and specifics related to various industries and technologies.
To start the series, there is the first question: Why do we need Data Warehouse models?
Let’s think in a different context – imagine that you are a successful doctor, you have bought beautiful piece of land near by dreamy lake and you are planning to build the house. What are you going to do? You can engage constructors to build the house, but they will ask you for the blueprint. You cannot make a blueprint on your own, because you are a doctor and you don’t know anything about architecture, static forces, building materials or wiring. Of course, you will engage an architect and pay him for the blueprint. You will tell the architect what you have in mind and what are your requirements, and most likely he will show you some template blueprints of his previous work that was based on architectural standards and best practices. Of course, you will use blueprint for family house, and not for the warehouse or the bridge, because those blueprints are used to build something completely different. Final blueprint will be customized based on your specific requirements. At the other hand, if you want completely new blueprint, designed exclusively for you, that means that it will cost you more because it will require more work from the architect, and it will also bring in the equation some risk that this new blueprint and your new house will not be as brilliant as you want it to be. I have seen many ugly houses around beautiful lakes.
The reason for using Data Warehouse models is literary the same. If you are in telco, retail, healthcare or any other business, this business is the field where you are strong. You are not Data Warehouse architect and if you want to implement Data Warehouse system you need somebody who is experienced in that field and blueprint that you will use as standard and guidance.
Data Warehouse model is a platform-independent solution (i.e. blueprint) that contains thousands of hours’ worth of development effort and industry expertise to help business users and IT to implement Data Warehouses, Data Marts and analytical applications on time and on budget. Model offers the scalability and flexibility needed to address existing and future data integration and analysis requirements and can be customized to meet specific needs of customer in specific industry. Data Warehouse model cannot be general – it is always designed to fulfill standard needs of particular industry, such as banking, communications, discrete manufacturing or retail. By using standard industry Data Warehouse model, you will reduce the cost and the risk of your Data Warehouse implementation.
In next blog we will discuss in detail the benefits of the implementation of standard industry Data Warehouse model.
Dra?en Ore??anin
Data Warehouse architect
Associate Partner - Cognitive and Analytics at IBM
6 年Very nicely articulated the modeller part
Senior Data Analyst
6 年Your article made great sense and is very timely. Keep up the great blog...
When working with clients, I often ask them if they have a database model. 9 times out of 10, the answer is no. That usually tells me everything I need to know about why they have problems. I've also seen a worrisome trend in the rise of things like JSON and Parquet files with things like arrays of strings embedded in them. These strike me as "hacker" tools, and make data processing super hard and complicated. Nothing beats a good data model for performance and ease of use.
Founder, Chairman, CEO, Best-Selling Author, University of Denver & Scalefree Advisory Board Member
7 年Drazen - I liked your article very much - Bill Inmon