Data Integration is Like Weight Loss...
Brian Farish
#BigID | IT Consulting | Information Management | Data Architecture | Data Modeling | Data Management/Governance | Thoughts -> Words -> Design -> Technology
...There are many big fans [pun kinda' intended] of the concept but very few are willing to do what it takes to accomplish it.
Data Architects are like the doctors... earnestly promoting the "right path" and exhorting the enterprise/patient to "do the right thing".
The enterprise/patient knows that the "right thing" is to integrate the data/lose the weight.
The integration effort/nutrition and exercise plan kicks off with much enthusiasm and conviction.
Often there are encouraging initial results...
The enterprise integration champions/patients bore everyone to death with the details of their new integration initiative/nutrition and exercise plan, but everyone is encouraged and hopeful about the situation.
But then the "new" wears off and the tedium of the day-to-day integration and governance activities/sensible menu sets in and an "opportunity for a quick win" (sexy new buzzword... technology, paradigm... matters not...)/hunk of chocolate cake comes along and short-sighted decision makers are tempted to just bypass all that integration effort and time and throw the thing in production/eat the cake.
Assuming that this backsliding doesn't completely end the integration effort/nutrition and exercise plan the effect is discouraging. Analysis, rework and cleanup/losing the same weight again is required.
If the backsliding and resulting discouragement leads to abandoning the right path altogether because "it's just too hard", the results are inevitable and tragic.
For the enterprise, in addition to the possibility of going out of business or going to jail for regulatory violations, they lose day-to-day insight into their business and the agility to maximize undiscovered business opportunities and capture competitive advantages.
But the point to be taken away here is that it is not the data architect/doctor that determines the success or failure of the integration/nutrition and exercise plan... And it is really not the technology or approach/nutrition and exercise plan chosen. It is the decision-makers/patients making the right choice again-and-again-and-again to "do the right thing".
The long-term payoff is HUGE [again, pun kinda' intended].
Medical Student at Case Western Reserve University
8 年Brian, great analogy you've laid out here! My team is currently working on a market analysis of data integration vendors. Would love to have an interview with you to chat about where you believe the market is heading and some of your experiences with data integration platforms.
Enterprise Data Architect at Network Rail - virtualising physical assets into an analytics friendly, Cloud based digital twin
9 年I agree that the long term message of integration needs to be constantly communicated (and defended) against the more obvious short term quick win that will potentially undermine integration. The real trick is not to sell the idea, but have the decision makers queuing up to buy in to it. That really is the best defense.
Data Governance Leader, Consulting Chief Data Officer
9 年I like the analogy - well put. Like the doctor, the better we know our patients and what matters to them, the more likely we are to find the personal reasons that will inspire them to change their lifestyle permanently.
I agree with the observation that its really commitment from the business decision makers that determine success of the weight-loss program (to follow the analogy). It does take a long time to loose weight though and it does not fit nicely with the very short-term performance and reward cycles thta our executives face. You have to build in early wins even if it departs slightly from your roadmap. Yes, you have to plan to have your cake and loose weight in the long term. Governance becomes a key enabler.
SVP Data, Business Operations @ Zeel.com | Revenue Cycle, Analytics
10 年I need to integrate the "hunk of chocolate cake" into planning.