Understanding Data Quality

Understanding Data Quality

The fundamental paradigms underpinning data quality and quality data have reversed from where they were even 20 years ago.? The costs of storage and industrial strength relational databases have fallen so dramatically that data collection has completely replaced data quality.? Once much of the world’s data was trapped in flat files and each kernel had to be of critical value. At the time, the expectation was that the integrity of data was verified before it was entered. There wasn’t the money or space for storing poor quality data or for fixing it afterwards. The high standards and good practices of entry personnel, clerks and postal workers ensured the accuracy on each record.?

Many of us suffer under the delusion that our information still receives this level of care, as if we are living in the world portrayed in a Norman Rockwell painting. Unfortunately, we need to become much more cynical and realize that we live in a world of keystroke counts and workflows that rarely value the quality of the information entered.

Companies are leaving data entry up to the customer: sign up for our membership, register your appliance, fill out the satisfaction survey, review the product, fill in this form.? The consumer who fails to enter correct information may lose their warranty, never receive their service, be overcharged or turned down for a loan or find erroneous information in their credit reports.?

Meanwhile bots or data scraping programs promulgating inaccurate data circulate across the online world.? Tech corporations and their bricks and mortar counterparts are retreating from any responsibility for the quality of the data they retain, especially because the sale of our data remains a profitable business. Once the consumer checks that box of pages of tiny print they finds themselves left with the overwhelming task of ensuring their information across the web and in a thousand and one databases is both accurate and current. This same customer also finds themselves abandoned to deal with increasing infestations of spam, bots, fake accounts and outright scams on social media all by themselves.

Even the Social Security Administration charges retirees when their own software has miscalculated and over payed. They just dock future payments to claw back the funds rather than write-off their mistake. The resounding message you should be hearing is that the quality of your data has become solely your responsibility.

For this new and personal model of Data Quality and Data Governance to succeed requires us to create new arguments and rationalizations for the importance of good data and why we need to convince the organizations retaining our data to care about not just its security, but its quality.? It is time for a new paradigm, fully engaged in our modern reality, that makes data “ownership” simple and provides owners with effective tools to observe, maintain, and retain their information.??

I will explore some of these ideas in upcoming posts

要查看或添加评论,请登录

Jared Snyder的更多文章

  • The Business Analyst as Switzerland

    The Business Analyst as Switzerland

    The Business Analyst needs to be Switzerland. You can use terms like agnostic or apolitical, but I think neutral best…

  • The Power of Doing Right

    The Power of Doing Right

    The most powerful tool that every Business Analyst and Project Manager has at their disposal is doing things right. By…

  • AI Predictive Models

    AI Predictive Models

    Somewhere not yet recovered from the history of the latter half of the twentieth century is the story of the massive…

  • Signs Your Project is not Expected to Succeed - Part II

    Signs Your Project is not Expected to Succeed - Part II

    In Part I, I talked about people who were assigned to the project who were poor fits. Their assignment to the project…

  • Signs Your Project is not Expected to Succeed

    Signs Your Project is not Expected to Succeed

    Successful projects are about setting reasonable expectations and attempting to meet those expectations using a plan…

  • The power of words and conserving their value

    The power of words and conserving their value

    Once, long ago I was a student of the brilliant anthropologist Dennis Tedlock. It was through him that I was introduced…

  • Lesson Learned about Lessons Learned

    Lesson Learned about Lessons Learned

    Two Ways to Run Lessons Learned I have found two very different ways to manage Lessons Learned sessions. Both are…

    1 条评论
  • Lessons Learned about Lessons Learned - Part I - The Setup

    Lessons Learned about Lessons Learned - Part I - The Setup

    Setting up a Lessons Learned session Give your session plenty of time. I would not schedule a session for less than an…

  • Low Hanging Fruit

    Low Hanging Fruit

    I am not a big fan of the term “low hanging fruit”. I think it is a misnomer that can lead to erroneous assumptions.

  • Is patience really a skill?

    Is patience really a skill?

    Perhaps you are like me and grew up in a household where we were taught as children that “patience is a virtue.” The…

社区洞察

其他会员也浏览了