Integrated Data Quality experience in Purview Data Governance solution
Data Quality scores of data products and business domains

Integrated Data Quality experience in Purview Data Governance solution

The integrated data quality experience offered by Microsoft Purview Data Governance solution is designed to provide organizations with a comprehensive and seamless approach to managing data quality across their entire data estate.

Purview data quality allows for measuring data quality at multiple levels, including data columns, data assets, data product, and business domain levels. This multi-level approach enables organizations to gain insights into data quality from granular data elements to higher-level business contexts.

At the data column level, Purview enables organizations to assess the quality of individual data attributes, including accuracy, completeness, consistency, and timeliness. This granular assessment helps identify specific data quality issues and actions within datasets. Purview aggregates data quality metrics from individual columns to provide insights into the overall quality of data assets and data products.

Data quality score deep link of a data asset.

By consolidating data quality scores, organizations can understand the collective health of their data assets and identify areas for improvement.

Data quality score deep link of a data product

The benefits of integrated data quality experience is illustrated in two example scenarios, but there are number of scenarios you could find when you talk with data practitioners:


Scenario 1: Finance business domain owner has defined an OKR for invoice accuracy, their target is 99.5% customers invoice must be accurate.? To achieve this OKR, the Finance business domain owner needs to make sure that all data that requires to create and send invoice to the customers must be complete and accurate.? Zip code or postal code has a direct impact on tax calculation of invoiced amount. If the Zip code or postal code is incorrect then calculated tax amounts for invoiced amount will be incorrect. This means customers will get inaccurate invoices and correction of the invoice is required. This means, company need to correct the invoices. The negative impacts of inaccurate invoicing are many, for example, it may create bad customer experience, and company need to collect additional tax from customer (under taxation) or pay back tax to the customer due to over taxation. So, the quality of data in a column is directly correlating with OKR of the Finance Business domain & processes, a business domain owner might not be aware of it unless we rolled up the data quality of a column all the way to data asset, data product and business domain level.

?

Scenario 2: Marketing business domain has defined an OKR to measure the impact of marketing campaign, the target is, 80% of customers shall receive email campaign and 10% customers engagement expected to be increased if the campaign target meets. The quality of customer contact data has direct contribution to achieve this 80% OKR target. If 30% of the email contacts are incorrect then the email campaign will not be reached to 30% customers contact and the OKR target will be missed.? If the business domain owner has visibility of quality trend of data estate in Marketing domain, then the owner will be able to take preventive action to improve the quality of data to meet the quality expectation thus achieve the OKR target.


In summary

Purview contextualizes data quality assessments within the broader context of business domains. By aligning data quality metrics with specific business objectives and key results (OKRs), organizations can prioritize data quality improvements that directly impact business outcomes.

Moreover, Purview's integrated experience helps stakeholders to justify the importance of different data assets by assessing their relevance to business domains and data products. If a data asset is not being utilized within a business domain or data product, stakeholders can question its importance and evaluate whether it should be retained or deprecated.

Overall, the integrated data quality experience offered by Microsoft Purview Data Governance solution enables organizations to establish a robust framework for managing data quality across their entire data estate. By combining granular data quality assessment with business context alignment and guided data quality improvement actions, Purview empowers organizations to ensure that their data remains accurate, reliable, and fit for purpose, thereby driving better business outcomes.

Other references: ?https://lnkd.in/gNBRHKrN, https://lnkd.in/g2wYipke



Aleksandra Egorova

Digital Transformation | Data Platform Owner

9 个月

hi Shafiq Mannan This is a great step forward. However, I notice that the scope of Purview is still quite limited to ADLS, SQL, and Blob storage. Beyond just data quality features, aspects like data lineage are also crucial. Are there plans to expand Purview’s capabilities to integrate with other tools, such as Databricks?

回复
?? Christophe Hervouet

Ingénieur Analytique / Lead tech / Expert ==> Microsoft BI ( Fabric et Power BI) && Data Analyste GCP Bigquery et DBT cloud && Conseiller DATA (organisations , gouvernances , architectures)

10 个月

Great news But do you know please is there is a plan at Microsoft to directly implement Data quality controls on the Fabric Workspaces ? - LH / DWH Gold & analytic SQL data <== completeness , data validity (integrity ..) , custom rules etc ..) - Power BI tables <== completeness , data validity (integrity ..) , custom rules etc ..) In hurry to also get a "best practices" metadata TESTS feature on FABRIC cicd deployment pipelines Around SQL , modelling ,Star model , DAX metadata qualities ??

回复
Rachana Gupta

Security engineering | Cloud Security and Compliance |Azure |GCP |AWS| OCI | ISO 27001 LA|Fedramp | GRC| Privacy | Empath

10 个月

Will purview integrate with priva for azure? For dsar type of request

If data lineage gives you GPS for your data, data quality gives you the road map to high-quality insights and AI innovation.

要查看或添加评论,请登录

Shafiq Mannan的更多文章

社区洞察

其他会员也浏览了