Proactive Data Management Strategy
This site is dedicated to furthering the cause of Data Governance…
Proactive Data Management begins with Active Metadata Management. This was first of the innovations with introduction of AI into new age DG tools as well as DG concepts that were built into the data warehouse or lake houses.
But, where I think we are all stuck, at least in the DG world is to cross the chasm from above to the almost Nirvana of non-invasive DG.
We are all trying; the DG platforms, the lake houses, data observability tools. And I think that is just great! But I think there are 2 critical challenges among others.
First, the data ops world, data sources etc. must be integrated into the DG catalog seamlessly. Second challenge is even tougher.
Generally speaking, every platform, tool, or data base are great at governing data within its boundaries for almost any purpose. Some platforms, put added emphasis on data governance features; e.g. Databricks Unity Catalog.
But how about cross database, cross platform, cross tool? That is where the DG tools are focusing their efforts. Applications and benefits are plenty, especially in AI/ML world. E.g. both, Data fabrics and Data mesh success hinges on this.
But while these innovations are coming and some are here, we must have right strategy to use them. We must be proactive, so that applications beginning with self-service analytics, through data products, and into latest Gen AI applications can rely on trusted and quality data!
That to me is Proactive Data Management (PDM) strategy. We will explore these further in upcoming blogs!