Amrinder Paul on Mon, 11 Sep 2017 02:04:54
1. Is it possible to add an extra column for having an extra details for the main column?
2. Is it possible to have an alert setup for each table which can tell us that changes happened for the table ( addition or deletion of column from the table)?
Matthew Roche [MSFT] on Wed, 13 Sep 2017 16:40:23
Thanks for the questions.
For #1, I'm not sure what you're asking. Would it be possible to please clarify?
For #2, the easiest way to track changes of this sort is to use the Data Catalog REST API to periodically query the catalog to check for assets based on their last modified date. Data Catalog does not currently support alerts to proactively notify users of changes.
Matthew Azure Data Catalog Team
Amrinder Paul on Wed, 13 Sep 2017 23:59:15
Thanks for replying.
Let me try to explain a bit on it
Normally 4 columns are visible: Column name, Data type, tags, description.
Is it possible to add an additional column to it say "Encrypted values".
In this case total columns will be 5 : Column name, Data type, tags, description & Encrypted values.
Matthew Roche [MSFT] on Thu, 14 Sep 2017 15:49:11
Hi Arminder - thanks very much for the additional information!
Data Catalog does not currently provide the ability to customize the metadata schema for data assets in the catalog. This is functionality we have on our roadmap, but it will likely not be available until next year.
Amrinder Paul on Tue, 19 Sep 2017 06:18:55
Thanks a lot.
Shannon Lowder on Tue, 17 Oct 2017 11:49:28
When extending the metadata model for Data Catalog, there's a lot to consider. One of the biggest missing attributes currently is a concept of mapping. A way to say table1.column feeds this table2.colum through a certain SSIS package, USQL script, or Data Factory Pipeline. With this, you could automate building your ETL processes based on meta data.
A great metadata modeling tool is built in to Varigence BimlStudio. Effectively you can build your model however you wish, and the data underneath is stored to any number of data stores.