Support for Merge operations on Snowflake queries

[bhavesh91]

We are having a requirement to parse the SQL queries that has MERGE operations - is there a plan to have a functionality to incorporate this ?

[vrajat]

Yes. I am assuming you are referring to the MERGE statement from Snowflake docs. Can you provide more info on how and why you are considering using data-lineage? This will help me prioritize the request. Can you fill in this survey?

Also will you be able to test an alpha build?

[sragavanvijay]

Hello @vrajat, Is the capability exists to connect to Snowflake directly and extract metadata to build lineage? Is there a plan to have this functionality built in the near future??

[vrajat]

Hi @sragavanvijay , data-lineage can pull the catalog from Snowflake. There is a query parser plugin to parse snowflake query history and build the lineage. A couple of examples that demo the current state:

• Store and extract Snowflake Query History
• Query Parser Example Notebook

So the building blocks are there. Some scripting is required. I am working on packaging this better. Can you fill in this survey so that I can better understand your requirements?

[vrajat]

Duplicate of #78