{"id":2558,"date":"2022-09-10T18:46:11","date_gmt":"2022-09-10T23:46:11","guid":{"rendered":"https:\/\/www.dpriver.com\/blog\/?p=2558"},"modified":"2022-09-10T18:46:13","modified_gmt":"2022-09-10T23:46:13","slug":"octopai-has-announced-a-new-data-lineage-platform","status":"publish","type":"post","link":"https:\/\/www.dpriver.com\/blog\/2022\/09\/octopai-has-announced-a-new-data-lineage-platform\/","title":{"rendered":"Octopai Has Announced A New Data Lineage Platform"},"content":{"rendered":"\n

Israeli data discovery company Octopai has announced a new data lineage platform, Data Lineage<\/a><\/strong> XD, which takes care of and automatically discovers and records data transformations<\/strong><\/a> and flows within customer data areas. “XD” stands for Interdimensional, and the name isn’t just a marketing gimmick. The Octopai system can map what the company calls cross-system lineage, intra-system lineage, and end-to-end column lineage.<\/p>\n\n\n

\n
\"Octopai
Octopai Has Announced A New Data Lineage Platform<\/figcaption><\/figure><\/div>\n\n\n

Octopai executives briefed jsspu on the data lineage XD and demo aspects of the platform. They explain that cross-system lineage maps the flow of data across systems, from initial ingestion and extraction, transformation and loading (ETL<\/a><\/strong>) to reporting and analysis. It provides color-coded network diagrams in interactive visualizations to illustrate flows and dependencies. The image above provides an example.<\/p>\n\n\n\n

Internal system lineage maps transformations of data columns in ETL processes, reports, or database objects. To achieve this, Octopai not only has connectors to data sources and destinations, but also to various ETL platforms, business intelligence (BI) backends and self-service BI visualization tools. Instead of treating everything as a database, Octopai’s connectors have a contextual understanding of how to read metadata<\/a><\/strong> and code in SQL scripts and stored procedures. It can also read “code” (detailed transformations and dependencies) in ETL and BI assets.<\/p>\n\n\n\n

End-to-end column lineage details data column-specific lineage between systems. It is particularly relevant to regulatory compliance, impact analysis, and root cause analysis. Because the connectors provided by Octopai are very component-specific, the column lineage that Octopai can generate is very granular and detailed.<\/p>\n\n\n\n

It supports the following platforms:<\/strong><\/p>\n\n\n\n