{"id":1751,"date":"2022-05-07T21:15:23","date_gmt":"2022-05-08T02:15:23","guid":{"rendered":"https:\/\/www.dpriver.com\/blog\/?p=1751"},"modified":"2022-05-22T19:06:18","modified_gmt":"2022-05-23T00:06:18","slug":"gudu-sqlflow-whats-it-why-it-important","status":"publish","type":"post","link":"https:\/\/www.dpriver.com\/blog\/2022\/05\/gudu-sqlflow-whats-it-why-it-important\/","title":{"rendered":"Gudu SQLFlow : What’s it and why it is important?"},"content":{"rendered":"

What’s Gudu SQLFlow?<\/h2>\n

In large data warehouses and data lakes, complete data lineage<\/a><\/strong> can be used for data traceability, impact analysis of table and column changes, proof of data compliance, data quality checks, and more.\u00a0So what exactly is data lineage?\u00a0<\/span>According to Wikipedia, data lineage includes where the data came from, what happened, and where it moved over time.\u00a0\u00a0Gudu SQLFlow<\/strong> gives complete data lineage by analyzing SQL scripts.\u00a0It can handle SQL statements of more than 20 kinds of databases, including complex stored procedures and dynamic SQL statements.\u00a0With the powerful SQL processing capability of the self-developed general-purpose SQL parser, Gudu SQLFlow is one of the most popular data lineage tools<\/a><\/strong> available on the market today.\u00a0<\/span><\/p>\n

\"Gudu
Gudu SQLFlow<\/figcaption><\/figure>\n

Gudu SQLFlow generates data lineages by analyzing SQL queries and stored procedures.\u00a0Entities in the data lineage model include tables, columns, functions, relationships, and other entities. The combination of entities and dataflows shows the lineage from one table\/column to another.<\/p>\n

1. Data flow unit<\/h3>\n

A data flow unit includes source entities, target entities, and the type of data flow between them.<\/p>\n

\"Gudu_SQLFlow<\/p>\n

This is the data flow generated for the above SQL query.<\/p>\n

\"Gudu_SQLFlow<\/p>\n

\"02-1\"<\/p>\n

1.1 Source and target entities<\/h4>\n

Source and target entities often reference tables, views, and other relationships, such as common table expressions, result sets generated during query execution. It may also refer to files in HDFS systems etc.<\/p>\n

1.2 Types of data flow<\/h4>\n

There are two types of data flow: direct data flow and indirect data flow.<\/p>\n

1.2.1 Direct data flow<\/h5>\n

Direct data flow means that the data of the target entity comes directly from the source entity. In the diagram above, RS-1.FirstName directly from Person.FirstName.<\/p>\n

Arrows are used to represent direct data flow in the diagram:\u00a0\"03-1\"<\/p>\n

1.2.2 Indirect data flow<\/h5>\n

Indirect data flow means that the data of the target column does not come from the source column, but the data of the source column\/table affects the result data of the target column.
\nDashed arrows are used to represent indirect data flow in the diagram:\u00a0\"04-1\"<\/p>\n

Source columns in indirect data flow typically appear in the following clauses:<\/p>\n