Bound AST, Logical Plan, and Relational Algebra Explained
A deep technical guide to SQL parser ASTs, bound ASTs, Logical IR, Semantic IR, logical plans, and relational algebra for parser, lineage, and governance engineers.
Category Data Governance
Data Governance Tools and Resources
Why DataHub Loses Column-Level Lineage on dbt Deduplication Macros — and How to Recover It
DataHub silently drops column-level lineage on the dbt-utils deduplicate macro because of how sqlglot's column resolver handles ARRAY_AGG + struct unpack. Here's why — and an open-source post-processor that recovers the missing lineage.
BigQuery Column-Level Lineage Without Metadata: Inferring STRUCT and ARRAY Types from SQL Alone
How a BigQuery-aware SQL parser can extract column-level lineage from ARRAY<STRUCT>, SELECT AS STRUCT, and array_agg(row) patterns without any catalog metadata — and where generic parsers silently fail.
10 Best Data Lineage Tools in 2024 | Top 10 Data Lineage Tools You Can Buy Now
10 Best Data Lineage Tools 2024 A Data lineage tool is a sophisticated software application designed for comprehensive data management within an organizational context. Its primary function is to systematically document and illustrate the trajectory of data elements from their…
Ingest MySQL metadata on Datahub
Datahub is an open-source metadata platform for the modern data stack. We have integrated the SQLFlow into Datahub so that the SQLFlow data lineage is enabled in the Datahub UI. Check this blog for how to integrate SQLFlow into Datahub.…
Integrate SQLFlow into Datahub
Datahub is an open-source metadata platform for the modern data stack. We have integrated the SQLFlow into Datahub so that the SQLFlow data lineage is enabled in the Datahub UI. This integration is for Datahub v0.10.4. You will need to…
Visualize your upstream/downstream data with SQLFlow REST API
Gudu SQLFlow is an analysis software for analyzing SQL statements and discovering data lineage relationships. It is often used with metadata management tools and is a basic tool for enterprise data governance. Check this introduction blog if you don’t know…
Visualize your data under Left-Most format with SQLFlow REST API
Gudu SQLFlow is an analysis software for analyzing SQL statements and discovering data lineage relationships. It is often used with metadata management tools and is a basic tool for enterprise data governance. Check this introduction blog if you don’t know…
Export E-R Diagram with SQLFlow REST API
Gudu SQLFlow is an analysis software for analyzing SQL statements and discovering data lineage relationships. It is often used with metadata management tools and is a basic tool for enterprise data governance. Check this introduction blog if you don’t know…
Visualize selected data with SQLFlow REST API in Job mode
Gudu SQLFlow is an analysis software for analyzing SQL statements and discovering data lineage relationships. It is often used with metadata management tools and is a basic tool for enterprise data governance. Check this introduction blog if you don’t know…