Skip to content

feat: column-level lineage for DuckLake pipelines (SQL-AST inferred + traceable) #9814

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
rubenfiszel merged 15 commits into from
Jun 27, 2026
+1,973 −149
Merged

feat: column-level lineage for DuckLake pipelines (SQL-AST inferred + traceable) #9814

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
ec5d4d9
feat: column-level lineage for ducklake pipelines via // column annot…
rubenfiszel Jun 26, 2026
f9b1336
feat: auto-derive column lineage from DuckDB SQL AST (annotation as o…
rubenfiszel Jun 26, 2026
5ea7717
docs: clarify column-lineage inference is server-side; drafts use ann…
rubenfiszel Jun 26, 2026
324a520
feat(frontend): surface inferred column lineage in live pipeline drafts
rubenfiszel Jun 26, 2026
59b5d45
chore(frontend): bump windmill-parser-wasm-asset to 1.740.0 for SQL c…
rubenfiszel Jun 26, 2026
5479cb7
docs: column-lineage inference now runs live (WASM) too, merged with …
rubenfiszel Jun 26, 2026
0db36ae
feat(frontend): transitive column-lineage trace (impact analysis)
rubenfiszel Jun 26, 2026
49ff112
fix: address CI review on column lineage (parse-fallback, node-id, pe…
rubenfiszel Jun 26, 2026
4319d74
fix: resolve JOIN inputs + anchor column lineage to // materialize ta…
rubenfiszel Jun 26, 2026
e2cdcee
fix: gate column-lineage badge to the // materialize target write-edge
rubenfiszel Jun 26, 2026
e76a3ee
Merge remote-tracking branch 'origin/main' into pipeline-column-lineage
rubenfiszel Jun 27, 2026
4459df7
fix: build column trace from displayGraph so View hides draft lineage
rubenfiszel Jun 27, 2026
e6e4b45
fix: don't infer column lineage for local/temp staging CTAS
rubenfiszel Jun 27, 2026
57cd092
fix: scope inferred column lineage to one output asset
rubenfiszel Jun 27, 2026
8b86bdc
fix: treat CREATE TEMP TABLE/VIEW as local even under an active USE
rubenfiszel Jun 27, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
67 changes: 67 additions & 0 deletions backend/.sqlx/query-87ca1f2a34f54dade76f5a2cde5ecdac6806e1a306dca880943d97bb6d6a889d.json
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

1 change: 1 addition & 0 deletions backend/Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading
Loading