Skip to content

test(integration-tests): cover maintenance and planning - #752

Closed
mkuchenbecker wants to merge 22 commits into
mkuchenbecker/delta-harness-rtasfrom
mkuchenbecker/delta-harness-maintenance-planning
Closed

mkuchenbecker wants to merge 22 commits into
mkuchenbecker/delta-harness-rtasfrom
mkuchenbecker/delta-harness-maintenance-planning

Conversation

@mkuchenbecker

@mkuchenbecker mkuchenbecker commented Sep 18, 2026

Copy link
Copy Markdown
Collaborator

Summary

This PR adds maintenance procedures, metadata tables, compaction planning, and
scan planning on top of RTAS. It contributes 23 cases to the 394-case RTAS
catalog and produces 417 combined cases.

This branch also fills the Maintenance and planning section in
TEST-COVERAGE.md.

Stack

Layer Parent Contribution Combined Pull request
RTAS Standard DML 264 394 #744
Maintenance and planning RTAS 23 417 This PR

Scope

This layer owns snapshot expiration, data and manifest rewrites, orphan
removal, metadata-table projections, compaction planning, and scan-split
planning. Each case checks the table's current files, snapshots, and sequence
metadata.

Contribution Cases
Maintenance procedures (ScenarioMaintenance.scala) 12
Metadata tables (ScenarioMetadataTable.scala) 6
Compaction planning (ScenarioCompactionPlanning.scala) 3
Scan planning (ScenarioScanPlanning.scala) 2
Total 23

Known limitations

This layer adds no known-bug skips. Its four combined-catalog skips are inherited
from RTAS.

Validation

Check Result
git diff --check against the parent tip Clean.
Added lines ASCII only.
Embedded catalog 417 combined cases: 413 passed, 4 skipped, 0 failed.

mkuchenbecker and others added 9 commits September 4, 2026 14:34
Rebuild this capability as a clean additive catalog contribution on the revised harness stack.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
…ecker/delta-harness-maintenance-planning-recut
…ecker/delta-harness-maintenance-planning-recut
Keep side-table ownership, multi-snapshot preparation, and evolved rows
with the maintenance and planning scenarios that consume them.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
mkuchenbecker and others added 12 commits September 17, 2026 17:51
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Describe maintenance and planning through visible procedure effects, metadata,
scan tasks, and compaction decisions.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

# Conflicts:
#	integrations/spark/delta-harness/TEST-COVERAGE.md
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Move maintenance and planning contributors into the renamed package and
keep their qualitative coverage documentation with the module.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@mkuchenbecker mkuchenbecker changed the title test(delta-harness): add maintenance and planning scenarios test(delta-integration-tests): cover maintenance and planning Sep 21, 2026
@mkuchenbecker mkuchenbecker reopened this Sep 21, 2026
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@mkuchenbecker mkuchenbecker changed the title test(delta-integration-tests): cover maintenance and planning test(integration-tests): cover maintenance and planning Sep 22, 2026
@mkuchenbecker mkuchenbecker reopened this Sep 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant