test(integration-tests): cover maintenance and planning - #752
Closed
mkuchenbecker wants to merge 22 commits into
Closed
mkuchenbecker wants to merge 22 commits into
mkuchenbecker wants to merge 22 commits into
Conversation
Rebuild this capability as a clean additive catalog contribution on the revised harness stack. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
…ecker/delta-harness-maintenance-planning-recut
…ecker/delta-harness-maintenance-planning-recut
Keep side-table ownership, multi-snapshot preparation, and evolved rows with the maintenance and planning scenarios that consume them. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This was referenced Sep 18, 2026
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Describe maintenance and planning through visible procedure effects, metadata, scan tasks, and compaction decisions. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> # Conflicts: # integrations/spark/delta-harness/TEST-COVERAGE.md
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Move maintenance and planning contributors into the renamed package and keep their qualitative coverage documentation with the module. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds maintenance procedures, metadata tables, compaction planning, and
scan planning on top of RTAS. It contributes 23 cases to the 394-case RTAS
catalog and produces 417 combined cases.
This branch also fills the Maintenance and planning section in
TEST-COVERAGE.md.Stack
Scope
This layer owns snapshot expiration, data and manifest rewrites, orphan
removal, metadata-table projections, compaction planning, and scan-split
planning. Each case checks the table's current files, snapshots, and sequence
metadata.
ScenarioMaintenance.scala)ScenarioMetadataTable.scala)ScenarioCompactionPlanning.scala)ScenarioScanPlanning.scala)Known limitations
This layer adds no known-bug skips. Its four combined-catalog skips are inherited
from RTAS.
Validation
git diff --checkagainst the parent tip