Skip to content

fix(#2247): compare decoded text in shim drift detection#8

Closed
guyoron1 wants to merge 10 commits into
mainfrom
fix/2247-shim-stale-comparison
Closed

fix(#2247): compare decoded text in shim drift detection#8
guyoron1 wants to merge 10 commits into
mainfrom
fix/2247-shim-stale-comparison

Conversation

@guyoron1

Copy link
Copy Markdown
Owner

The stale-shim comparison in reconcile-repos.sh used direct base64 comparison which decoded base64, then re-encoded to base64. Bash command substitution strips trailing newlines, so the re-encoded base64 could differ from the original even when the decoded text was identical. This caused false-positive drift detection, leading to bogus update PRs (e.g. PR fullsend-ai#2101) that removed the sentinel lines.

Replace the base64-to-base64 comparison with decoded text comparison: decode both sides, strip carriage returns, and compare the resulting strings directly.

Add a regression test that verifies logically identical content with different trailing newlines is not flagged as stale.

Closes fullsend-ai#2247


Mirrored from upstream fullsend-ai/fullsend#2254 for QualityFlow demo.

The stale-shim comparison used direct base64 comparison which produced
false-positive drift detection when content was logically identical but
encoded with different trailing newlines from GitHub's content API.

Compare decoded text instead of base64 to avoid false positives.
Add regression test for trailing newline tolerance.

Closes fullsend-ai#2247
@guyoron1

Copy link
Copy Markdown
Owner Author

/fs quality

@fullsend-ai-review

fullsend-ai-review Bot commented Jun 15, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 6:09 AM UTC · Completed 6:20 AM UTC
Commit: b906834 · View workflow run →

@fullsend-ai-review

fullsend-ai-review Bot commented Jun 15, 2026

Copy link
Copy Markdown

Review

Reason: stale-head

The review agent reviewed commit 1836b4452caa99ba8961c97e13f7210f1524a4c9 but the PR HEAD is now 0ff68326df4c8df3df35ad9302bc0f58d0505765. This review was discarded to avoid approving unreviewed code.

Previous run

Review

Reason: stale-head

The review agent reviewed commit ce6715492f1a7cb5b91bbdb635dd9fa9c8f24393 but the PR HEAD is now ac7364a5e6e659febc4c2053498389ebc45616b2. This review was discarded to avoid approving unreviewed code.

Previous run (2)

Review

Reason: stale-head

The review agent reviewed commit 242c5c47fd3ffb048ad85cde95a690216a27586a but the PR HEAD is now 37118d0fa70906719383d2c6cb40f2501b9002e7. This review was discarded to avoid approving unreviewed code.

@fullsend-ai-review

Copy link
Copy Markdown

/fs-review

@fullsend-ai-review

fullsend-ai-review Bot commented Jun 15, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 6:21 AM UTC · Completed 6:34 AM UTC
Commit: b906834 · View workflow run →

Co-Authored-By: QualityFlow <qualityflow[bot]@users.noreply.github.com>
@fullsend-ai-review

Copy link
Copy Markdown

/fs-review

@fullsend-ai-review

fullsend-ai-review Bot commented Jun 15, 2026

Copy link
Copy Markdown

🤖 Finished Review · ✅ Success · Started 6:36 AM UTC · Completed 6:47 AM UTC
Commit: b906834 · View workflow run →

QualityFlow added 2 commits June 15, 2026 06:41
STD refined: APPROVED_WITH_FINDINGS -> APPROVED (score 80 -> 95)
- Fixed tier values: "Functional" -> "Tier 1" in all 6 scenarios
- Added patterns field to all scenarios (comparison-validation, workflow-integration, regression-suite)
- Added Ordered decorator to all scenario contexts
- Removed related_prs from document_metadata (content policy)
- Added gomega import to Go stubs
- Removed unused context import from code_generation_config
@fullsend-ai-review

Copy link
Copy Markdown

/fs-review

QualityFlow and others added 2 commits June 15, 2026 06:51
Replaces intermediate pipeline artifacts with organized test files.

Go tier 1 tests: 1 files → qf-tests/GH-8/go/
Python tier 2 tests: 4 files → qf-tests/GH-8/python/
Jira: GH-8
[skip ci]
@github-actions

Copy link
Copy Markdown

QualityFlow Pipeline Summary

Stage Agent Status
1 STP Builder
2 STP Reviewer
3 STP Refiner
4 STD Builder
5 STD Reviewer
6 STD Refiner
7 Go Test Generator
8 Python Test Generator

Test Output

Type Count Location
Go/Ginkgo tier 1 1 files qf-tests/GH-8/go/
Python/pytest tier 2 4 files qf-tests/GH-8/python/

Issue: GH-8


Generated by QualityFlow

@guyoron1

Copy link
Copy Markdown
Owner Author

Closing to re-run with unified test-generator (7-stage pipeline)

@guyoron1 guyoron1 closed this Jun 15, 2026
@guyoron1 guyoron1 deleted the fix/2247-shim-stale-comparison branch June 15, 2026 11:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

reconcile-repos.sh produces shim blob without sentinel, creating bogus update PR

1 participant