Skip to content

add_fivetran_deleted_column_and_filter#9

Merged
fivetran-savage merged 4 commits into
mainfrom
feature/add_fivetran_deleted_column_and_filter
Oct 21, 2025
Merged

add_fivetran_deleted_column_and_filter#9
fivetran-savage merged 4 commits into
mainfrom
feature/add_fivetran_deleted_column_and_filter

Conversation

@fivetran-savage

Copy link
Copy Markdown
Contributor

PR Overview

Package version introduced in this PR:

  • 0.2.2

This PR addresses the following Issue/Feature(s):

Summary of changes:

  • Added additional records to seed data where _fivetran_deleted = true for testing purposes
  • Added _fivetran_deleted field to source model and .yml
    • filtered out _fievetran_deleted field in staging model

Submission Checklist

  • Alignment meeting with the reviewer (if needed)
    • Timeline and validation requirements discussed
  • Provide validation details:
    • Validation Steps: Check for unintentional effects (e.g., add/run consistency & integrity tests)
    • Testing Instructions: Confirm the change addresses the issue(s)
    • Focus Areas: Complex logic or queries that need extra attention
  • Merge any relevant open PRs into this PR

Changelog

  • Draft changelog for PR
  • Final changelog for release review

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fivetran-savage great work on this PR! Some small changes before approval. Be sure to regen the docs after making these updates and marking as ready for re-review. Thanks!

cast(parent_asin as {{ dbt.type_string() }}) as parent_asin,
upper(type) as type
from fields
where coalesce(_fivetran_deleted, false) = false

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When writing these types of queries the standard is to use the following approach (see here as an example).

Suggested change
where coalesce(_fivetran_deleted, false) = false
where not coalesce(_fivetran_deleted, false)

Comment thread CHANGELOG.md Outdated
[PR #9](https://github.com/fivetran/dbt_amazon_selling_partner/pull/9) includes the following updates:

## Under the Hood
- Added `_fivetran_deleted` filter to `stg_amazon_selling_partner__item_relationship` model to exclude soft-deleted records and improve data quality.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's also include in this same bullet that this update was made to correspond with the same update being applied to the upstream connector. We can then link the release notes.

Corrected the spelling of 'inbound_shipped_quantity' to 'inblound_shipped_quantity'.
@fivetran-savage fivetran-savage added the docs:ready Triggers the docs generator workflow. label Oct 21, 2025

@fivetran-joemarkiewicz fivetran-joemarkiewicz left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@fivetran-savage fivetran-savage merged commit 53a7085 into main Oct 21, 2025
8 checks passed
@fivetran-savage fivetran-savage deleted the feature/add_fivetran_deleted_column_and_filter branch October 21, 2025 18:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs:ready Triggers the docs generator workflow.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants