comparing input_data_version with upstream asset data_version #19282
Replies: 2 comments
-
Safest option was to repurpose |
Beta Was this translation helpful? Give feedback.
0 replies
-
I have the same issue, it felt quite surprising that the I will try to look into the |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
I have an upstream asset (
up_asset
) that sets a user defined data_version in theOutput
on materialization, along with an explicit code_version='v1' . I can see both of these value in the UI after materializingup_asset
. However, when a downstream assetdown_asset
materializes, the value ofinput_data_version/up_asset
that is generated, is not equal to the data_versionof
up_asset`.In the code for
down_asset
, I want to determine if the up_stream has changed since the last materialization ofdown_asset
.How can I compare
input_data_version/up_asset
from the last materialization ofdown_asset
, with thedagster/data_version
anddagster/code_version
from most recent materialization ofup_asset
.Note both assets are partitioned daily
Beta Was this translation helpful? Give feedback.
All reactions