Skip to content

test: verify changed-file scans skip unchanged data files - #113

Merged
osipovartem merged 1 commit into
embucket-sync-df55.0.0from
compat/changed-file-plan-count
Oct 15, 2026
Merged

osipovartem merged 1 commit into
embucket-sync-df55.0.0from
compat/changed-file-plan-count

Conversation

@osipovartem

Copy link
Copy Markdown

Summary

  • Add a physical-plan assertion to the existing Iceberg v3 row-lineage/change-scan test.
  • With three append snapshots, the full scan plans three data files while a change scan starting after the first snapshot plans only two. Existing row assertions confirm those two files contain the changed rows.
  • This verifies the changed-data-file I/O criterion in Embucket/rustice#358 without changing runtime code.

Verification

  • CARGO_INCREMENTAL=0 cargo +1.99.0 test -p datafusion_iceberg --lib test_v3_row_lineage_columns_are_synthesized_by_scan -- --nocapture (passed)
  • cargo +1.99.0 fmt --all and git diff --check (passed)
  • Independent read-only review: APPROVED.

@osipovartem
osipovartem merged commit b10c028 into embucket-sync-df55.0.0 Oct 15, 2026
2 checks passed
@osipovartem
osipovartem deleted the compat/changed-file-plan-count branch October 15, 2026 08:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant