Skip to content

test: verify nested Iceberg field IDs through Parquet scans - #115

Merged
osipovartem merged 1 commit into
embucket-sync-df55.0.0from
test-parquet-nested-id-evolution
Oct 15, 2026
Merged

osipovartem merged 1 commit into
embucket-sync-df55.0.0from
test-parquet-nested-id-evolution

Conversation

@osipovartem

Copy link
Copy Markdown

Summary

  • Write LIST and MAP<STRING, STRUCT> values to an Iceberg Parquet data file.
  • Evolve the schema by renaming and reordering nested fields and adding nullable children.
  • Read the unchanged file using the current schema and assert values, nulls, container offsets, and map keys.

Verification

  • cargo +1.99.0 test -p datafusion_iceberg --test nested_schema_evolution
  • cargo +1.99.0 clippy -p datafusion_iceberg --test nested_schema_evolution (with existing Rust 1.99 lint exceptions)
  • cargo +1.99.0 fmt --all --check
  • Independent read-only review: approved, no blocking findings.

Test-only change; live Horizon/SPCS validation remains separate.

@osipovartem
osipovartem merged commit f955faa into embucket-sync-df55.0.0 Oct 15, 2026
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant