Skip to content

feat: add Iceberg v3 variant Parquet support - #1053

Draft
zhjwpku wants to merge 1 commit into
apache:mainfrom
zhjwpku:support_variant_type
Draft

zhjwpku wants to merge 1 commit into
apache:mainfrom
zhjwpku:support_variant_type

Conversation

@zhjwpku

@zhjwpku zhjwpku commented Oct 22, 2026

Copy link
Copy Markdown
Collaborator

Map variant schemas to Arrow and Parquet, read unshredded and shredded variants, and support explicit shredding targets when writing Parquet. Preserve nested projections and null semantics, validate variant values, and add coverage for round trips, residuals, filtering, and invalid input.

Pin Arrow PR #50252 to 0f16412bb1c39611aeed7393eba09e637f4d86fa with archive SHA256 verification. Require its variant APIs by default, force the pinned dependency in CI, and document the build options.

Map variant schemas to Arrow and Parquet, read unshredded and shredded
variants, and support explicit shredding targets when writing Parquet.
Preserve nested projections and null semantics, validate variant values,
and add coverage for round trips, residuals, filtering, and invalid input.

Pin Arrow PR #50252 to 0f16412bb1c39611aeed7393eba09e637f4d86fa
with archive SHA256 verification. Require its variant APIs by default,
force the pinned dependency in CI, and document the build options.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant