Skip to content

Core: Fix rewrite_position_delete_files failure with array/map columns#15632

Open
szehon-ho wants to merge 7 commits intoapache:mainfrom
szehon-ho:fix_rewrite_pos_delete_nested
Open

Core: Fix rewrite_position_delete_files failure with array/map columns#15632
szehon-ho wants to merge 7 commits intoapache:mainfrom
szehon-ho:fix_rewrite_pos_delete_nested

Conversation

@szehon-ho
Copy link
Member

@szehon-ho szehon-ho commented Mar 14, 2026

An alternate to #15079, avoid ExpressionUtils.identitySpec() altogether for this case to construct the metadata column's residual filter.

Fixes: #15080

@szehon-ho szehon-ho force-pushed the fix_rewrite_pos_delete_nested branch from 9afddd3 to a07da0f Compare March 14, 2026 04:31
@szehon-ho szehon-ho force-pushed the fix_rewrite_pos_delete_nested branch from fee128f to 852cc81 Compare March 14, 2026 08:06
@szehon-ho szehon-ho closed this Mar 16, 2026
@szehon-ho szehon-ho reopened this Mar 16, 2026
@szehon-ho
Copy link
Member Author

szehon-ho commented Mar 17, 2026

@amogh-jahagirdar @huaxingao this was on the mailing thread as a request for Iceberg 1.10.2. can you guys help review? Thanks

@huaxingao
Copy link
Contributor

Thanks @szehon-ho for the PR! It might be worth adding a unit test for extractByIdInclusive in TestExpressionUtil. Other than that, the fix looks correct to me.

- Add blank lines after control blocks (review)
- Add TestExpressionUtil coverage for extractByIdInclusive
- Add nested struct/list/map cases
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

rewrite_position_delete_files fails with ValidationException for tables with array columns

2 participants