Skip to content

Conversation

@subkanthi
Copy link
Collaborator

2_date_cols.parquet: processing
2026-01-13 08:01:47 [-6-thread-1] WARN c.a.i.c.internal.cmd.Insert > 2_date_cols.parquet: File contains multiple partition values for 'end_date' (min: 20468, max: 20512). Falling back to full scan (slow)
2026-01-13 08:01:47 [-6-thread-1] INFO c.a.i.c.internal.cmd.Insert > 2_date_cols.parquet: partitioning
2026-01-13 08:01:47 [-6-thread-1] INFO c.a.i.c.internal.cmd.Insert > 2_date_cols.parquet: adding data file: s3://bucket1/test/test12/data/end_date_day=2026-01-15/1768312907036-39a60eac0b0284c15751e9494ca3b1e59eb909cd09cc6d0b4b35075721be9863-part.parquet
2026-01-13 08:01:47 [-6-thread-1] INFO c.a.i.c.internal.cmd.Insert > 2_date_cols.parquet: adding data file: s3://bucket1/test/test12/data/end_date_day=2026-02-28/1768312907036-39a60eac0b0284c15751e9494ca3b1e59eb909cd09cc6d0b4b35075721be9863-part.parquet
2026-01-13 08:01:47 [main] INFO o.a.i.SnapshotProducer > Committed snapshot 2985048395570678302 (MergeAppend)

--force-no-copy


2026-01-13 08:02:35 [-6-thread-1] INFO c.a.i.c.internal.cmd.Insert > 2_date_cols.parquet: processing
2026-01-13 08:02:35 [main] ERROR com.altinity.ice.cli.Main > Fatal
java.io.IOException: Error processing file(s)
	at com.altinity.ice.cli.internal.cmd.Insert.run(Insert.java:231)
	at com.altinity.ice.cli.Main.insert(Main.java:447)
	at com.altinity.ice.cli.Main.lambda$1(Main.java:692) [9 skipped]
	at com.altinity.ice.cli.Main.main(Main.java:699) [1 skipped]
Caused by: java.io.IOException: Error processing 2_date_cols.parquet
	at com.altinity.ice.cli.internal.cmd.Insert.lambda$run$2(Insert.java:215)
 [4 skipped]
Caused by: org.apache.iceberg.exceptions.BadRequestException: 2_date_cols.parquet: File contains multiple partition values for 'end_date' (min: 20468, max: 20512). In no-copy mode, each file must contain data for only one partition value
	at com.altinity.ice.cli.internal.cmd.Insert.processFile(Insert.java:430)
	at com.altinity.ice.cli.internal.cmd.Insert.lambda$run$2(Insert.java:194)
	... 4 common frames omitted

…opy for file(row group/block) with multiple partitions
…opy for file(row group/block) with multiple partitions
@subkanthi subkanthi requested a review from shyiko January 13, 2026 14:32
Copy link

@xieandrew xieandrew left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me

@subkanthi subkanthi merged commit cd41fa8 into master Jan 16, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improve the error message when user attempts to perform a no-copy with multiple partitions in the same row group(block)

3 participants