Skip to content

Fix partitioned table planning - #6

Merged
rahil-c merged 2 commits into
rahil-c:scan-plan-model-parser-onlyfrom
amogh-jahagirdar:scan-plan-model-parser-only-cleanup
Nov 4, 2024
Merged

rahil-c merged 2 commits into
rahil-c:scan-plan-model-parser-onlyfrom
amogh-jahagirdar:scan-plan-model-parser-only-cleanup

Conversation

@amogh-jahagirdar

Copy link
Copy Markdown
Collaborator

No description provided.

@github-actions github-actions Bot added the CORE label Nov 3, 2024
@amogh-jahagirdar
amogh-jahagirdar force-pushed the scan-plan-model-parser-only-cleanup branch from 743c55d to 2d019f5 Compare November 3, 2024 16:31
@amogh-jahagirdar
amogh-jahagirdar force-pushed the scan-plan-model-parser-only-cleanup branch from 2d019f5 to ae5c475 Compare November 3, 2024 16:33
import org.apache.iceberg.expressions.Expression;
import org.apache.iceberg.expressions.ResidualEvaluator;

public class UnboundBaseFileScanTask extends BaseFileScanTask {

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is important, we should double check we're not making classes unnecessarily public. I cleaned up this case, but let's double check as we iterate.

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ack

Comment on lines +46 to +47
response.specsById() != null
|| (response.fileScanTasks() == null || response.fileScanTasks().isEmpty()),

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I fixed the condition for failing when specs by id is missing as well. We only need to have specs by Id defined when the response has file scan tasks, but it's not needed if there's just plan tasks.

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch thanks!

@rahil-c rahil-c left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @amogh-jahagirdar this looks clean!

@rahil-c
rahil-c merged commit 9f57240 into rahil-c:scan-plan-model-parser-only Nov 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants