Skip to content

Reading Iceberg tables show 0.0B for the Input column on Spark's executor UI #5264

Description

@hsiang-c

Describe the bug

spark.comet.scan.icebergNative.enabled=true
Image

spark.comet.scan.icebergNative.enabled=false

Image

Steps to reproduce

SELECT COUNT(DISTINCT(col_string)) FROM $ICEBERG_TABLE WHERE ... (predicates)

Expected behavior

CometIcebergNativeScan should also report input size per executor.

Additional context

No response

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

area:scanParquet scan / data readingbugSomething isn't workingpriority:lowMinor issues, test failures, tooling, cosmetic

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions