Skip to content

[VL] Spark 4.x: CastTransformer does not pass per-expression timezone for timestamp formatting #11918

Closed

Description

@baibaichen

Backend

VL (Velox)

Bug description

CastTransformer does not pass per-expression timezone through Substrait. When casting timestamp to string, Velox does not use the session timezone, producing output that differs from Spark's expected format.

This is a Substrait architecture limitation that requires changes at the C++ layer.

Affects both Spark 4.0 and 4.1.

Parent issue: #11550

Impact

Suite Failures spark40 spark41
GlutenToPrettyStringSuite 1 ("Timestamp as pretty strings") 🔴 🔴
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions