Skip to content

Record ignoring table because of ... errors from crawl_tables step for later analysis #231

@nfx

Description

@nfx

Corner-case errors are not surfaced outside of the crawl_tables task run. These errors are rather rare conditions, but still it's good to surface them somewhere:

  • java.lang.IllegalArgumentException: Error: type expected at the position 34508 ...
  • org.apache.spark.SparkException: [CANNOT_RECOGNIZE_HIVE_TYPE] Cannot recognize hive type string: ...
  • java.lang.UnsupportedOperationException: Parquet does not support timestamp. See HIVE-6384
  • java.lang.RuntimeException: MetaException(message:java.lang.ClassNotFoundException Class org.apache.hadoop.hive.serde2.OpenCSVSerde not found)
image

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions