Skip to content

GoogleCloudStorageToBigQueryOperator reads string as a list in parameter source_objects #16008

Description

@stavhaco

Apache Airflow version:1.10.12
Environment: google cloud composer

What happened:
When using GoogleCloudStorageToBigQueryOperator and providing string as parameter source_objects, the process is iterating on a the string as a valid list.
For example -
cloud_storage_to_bigquery = GoogleCloudStorageToBigQueryOperator( bucket = 'bucket', source_objects = 'abc', )
Will result in looking into the sources: bucket/a, bucket/b, bucket/c.

What you expected to happen:
Throw an error on type (string instead of list).

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions