Skip to content

Feat: ability to read from GCS buckets#156

Merged
prakharmathur82 merged 7 commits intodagger-parquet-file-processingfrom
read-from-gcs
Jun 1, 2022
Merged

Feat: ability to read from GCS buckets#156
prakharmathur82 merged 7 commits intodagger-parquet-file-processingfrom
read-from-gcs

Conversation

@MayurGubrele
Copy link
Member

  • Adding Hadoop-client and gcs-connector in dependenciesCommonJar
  • Adding a sample core-site.xml with Hadoop configurations required
  • Bump up dependenciesVersion to 0.2.2

@prakharmathur82 prakharmathur82 merged commit 022ba94 into dagger-parquet-file-processing Jun 1, 2022
@prakharmathur82 prakharmathur82 deleted the read-from-gcs branch June 1, 2022 06:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: Add support for reading files from a GCS bucket for Parquet Data Source

2 participants