Skip to content
This repository was archived by the owner on Dec 15, 2021. It is now read-only.

Configuration parameter for Staging dataset id#63

Merged
nevillelyh merged 1 commit into
spotify:masterfrom
Tapad:feature/user-defined-temp-datasetid
Apr 17, 2018
Merged

Configuration parameter for Staging dataset id#63
nevillelyh merged 1 commit into
spotify:masterfrom
Tapad:feature/user-defined-temp-datasetid

Conversation

@pcejrowski

Copy link
Copy Markdown
Contributor

Adding configuration parameter bq.staging_dataset.id which allows to choose staging Dataset ID which stores results of SELECT ... statements.

Currently existing prefix + location doesn't allow to specify the full bucket name.

@nevillelyh nevillelyh merged commit a0ecb3f into spotify:master Apr 17, 2018
@pcejrowski pcejrowski deleted the feature/user-defined-temp-datasetid branch April 19, 2018 07:29
@pcejrowski

Copy link
Copy Markdown
Contributor Author

@nevillelyh Do you have any plans for releasing the newest version?

lverzosa added a commit to lverzosa/spark-bigquery that referenced this pull request Apr 26, 2019
lverzosa added a commit to lverzosa/spark-bigquery that referenced this pull request May 1, 2019
* Updating versions

* Revert "Update README.md"

This reverts commit 55c75ec.

* Revert "Added support for Spark 2.4.0 and Scala 2.12. Adjusted code slightly since Databricks Avro library moved into Spark with small syntax changes. (spotify#69)"

This reverts commit ee9136b.

* Revert "Update README.md (spotify#68)"

This reverts commit a2d5a63.

* Revert "Create daily partitioned table when necessary (spotify#67)"

This reverts commit f5b4815.

* Revert "Add maintenance mode notice"

This reverts commit ab8fd9c.

* Revert "Enable user to specify write options, hinting about issues with nested records (spotify#59)"

This reverts commit 7f65455.

* Revert "Configuration parameter for intermediate dataset id (spotify#63)"

This reverts commit a0ecb3f.

* Revert "Make a defensive copy to stop polution of sparkconf (spotify#60)"

This reverts commit ffcd9a6.

* Revert "Support setting query job priority (spotify#54)"

This reverts commit 07e012a.

* Fixing GoogleCredentials to use supplied file
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants