Skip to content

Spark 3.4: Migrate source and spark tests - #12998

Merged
nastra merged 3 commits into
apache:mainfrom
tomtongue:migrate-spark3.4-source-and-spark
May 8, 2025
Merged

nastra merged 3 commits into
apache:mainfrom
tomtongue:migrate-spark3.4-source-and-spark

Conversation

@tomtongue

@tomtongue tomtongue commented May 7, 2025 •

Copy link
Copy Markdown
Contributor

Migrate Spark 3.4 tests based on JUnit 4 to Junit5 with AssertJ style. This is related to #7160

This PR migrates the following Spark 3.4 tests in the spark and spark.source packages to JUnit 5 with AssertJ:

spark:

  • TestFileRewriteCoordinator
  • TestSparkCatalogOperations
  • TestSparkWriteConf
  • TestSparkCachedTableCatalog

spark.source:

  • TestDataSourceOptions
  • TestIcebergSourceTablesBase
  • TestIcebergSourceHadoopTables
  • TestIcebergSourceHiveTables
  • TestMetadataTableReadableMetrics
  • TestMetadataTablesWithPartitionEvolution

And, additiona one such as TestMigrateTableAction which is only left in the actions package.

@github-actions github-actions Bot added the spark label May 7, 2025
assertThat(actual)
.singleElement()
.satisfies(
row -> {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: {} can be removed here

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for checking this, let me update this.

assertThat(actual)
.singleElement()
.satisfies(
row -> {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: {} can be removed here

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let me update this as well.

@nastra nastra left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with two nits, thanks @tomtongue

@nastra
nastra merged commit ada3d12 into apache:main May 8, 2025
@tomtongue

Copy link
Copy Markdown
Contributor Author

@nastra Thanks for the review!!

@tomtongue
tomtongue deleted the migrate-spark3.4-source-and-spark branch May 8, 2025 05:34
anuragmantri added a commit to anuragmantri/iceberg that referenced this pull request Jul 25, 2025
…pache#1588)

Co-authored-by: Tom Tanaka <43331405+tomtongue@users.noreply.github.com>
devendra-nr pushed a commit to devendra-nr/iceberg that referenced this pull request Dec 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants