Skip to content

[Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules - #24992

Merged
aromanenko-dev merged 13 commits into
apache:masterfrom
aromanenko-dev:avro_24756
Feb 22, 2023
Merged

[Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules#24992
aromanenko-dev merged 13 commits into
apache:masterfrom
aromanenko-dev:avro_24756

Conversation

@aromanenko-dev

@aromanenko-dev aromanenko-dev commented Jan 13, 2023

Copy link
Copy Markdown
Contributor

Make all Beam Java SDK modules, that depend on Avro, use Avro extension instead of Avro from core.

It should not introduce any breaking changes for users.

Closes #24748


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI.

@olehborysevych

Copy link
Copy Markdown
Contributor

@aromanenko-dev looking into failing Example check. Sorry for inconvenience (

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run Java_Kafka_IO_Direct PreCommit

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run SQL_Java17 PreCommit

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run Java_GCP_IO_Direct PreCommit

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run SQL PreCommit

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run SQL_Java11 PreCommit

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run Java_Kafka_IO_Direct PreCommit

@github-actions github-actions Bot added the gcp label Jan 17, 2023
@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run SQL PreCommit

@Abacn

Abacn commented Feb 20, 2023

Copy link
Copy Markdown
Contributor

Java11/Java17 test failures are due to #23210, see investigation done in #25566

@aromanenko-dev

aromanenko-dev commented Feb 21, 2023

Copy link
Copy Markdown
Contributor Author

@Abacn Do you have an idea when it can be fixed? Do you think we have to wait for a fix before merging this one?

@Abacn

Abacn commented Feb 21, 2023

Copy link
Copy Markdown
Contributor

Thanks @aromanenko-dev for pinning. I think we can proceed given that those failures are understood to be not related. I also opened #25566

@Abacn

Abacn commented Feb 21, 2023

Copy link
Copy Markdown
Contributor

Run SQL_Java11 PreCommit

@Abacn

Abacn commented Feb 21, 2023

Copy link
Copy Markdown
Contributor

Run SQL_Java17 PreCommit

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

retest this please

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run Java_GCP_IO_Direct PreCommit

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run Java_Kafka_IO_Direct PreCommit

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

Run Java_HCatalog_IO_Direct PreCommit

@aromanenko-dev

Copy link
Copy Markdown
Contributor Author

I merge this one since failed checks are not related and all others are green.

@aromanenko-dev
aromanenko-dev merged commit 95a6566 into apache:master Feb 22, 2023
lostluck pushed a commit to lostluck/beam that referenced this pull request Feb 22, 2023
…odules (apache#24992)

* Use "extensions/avro" instead of avro from"core" in Java SDK modules

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/kafka

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/google-cloud-platform

* Resolve rebase conflicts

* Use "extensions/avro" for Dataflow runner

* Use "extensions/avro" for core-construction runner

* Add avro extension as a dependency for direct runner

* Copy Avro-related tests to Avro extension

* Address review comments

* Depend javaPreCommit on extensions:avro

* Address review comments

* Revert CountingSource.java

* Up-to-date Avro usages
ruslan-ikhsan pushed a commit to akvelon/beam that referenced this pull request Mar 10, 2023
…odules (apache#24992)

* Use "extensions/avro" instead of avro from"core" in Java SDK modules

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/kafka

* Use "extensions/avro" instead of avro from"core" in sdks/java/io/google-cloud-platform

* Resolve rebase conflicts

* Use "extensions/avro" for Dataflow runner

* Use "extensions/avro" for core-construction runner

* Add avro extension as a dependency for direct runner

* Copy Avro-related tests to Avro extension

* Address review comments

* Depend javaPreCommit on extensions:avro

* Address review comments

* Revert CountingSource.java

* Up-to-date Avro usages
@aromanenko-dev
aromanenko-dev deleted the avro_24756 branch March 20, 2023 15:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Task]: [Avro] Use "extensions/avro" instead of avro from"core" in Java SDK modules

4 participants