Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[FLINK-36648] Bump Flink version to Flink 2.0.0 #140

Merged
merged 3 commits into from
Mar 28, 2025

Conversation

lvyanquan
Copy link
Contributor

@lvyanquan lvyanquan commented Dec 4, 2024

Bump Flink version to Flink 2.0-preview1.
This is required as flink-example module and flink-e2e-to-e2e-tests need to use Kafka connector for testing, and some other project like Apache Paimon also rely on Kafka connector in test.

This pr is based on #139 to remove many deprecated classes.
And as there is a bug in SinkTestSuiteBase/SourceTestSuiteBase in Flink 2.0-preview1 as https://issues.apache.org/jira/browse/FLINK-36845 described, temporarily commented relevant test as this will need to wait for a new release of Flink(Or we can directly cover these classes).

@leonardBang
Copy link
Contributor

@PatrickRen Would you like to review this PR when you have time?

Copy link
Contributor

@PatrickRen PatrickRen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lvyanquan Thanks for the awesome contribution! I found more classes that can be removed.

I simply searched keyword deprecated in the repo, and there are still some appearances. Could you check them all?

Also I see a lot of empty files under flink-connector-kafka/archunit-violations. I think we should remove them as well.

@lvyanquan
Copy link
Contributor Author

Also I see a lot of empty files under flink-connector-kafka/archunit-violations. I think we should remove them as well.

Remove some empty files, and remain some files which were referenced in stored.rules.

@lvyanquan
Copy link
Contributor Author

E2e case would fail, as there is a bug in Collect Sink in 2.0-preview version.

Should I delete or comment these cases out? WDYT @PatrickRen.

@lvyanquan lvyanquan requested a review from PatrickRen January 14, 2025 06:49
@lvyanquan
Copy link
Contributor Author

Hi, @PatrickRen can you help to review again and help to complete this PR?

@lvyanquan
Copy link
Contributor Author

Rebase master to solve conflict.

@lvyanquan
Copy link
Contributor Author

Hi @PatrickRen. I have made adjustments based on your previous suggestion. Can you help confirm if there are any other suggestions?
Since this PR is likely to conflict with other PRs, it will be troublesome to rebase multiple times in the future. and @AHeise, I've addressed the comments in #139 too, do you have time to help review the remaining parts?

flink: [ 1.20.0 ]
jdk: [ '8, 11, 17, 21' ]
flink: [ 2.0-preview1 ]
jdk: [ '11, 17, 21' ]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since Flink 2.0 is built on Java 17 can we simply build this there as well? Then we can remove Java 11 from the CI matrix

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Addressed it.

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also Flink is out of the preview version now right.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

@lvyanquan lvyanquan marked this pull request as draft March 12, 2025 01:57
@lvyanquan lvyanquan marked this pull request as ready for review March 12, 2025 06:53
@leonardBang leonardBang changed the title [FLINK-36648] Bump Flink version to Flink 2.0-preview1 [FLINK-36648] Bump Flink version to Flink 2.0-SNAPSHOT Mar 18, 2025
@leonardBang leonardBang changed the title [FLINK-36648] Bump Flink version to Flink 2.0-SNAPSHOT [FLINK-36648] Bump Flink version to Flink 2.0.0 Mar 25, 2025
@lvyanquan
Copy link
Contributor Author

Rebase and rearrange to make commit message more clearly.

@lvyanquan
Copy link
Contributor Author

lvyanquan commented Mar 27, 2025

Hi, @PatrickRen @leonardBang @gyfora @prshnt could you take a look at this as Flink 2.0.0 was released recently.

@mlegore
Copy link

mlegore commented Mar 27, 2025

I hope this can be released soon! Would love to move to 2.0 for our project

Copy link
Contributor

@leonardBang leonardBang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @lvyanquan for the great work, LGTM

@@ -30,7 +30,7 @@ jobs:
strategy:
matrix:
flink_branches: [{
flink: 1.20-SNAPSHOT,
flink: 2.1-SNAPSHOT,
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what do you think about using the main branch with the stable release of Flink and not the snapshot?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tend to add both snapshot and stable versions to ensure compatibility, and this runs weekly with minimal resource overhead.

@prshnt
Copy link

prshnt commented Mar 27, 2025

Thanks @lvyanquan for the PR and taking care of this.

@leonardBang
Copy link
Contributor

CI passed, merging...

@leonardBang leonardBang merged commit c280545 into apache:main Mar 28, 2025
1 check passed
leonardBang pushed a commit that referenced this pull request Mar 28, 2025
Copy link

boring-cyborg bot commented Mar 28, 2025

Awesome work, congrats on your first merged pull request!

# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants