Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Support cudf pin with rapids-cmake #1877

Merged
merged 5 commits into from
Mar 21, 2024

Conversation

GaryShen2008
Copy link
Collaborator

@GaryShen2008 GaryShen2008 commented Mar 18, 2024

  • Set cuDF build with pinned rapids-cmakes in POM
  • Use git download the rapids-cmake in cudf build so that we can get the rapids-cmake's SHA
  • Update ci/submodule-sync.sh to get the latest cuDF commit and with the latest rapids-cmake

Close #1666

Main code is copied from robertmaynard@85f5a29

@GaryShen2008
Copy link
Collaborator Author

build

Copy link
Contributor

@jlowe jlowe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For proper attribution and to make this a bit easier to review vs. the original source, I think this PR should have been done as a cherry pick of the original reference commit to preserve the original author and then commits added to that (e.g.: fixing copyrights, adding the pinned json from the build, etc.)

robertmaynard and others added 2 commits March 19, 2024 11:10
So that we can get SHA
Use same format of CopyRight
Use cudf/rapids_config.cmake which is renamed from fetch_rapids.cmake
Update versions to latest

Signed-off-by: Gary Shen <gashen@nvidia.com>
Signed-off-by: Gary Shen <gashen@nvidia.com>
@GaryShen2008
Copy link
Collaborator Author

build

@GaryShen2008
Copy link
Collaborator Author

build

1 similar comment
@GaryShen2008
Copy link
Collaborator Author

build

since the second one can commit it at once

Signed-off-by: Gary Shen <gashen@nvidia.com>
@jlowe
Copy link
Contributor

jlowe commented Mar 20, 2024

build

@GaryShen2008 GaryShen2008 merged commit d8771da into NVIDIA:branch-24.04 Mar 21, 2024
3 checks passed
jlowe added a commit to jlowe/spark-rapids-jni that referenced this pull request Mar 25, 2024
This reverts commit d8771da.

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
jlowe added a commit that referenced this pull request Mar 25, 2024
This reverts commit d8771da.

Signed-off-by: Jason Lowe <jlowe@nvidia.com>
jlowe pushed a commit to jlowe/spark-rapids-jni that referenced this pull request Mar 26, 2024
* Use rapids-cmake to pin cudf dependencies to known working SHA1's

* Use git download rapids-cmake

So that we can get SHA
Use same format of CopyRight
Use cudf/rapids_config.cmake which is renamed from fetch_rapids.cmake
Update versions to latest

Signed-off-by: Gary Shen <gashen@nvidia.com>

* Commit cudf to the latest code before mvn verify

Signed-off-by: Gary Shen <gashen@nvidia.com>

* Remove the first commit of cudf

since the second one can commit it at once

Signed-off-by: Gary Shen <gashen@nvidia.com>

---------

Signed-off-by: Gary Shen <gashen@nvidia.com>
Co-authored-by: Robert Maynard <rmaynard@nvidia.com>
jlowe added a commit that referenced this pull request Apr 2, 2024
* Support cudf pin with rapids-cmake (#1877)

* Use rapids-cmake to pin cudf dependencies to known working SHA1's

* Use git download rapids-cmake

So that we can get SHA
Use same format of CopyRight
Use cudf/rapids_config.cmake which is renamed from fetch_rapids.cmake
Update versions to latest

Signed-off-by: Gary Shen <gashen@nvidia.com>

* Commit cudf to the latest code before mvn verify

Signed-off-by: Gary Shen <gashen@nvidia.com>

* Remove the first commit of cudf

since the second one can commit it at once

Signed-off-by: Gary Shen <gashen@nvidia.com>

---------

Signed-off-by: Gary Shen <gashen@nvidia.com>
Co-authored-by: Robert Maynard <rmaynard@nvidia.com>

* Update cudf pin versions

Signed-off-by: Jason Lowe <jlowe@nvidia.com>

* Update pin versions

Signed-off-by: Jason Lowe <jlowe@nvidia.com>

---------

Signed-off-by: Gary Shen <gashen@nvidia.com>
Signed-off-by: Jason Lowe <jlowe@nvidia.com>
Co-authored-by: Gary Shen <gashen@nvidia.com>
Co-authored-by: Robert Maynard <rmaynard@nvidia.com>
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] The build can be broken due to dependency changes of cudf
3 participants