Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[FEA] Create Cloudera shim layer #951

Closed
tgravescs opened this issue Oct 15, 2020 · 1 comment · Fixed by #2423
Closed

[FEA] Create Cloudera shim layer #951

tgravescs opened this issue Oct 15, 2020 · 1 comment · Fixed by #2423
Labels
feature request New feature or request P0 Must have for release
Milestone
May 24 - Jun 4

Comments

@tgravescs
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
Cloudera version of Spark has a different version number and potentially pulls back fixes from later versions of Spark, we should create a shim layer and test it.

Reference #905 (comment) for more details
@tgravescs tgravescs added feature request New feature or request ? - Needs Triage Need team to review and classify labels Oct 15, 2020
@tgravescs tgravescs mentioned this issue Oct 15, 2020
Closed
@sameerz sameerz added P0 Must have for release and removed ? - Needs Triage Need team to review and classify labels Oct 20, 2020
@sameerz sameerz added P1 Nice to have for release and removed P0 Must have for release labels Nov 6, 2020
@tgravescs
Copy link
Collaborator Author

tgravescs commented Feb 12, 2021 •
edited
Loading

version numbers seem pretty straight forward where first part is spark version 3.0.1 and then they add in extra .X.X-Y* format (3.0.1.3.0.7110.0-81)
, need to do some testing to see if we want entire shim or if we do something like #409

@jlowe jlowe self-assigned this Mar 3, 2021
@revans2 revans2 mentioned this issue Apr 1, 2021
Open
38 tasks
@sameerz sameerz linked a pull request May 19, 2021 that will close this issue
Add cloudera shim layer #2423
Merged
@sameerz sameerz added P0 Must have for release and removed P1 Nice to have for release labels Jun 1, 2021
@sameerz sameerz added this to the May 24 - Jun 4 milestone Jun 1, 2021
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this issue Nov 30, 2023
@revans2
Fix memory leaks and test logging (NVIDIA#951)
5107ead 
Signed-off-by: Robert (Bobby) Evans <bobby@apache.org>
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
feature request New feature or request P0 Must have for release
Projects
None yet
Milestone
May 24 - Jun 4
Development

Successfully merging a pull request may close this issue.

Add cloudera shim layer sririshindra/spark-rapids
3 participants
@jlowe @tgravescs @sameerz