Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[SPARK-39840][SQL][PYTHON] Factor PythonArrowInput out as a symmetry to PythonArrowOutput #6172

Open
amahussein opened this issue Aug 1, 2022 · 0 comments
Labels
audit_3.4.0 Audit related tasks for 3.4.0 P1 Nice to have for release

Comments

@amahussein
Copy link
Collaborator

amahussein commented Aug 1, 2022

Spark-context

apache/spark@2e1467f748

What changes were proposed in SPARK pull request?

Similar to the refactor done PythonArrowOutput in SPARK-29317, this PR factors the Arrow input code path out as PythonArrowInput

Why are the changes needed in Spark?

Code-refactor

Does this PR introduce any user-facing change?

No

Why it might affect RAPIDS?

Currently, We define a trait GpuPythonArrowOutput which is used
in declaring class GpuArrowPythonRunner

We will need to change GpuArrowPythonRunner to be aware of the two traits

class GpuArrowPythonRunner(

) with GpuPythonArrowInput GpuPythonArrowOutput { }

Impact on Testing?

No

Requires Doc update?

No

@amahussein amahussein added ? - Needs Triage Need team to review and classify audit_3.4.0 Audit related tasks for 3.4.0 labels Aug 1, 2022
@sameerz sameerz added P1 Nice to have for release and removed ? - Needs Triage Need team to review and classify labels Aug 2, 2022
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
audit_3.4.0 Audit related tasks for 3.4.0 P1 Nice to have for release
Projects
None yet
Development

No branches or pull requests

2 participants