Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[AUDIT][SPARK-42521][SQL] Add NULLs for INSERTs with user-specified lists of fewer columns than the target table #8118

Open
abellina opened this issue Apr 14, 2023 · 1 comment
Open

[AUDIT][SPARK-42521][SQL] Add NULLs for INSERTs with user-specified lists of fewer columns than the target table #8118

abellina opened this issue Apr 14, 2023 · 1 comment
Labels
audit_3.4.0 Audit related tasks for 3.4.0 feature request New feature or request

Comments

@abellina
Copy link
Collaborator

This changed introduced some default value handling in Spark 3.4.0 that I do not think we are testing, and I am not 100% sure how this works with our writers. So I figure to file this issue for follow up, but I am not sure if there is anyhting to do here yet.

Spark reference: apache/spark@d8fa508e53
@abellina abellina added feature request New feature or request ? - Needs Triage Need team to review and classify audit_3.4.0 Audit related tasks for 3.4.0 labels Apr 14, 2023
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Apr 18, 2023
@mattahrens
Copy link
Collaborator

Scope: validate behavior that Spark is inserting nulls ahead of our plugin. If not, we may need code changes on our side.

@NVnavkumar NVnavkumar mentioned this issue May 17, 2023
Open
27 tasks
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
audit_3.4.0 Audit related tasks for 3.4.0 feature request New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@abellina @mattahrens