Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[BUG] from_json and scan json do not replace \u escaped chars in nested data returned as a string. #11632

Open
revans2 opened this issue Oct 18, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@revans2
Copy link
Collaborator

revans2 commented Oct 18, 2024

Describe the bug
In nested data that is being returned as a string column in from_json or json scan if a string contains a \u escaped character sequence in it Spark will replace that \u sequence with the smallest replacement possible. It may be the regular characters or a smaller escape sequence like \r or \n. Our code does not do this.

@revans2 revans2 added ? - Needs Triage Need team to review and classify bug Something isn't working labels Oct 18, 2024
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Oct 22, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants