Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[BUG] CSV Parseing Inf, -Inf, and NaN not supported #125

Open
revans2 opened this issue Jun 8, 2020 · 3 comments
Open

[BUG] CSV Parseing Inf, -Inf, and NaN not supported #125

revans2 opened this issue Jun 8, 2020 · 3 comments
Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin

Comments

@revans2
Copy link
Collaborator

revans2 commented Jun 8, 2020

Describe the bug
Parsing these values results in a null.

Steps/Code to reproduce bug
There are integration tests added .

Expected behavior
Ideally we would be able to support positiveInf, negativeInf, and nanValue CSV parser options.
@revans2 revans2 added bug Something isn't working ? - Needs Triage Need team to review and classify SQL part of the SQL/Dataframe plugin labels Jun 8, 2020
@sameerz sameerz added P2 Not required for release and removed ? - Needs Triage Need team to review and classify labels Aug 18, 2020
@revans2
Copy link
Collaborator Author

revans2 commented Apr 1, 2021 •
edited
Loading

Inf and -Inf are now partially supported, but they are not configurable.

@revans2 revans2 mentioned this issue Apr 1, 2021
Open
38 tasks
@wbo4958
Copy link
Collaborator

wbo4958 commented Jan 12, 2022

JSON also can't parse NaN.

@andygrove andygrove mentioned this issue Jan 26, 2022
Merged
7 tasks
@andygrove
Copy link
Contributor

I filed #4644 for supporting positiveInf, negativeInf, and nanValue CSV parser options to reduce the scope of this issue.

@andygrove andygrove self-assigned this Jan 27, 2022
@andygrove andygrove removed their assignment Feb 10, 2022
@sameerz sameerz removed this from the Jan 31 - Feb 11 milestone Feb 15, 2022
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this issue Nov 30, 2023
@nvauto
Update submodule cudf to 76c772e (NVIDIA#125)
0ccf6c7 
Signed-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@andygrove @wbo4958 @revans2 @sameerz