Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[BUG] CSV/JSON Parsing some float values results in overflow #124

Closed
revans2 opened this issue Jun 8, 2020 · 1 comment · Fixed by #4637
Closed

[BUG] CSV/JSON Parsing some float values results in overflow #124

revans2 opened this issue Jun 8, 2020 · 1 comment · Fixed by #4637
Assignees
@andygrove
Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin
Milestone
Jan 31 - Feb 11

Comments

@revans2
Copy link
Collaborator

revans2 commented Jun 8, 2020

Describe the bug
Parsing -3.4028234663852886e+38 as a float32 results in -Inf.

Steps/Code to reproduce bug
There is an integration test added for this.

Expected behavior
It should parse to the corresponding supported value.
@revans2 revans2 added bug Something isn't working ? - Needs Triage Need team to review and classify SQL part of the SQL/Dataframe plugin labels Jun 8, 2020
@sameerz sameerz added P2 Not required for release and removed ? - Needs Triage Need team to review and classify labels Aug 18, 2020
@revans2 revans2 mentioned this issue Apr 1, 2021
Open
38 tasks
@wbo4958 wbo4958 changed the title [BUG] CSV Parseing some float values results in overflow [BUG] CSV/JSON Parseing some float values results in overflow Jan 12, 2022
@wbo4958
Copy link
Collaborator

wbo4958 commented Jan 12, 2022

Json reader also has the same issue. Changed the title

@andygrove andygrove mentioned this issue Jan 26, 2022
Merged
7 tasks
@andygrove andygrove self-assigned this Jan 27, 2022
@andygrove andygrove added this to the Jan 10 - Jan 28 milestone Jan 27, 2022
@sameerz sameerz changed the title [BUG] CSV/JSON Parseing some float values results in overflow [BUG] CSV/JSON Parsing some float values results in overflow Jan 28, 2022
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this issue Nov 30, 2023
@nvauto
Merge pull request NVIDIA#124 from NVIDIA/bot-auto-merge-branch-22.04
863eebc 
[auto-merge] bot-auto-merge-branch-22.04 to branch-22.06 [skip ci] [bot]
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@andygrove andygrove

Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin
Projects
None yet
Milestone
Jan 31 - Feb 11
Development

Successfully merging a pull request may close this issue.

Improve support for reading CSV and JSON floating-point values andygrove/spark-rapids
4 participants
@andygrove @wbo4958 @revans2 @sameerz