Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

[BUG] CSV parser does not support special case date/timestamp strings #136

Open
revans2 opened this issue Jun 9, 2020 · 1 comment
Open

[BUG] CSV parser does not support special case date/timestamp strings #136

revans2 opened this issue Jun 9, 2020 · 1 comment
Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin

Comments

@revans2
Copy link
Collaborator

revans2 commented Jun 9, 2020

Describe the bug
When spark parses dates and timestamps with CSV it supports some special case strings. Things like

  • "epoch"
  • "now"
  • "today"
  • "tomorrow"
  • "yesterday"

No idea why someone wants their data in a CSV file to change each time it is read in, but spark supports it, so we should too.
@revans2 revans2 added bug Something isn't working ? - Needs Triage Need team to review and classify SQL part of the SQL/Dataframe plugin labels Jun 9, 2020
@revans2 revans2 changed the title [BUG] CSV parser does not support special case strings [BUG] CSV parser does not support special case date/timestamp strings Jun 9, 2020
@revans2
Copy link
Collaborator Author

revans2 commented Jun 9, 2020

It should be noted that for legacy mode date/timestamp parsing these values are not supported either, so it is likely a low priority to support them.

@sameerz sameerz added P2 Not required for release and removed ? - Needs Triage Need team to review and classify labels Aug 18, 2020
@revans2 revans2 mentioned this issue Apr 1, 2021
Open
38 tasks
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this issue Nov 30, 2023
@nvauto
Merge pull request NVIDIA#136 from NVIDIA/bot-auto-merge-branch-22.04
7ef5bca 
[auto-merge] bot-auto-merge-branch-22.04 to branch-22.06 [skip ci] [bot]
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
bug Something isn't working P2 Not required for release SQL part of the SQL/Dataframe plugin
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@revans2 @sameerz