Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[BUG] CSV comment after partial line does not throw out the comment #2066

Open
revans2 opened this issue Apr 1, 2021 · 0 comments
Open

[BUG] CSV comment after partial line does not throw out the comment #2066

revans2 opened this issue Apr 1, 2021 · 0 comments
Labels
bug Something isn't working

Comments

@revans2
Copy link
Collaborator

revans2 commented Apr 1, 2021

Describe the bug

~ Some metadata
~Comment at the start of the line 
make,model,year,price,comment,extra
"Ford","F-150","2020","30,135.15","Luxury/Fullsize"

~GMC,Sierra 1500,1997,20000,"No comment",
Chevy,D-Max,2015,"5,000.10"
~ Last comment line

When parsed with the comment char ~ results in the last line being

"Chevy","D-Max","2015","5,000.10","~ Last comment line",""

This is not what happens with Spark.

Steps/Code to reproduce bug
There is an integration test already for this.test_basic_read for trucks-comments.csv

@revans2 revans2 added bug Something isn't working ? - Needs Triage Need team to review and classify labels Apr 1, 2021
@revans2 revans2 mentioned this issue Apr 1, 2021
38 tasks
@sameerz sameerz removed the ? - Needs Triage Need team to review and classify label Apr 6, 2021
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants