You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Spark does not have a lot of really good CSV tests. They use a third party CSV parser https://github.com/uniVocity/univocity-parsers/ and end up relying on it for a lot of the testing. We should try to port over as many tests as possible from these to our tests to help augment corner case testing. We should concentrate on tests that are for the default settings in Spark, but we should also add in as many tests as possible and verify that we fall back if they do not work, or mark them as xfail with the issues that would fix that problem.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Spark does not have a lot of really good CSV tests. They use a third party CSV parser https://github.com/uniVocity/univocity-parsers/ and end up relying on it for a lot of the testing. We should try to port over as many tests as possible from these to our tests to help augment corner case testing. We should concentrate on tests that are for the default settings in Spark, but we should also add in as many tests as possible and verify that we fall back if they do not work, or mark them as xfail with the issues that would fix that problem.
The text was updated successfully, but these errors were encountered: