Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Consider using with_skip_validation for shuffle file reading #1189

Open
milenkovicm opened this issue Feb 27, 2025 · 0 comments
Open

Consider using with_skip_validation for shuffle file reading #1189

milenkovicm opened this issue Feb 27, 2025 · 0 comments
Labels
enhancement New feature or request

Comments

@milenkovicm
Copy link
Contributor

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Improve shuffle reading, with apache/arrow-rs#7120 merged consider using it for shuffle files.

Describe the solution you'd like

Change shuffle reader to utilise new api.

Describe alternatives you've considered

Keep everything as it is

Additional context

@milenkovicm milenkovicm added the enhancement New feature or request label Feb 27, 2025
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant