We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? # to your account
Serializing a physical plan to bytes and then recreating it produces a different output. This was observed on TPCH query 3.
Note though, that it was also observed that if you remove the config option: datafusion.execution.parquet.pushdown_filters the discrepancy goes away.
datafusion.execution.parquet.pushdown_filters
I'll work up a PR to improve the round trip tests to hopefully isolate the problem.
A reproducible example is here https://github.com/robtandy/datafusion-physical-plan-round-trip/blob/main/src/main.rs
Physical plans should produce the same output after a round trip to proto and back.
No response
The text was updated successfully, but these errors were encountered:
This certainly sounds not good (and an excellent find)
Sorry, something went wrong.
45.0.0
Added to the list of things to look at before release on
Looks like the way we serialize pushdown_filters is wrong. It's true in the initial struct but false after deserialization
pushdown_filters
take
parquet_options
datafusion-proto
target
DmlStatement
blaginin
Successfully merging a pull request may close this issue.
Describe the bug
Serializing a physical plan to bytes and then recreating it produces a different output. This was observed on TPCH query 3.
Note though, that it was also observed that if you remove the config option:
datafusion.execution.parquet.pushdown_filters
the discrepancy goes away.I'll work up a PR to improve the round trip tests to hopefully isolate the problem.
To Reproduce
A reproducible example is here
https://github.com/robtandy/datafusion-physical-plan-round-trip/blob/main/src/main.rs
Expected behavior
Physical plans should produce the same output after a round trip to proto and back.
Additional context
No response
The text was updated successfully, but these errors were encountered: