WIP(iox-10577): patched df upgrade 202-04-14 #12
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…che#9897) * Revert "use alias (apache#9894)" This reverts commit 9487ca0. * Use `struct` instead of `named_struct` when there are no aliases * Update docs * fmt
…pache#9958) * for debug finish remove print add space * fix clippy * finish * fix clippy
…/update-df-apr-week-1-2
…/update-df-apr-week-1-2
…/update-df-apr-week-1-2
…/update-df-apr-week-1-2
…/update-df-apr-week-1-2
…/update-df-apr-week-1-2
…/update-df-apr-week-1-3
…/update-df-apr-week-1-3
…/update-df-apr-week-1-3
…/update-df-apr-week-1-3
…/update-df-apr-week-1-3
…/update-df-apr-week-2
…/update-df-apr-week-2
appletreeisyellow
force-pushed
the
chunchun/update-df-apr-week-2
branch
from
4e92062 to
85e7454
Compare
appletreeisyellow
force-pushed
the
chunchun/update-df-apr-week-2
branch
from
85e7454 to
41c7f3d
Compare
…L prune (apache#10051) * Prune pages are all null in ParquetExec by row_counts and fix NOT NULL prune * fix clippy * Update datafusion/core/src/physical_optimizer/pruning.rs Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * Update datafusion/core/tests/parquet/page_pruning.rs Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * Update datafusion/core/tests/parquet/page_pruning.rs Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * Update datafusion/core/tests/parquet/page_pruning.rs Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * Update datafusion/core/tests/parquet/page_pruning.rs Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org> * remove allocate vec * better way avoid allocate vec * simply expr --------- Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
…/update-df-apr-week-2
…/update-df-apr-week-2
…/update-df-apr-week-2
…/update-df-apr-week-2
appletreeisyellow
changed the title
|
Is the patch list still up-to-date? Based on the PR dates, many of them should be merged in the 2024-04-14 |
@crepererum This patch list keeps a history of how we get to 2024-04-14 without breaking any CI pipeline. You are right! All the patches are merged in the 2024-04-24 I think it works the same to have the DataFusion version in IOx Cargo.toml to either point to this forked |
|
The upgrade is done. Closing |
wiedld
pushed a commit
that referenced
this pull request
Jul 17, 2024
* Add dialect param to use CHAR instead of TEXT for Utf8 unparsing for MySQL (#12) * Configurable data type instead of flag for Utf8 unparsing * Fix type in comment
wiedld
pushed a commit
that referenced
this pull request
Jul 31, 2024
* Add dialect param to use CHAR instead of TEXT for Utf8 unparsing for MySQL (#12) * Configurable data type instead of flag for Utf8 unparsing * Fix type in comment
# for free
to join this conversation on GitHub.
Already have an account?
# to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
All the patches below are included in the last commit of April 13, 2024 in DataFusion!
This PR is based on #5 and #10 that including the following patches:
Bringing us up to datafusion to 2024-04-14
PATCH: add the named struct patch
PATCH: include the patch request (per slack) for the upstream coalesce bug.
apache@4d85979 / coercion vec[Dictionary, Utf8] to Dictionary for coalesce function apache/datafusion#9958
PATCH: patch for the function re-writer, visiting subqueries within expressions.
apache@e161cd6 / fix
NamedStructField should be rewritten in OperatorToFunctionin subquery regression (changeApplyFunctionRewritesto use TreeNode API apache/datafusion#10032 (merged in DF on April 12, 2024)PATCH: cherry-picked apache@671cef8 / Prune pages are all null in ParquetExec by row_counts and fix NOT NULL prune apache/datafusion#10051 (merged in DF on April 13, 2024)