[SPARK-39857][SQL] V2ExpressionBuilder uses the wrong LiteralValue data type for In predicate #6180
Labels
audit_3.3.0
Audit related tasks for 3.3.0
audit_3.4.0
Audit related tasks for 3.4.0
P1
Nice to have for release
Spark-context
apache/spark@6b2492628c
What changes were proposed in SPARK pull request?
There is a bug where
InSet.dataType
(which isBooleanType
) is used to build theLiteralValue
while building V2In
Predicate .The new PR fixes the bug by using
InSet.child.dataType
Why are the changes needed in Spark?
Bug Fix.
Does this PR introduce any user-facing change?
Why it might affect RAPIDS?
If this is a legit concern, then we may need to investigate if more tests are needed to catch such difference in behavior between GPU and CPU.
Impact on Testing?
Maybe more improvement to tests?
Requires Doc update?
No.
The text was updated successfully, but these errors were encountered: