Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[BUG] Spark-4.0: Tests failures in GpuLoreSuite #12016

Open
Tracked by #12001
nartal1 opened this issue Jan 23, 2025 · 1 comment
Open
Tracked by #12001

[BUG] Spark-4.0: Tests failures in GpuLoreSuite #12016

nartal1 opened this issue Jan 23, 2025 · 1 comment
Labels
bug Something isn't working Spark 4.0+ Spark 4.0+ issues test Only impacts tests

Comments

@nartal1
Copy link
Collaborator

nartal1 commented Jan 23, 2025

Describe the bug
Below unit tests(scala tests) are failing in GpuLoreSuite
Total test failures : 6

Pasting the error message which have different reasons for the failure.

1. - Aggregate *** FAILED ***
  java.lang.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.aggregate.HashAggregateExec
HashAggregate(keys=[key#1L], functions=[sum(value#2L)], output=[key#1L, total#3L])
+- Exchange hashpartitioning(key#1L, 200), ENSURE_REQUIREMENTS, [plan_id=43]
   +- HashAggregate(keys=[key#1L], functions=[partial_sum(value#2L)], output=[key#1L, sum#8L])

2. - AQE broadcast *** FAILED ***
  java.lang.IllegalArgumentException: Part of the plan is not columnar class org.apache.spark.sql.execution.exchange.ShuffleExchangeExec
Exchange hashpartitioning(key#91L, 200), ENSURE_REQUIREMENTS, [plan_id=796]
+- HashAggregate(keys=[key#91L], functions=[partial_sum(value#92L)], output=[key#91L, sum#105L])
   +- GpuColumnarToRow false
      +- GpuProject [(id#90L % 10) AS key#91L, (id#90L % 100) AS value#92L], [loreId=29]
         +- GpuCoalesceBatches targetsize(1073741824)
            +- GpuFilter gpuisnotnull((id#90L % 10)), [loreId=28]
               +- GpuRange (0, 1000, step=1, splits=10)

Steps/Code to reproduce bug

$ mvn package -f scala2.13/pom.xml -pl tests -am -Dbuildver=400 -Dsuffixes=".*GpuLoreSuite"

Expected behavior
Tests must either pass or skip with valid reason in the test suite.

@nartal1 nartal1 added ? - Needs Triage Need team to review and classify bug Something isn't working Spark 4.0+ Spark 4.0+ issues test Only impacts tests labels Jan 23, 2025
@nartal1
Copy link
Collaborator Author

nartal1 commented Jan 29, 2025

We will have to skip these tests for Spark-4.0. i.e disable ANSI mode for these failing tests.
We need to enable the tests once #5114 if fixed. Mention the issue number to track.

@nartal1 nartal1 removed the ? - Needs Triage Need team to review and classify label Jan 29, 2025
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
bug Something isn't working Spark 4.0+ Spark 4.0+ issues test Only impacts tests
Projects
None yet
Development

No branches or pull requests

1 participant