Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[BUG] Unit test FAILED against : SPARK-24957: average with decimal followed by aggregation returning wrong result #10327

Closed
NvTimLiu opened this issue Jan 30, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@NvTimLiu
Copy link
Collaborator

NvTimLiu commented Jan 30, 2024

Describe the bug

Unit test FAILED: SPARK-24957: average with decimal followed by aggregation returning wrong result, details:

 SPARK-24957: average with decimal followed by aggregation returning wrong result *** FAILED ***
 org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 3.0 failed 1 times, most recent age 3.0 (TID 3) (nightly-work1-jenkins-rapids-scala213-nightly-pre-release-vqjl3 executor driver): pe conversion is not allowed from Table{columns=[ColumnVector{rows=1, type=STRING, nullCount=Optional.empty, ebf0)}, ColumnVector{rows=1, type=INT64, nullCount=Optional.empty, offHeap=(ID: 777021 7fb66003cbd0)}, T64, nullCount=Optional.empty, offHeap=(ID: 777022 7fb66003d3a0)}, ColumnVector{rows=1, type=INT64, fHeap=(ID: 777023 7fb66003d690)}, ColumnVector{rows=1, type=INT64, nullCount=Optional.empty, offHeap=(ID: 777024 {rows=1, type=INT64, nullCount=Optional.empty, offHeap=(ID: 777025 7fb66003dd80)}], cudfTable=140421271470672, rows=1} ongType, GpuUnsignedLongType, GpuUnsignedLongType, LongType, LongType] columns 0 to 6
	at com.nvidia.spark.rapids.GpuColumnVector.from(GpuColumnVector.java:674)
	at com.nvidia.spark.rapids.GpuColumnVector.from(GpuColumnVector.java:555)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$performGroupByAggregation$4(GpuAggregateExec.scala:394)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$performGroupByAggregation$2(GpuAggregateExec.scala:393)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$performGroupByAggregation$1(GpuAggregateExec.scala:378)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.performGroupByAggregation(GpuAggregateExec.scala:377)
	at com.nvidia.spark.rapids.AggHelper.aggregate(GpuAggregateExec.scala:292)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$aggregateWithoutCombine$4(GpuAggregateExec.scala:311)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$aggregateWithoutCombine$3(GpuAggregateExec.scala:309)
	at com.nvidia.spark.rapids.Arm$.withResource(Arm.scala:30)
	at com.nvidia.spark.rapids.AggHelper.$anonfun$aggregateWithoutCombine$2(GpuAggregateExec.scala:308)
	at apidsRetryIterator$AutoCloseableAttemptSpliterator.next(RmmRapidsRetryIterator.scala:477)
	at com.nvidia.spark.rapids.RmmRapidsRetryIterator$RmmRapidsRetryIterator.next(RmmRapidsRetryIterator.scala:613)
	at apidsRetryIterator$RmmRapidsRetryAutoCloseableIterator.next(RmmRapidsRetryIterator.scala:517)
	at scala.collection.Iterator$$anon$10.next(Iterator.scala:61
	at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
	at com.nvidia.spark.rapids.GpuMergeAggregateIterator.aggregateInputBatches(GpuAggregateExec.scala:795)
	at com.nvidia.spark.rapids.GpuMergeAggregateIterator.$anonfun$next$2(GpuAggregateExec.scala:752)
	at scala.Option.getOrElse(Option.scala:201)
	at com.nvidia.spark.rapids.GpuMergeAggregateIterator.next(GpuAggregateExec.scala:749)
	at com.nvidia.spark.rapids.GpuMergeAggregateIterator.next(GpuAggregateExec.scala:711)
	at scala.collection.Iterator$$anon$9.next(Iterator.scala:577)
@NvTimLiu NvTimLiu added bug Something isn't working ? - Needs Triage Need team to review and classify labels Jan 30, 2024
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Jan 30, 2024
@mattahrens
Copy link
Collaborator

Fixed by #10331

@jlowe jlowe closed this as completed Jan 30, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants