Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Fix tests failures in join_test.py #11022

Open
Tracked by #11004
razajafri opened this issue Jun 8, 2024 · 2 comments
Open
Tracked by #11004

Fix tests failures in join_test.py #11022

razajafri opened this issue Jun 8, 2024 · 2 comments
Assignees
Labels
bug Something isn't working Spark 4.0+ Spark 4.0+ issues

Comments

@razajafri
Copy link
Collaborator

FAILED ../../../../integration_tests/src/main/python/join_test.py::test_broadcast_hash_join_fix_fallback_by_inputfile
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_broadcast_nested_join_fix_fallback_by_inputfile
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_broadcast_nested_loop_join_special_case_count
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_broadcast_nested_loop_join_special_case_group_by_count
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_broadcast_nested_loop_join_with_condition
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_cartesian_join_special_case_count
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_cartesian_join_special_case_group_by_count
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_distinct_join
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_half_cache_join
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_left_broadcast_nested_loop_join_condition_missing_count
FAILED ../../../../integration_tests/src/main/python/join_test.py::test_right_broadcast_nested_loop_join_condition_missing_count
@razajafri razajafri added bug Something isn't working ? - Needs Triage Need team to review and classify labels Jun 8, 2024
@razajafri razajafri added the Spark 4.0+ Spark 4.0+ issues label Jun 8, 2024
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Jun 11, 2024
@mythrocks
Copy link
Collaborator

Two of these tests (test_broadcast_hash_join_fix_fallback_by_inputfile, and test_broadcast_nested_join_fix_fallback_by_inputfile) seem to be failing with the same missing gpuDecodeTime metric:

E                   Caused by: java.util.NoSuchElementException: key not found: gpuDecodeTime
E                       at scala.collection.immutable.Map$EmptyMap$.apply(Map.scala:243)
E                       at scala.collection.immutable.Map$EmptyMap$.apply(Map.scala:239)
E                       at com.nvidia.spark.rapids.OrcTableReader.next(GpuOrcScan.scala:2884)
E                       at com.nvidia.spark.rapids.OrcTableReader.next(GpuOrcScan.scala:2859)

This comes from the ORC file reader.

The rest of the tests seem to run fine, when ANSI mode is disabled.

@mythrocks mythrocks self-assigned this Jun 12, 2024
@mythrocks mythrocks removed their assignment Jul 24, 2024
@mythrocks
Copy link
Collaborator

I've unassigned myself from this bug. This should be resolved after the missing metrics are addressed.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
bug Something isn't working Spark 4.0+ Spark 4.0+ issues
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants