Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Fix tests failures in map_test.py #11026

Closed
Tracked by #11004
razajafri opened this issue Jun 8, 2024 · 1 comment · Fixed by #11097
Closed
Tracked by #11004

Fix tests failures in map_test.py #11026

razajafri opened this issue Jun 8, 2024 · 1 comment · Fixed by #11097
Assignees
@mythrocks
Labels
bug Something isn't working Spark 4.0+ Spark 4.0+ issues

Comments

@razajafri
Copy link
Collaborator 

FAILED ../../../../integration_tests/src/main/python/map_test.py::test_basic_scalar_map_get_map_value
FAILED ../../../../integration_tests/src/main/python/map_test.py::test_get_map_value_numeric_keys
FAILED ../../../../integration_tests/src/main/python/map_test.py::test_get_map_value_supported_keys
FAILED ../../../../integration_tests/src/main/python/map_test.py::test_transform_values
@razajafri razajafri added bug Something isn't working ? - Needs Triage Need team to review and classify labels Jun 8, 2024
@razajafri razajafri mentioned this issue Jun 8, 2024
Open
@razajafri razajafri added the Spark 4.0+ Spark 4.0+ issues label Jun 8, 2024
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Jun 11, 2024
@mythrocks
Copy link
Collaborator

These tests pass with ANSI mode disabled.

@mythrocks mythrocks self-assigned this Jun 12, 2024
mythrocks added a commit to mythrocks/spark-rapids that referenced this issue Jun 25, 2024
@mythrocks
Prep miscellaneous integ tests for Spark 4
9316347 
Fixes NVIDIA#11020. (grouping_sets_test.py)
Fixes NVIDIA#11023. (dpp_test.py)
Fixes NVIDIA#11025. (date_time_test.py)
Fixes NVIDIA#11026. (map_test.py)

This commit prepares miscellaneous integration tests to be run on Spark
4.

Certain integration tests fail on Spark 4 because of ANSI mode being
enabled by default.  This commit disables ANSI on the failing tests, or
introduces other fixes so that the tests may pass correctly.

Signed-off-by: MithunR <mithunr@nvidia.com>
@mythrocks mythrocks mentioned this issue Jun 25, 2024
Merged
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@mythrocks mythrocks

Labels
bug Something isn't working Spark 4.0+ Spark 4.0+ issues
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix miscellaneous integ tests for Spark 4 [databricks] mythrocks/spark-rapids
3 participants
@mattahrens @mythrocks @razajafri