search

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
785 stars 228 forks source link

Fix tests failures in orc_test.py #11013

Open razajafri opened 3 months ago

razajafri commented 3 months ago 
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_basic_read
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_compress_read_round_trip
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_input_meta
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_merge_schema_read
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_missing_column_names_count
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_missing_column_names_count_with_schema
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_mixed_compress_read
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_orc_fallback
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_orc_read_avoid_coalesce_incompatible_files
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_orc_read_count
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_orc_read_multiple_schema
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_orc_read_with_corrupt_files
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_partial_missing_column_names_count
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_pred_push_round_trip
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_read_case_col_name
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_read_nested_pruning
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_read_round_trip
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_read_with_more_columns
FAILED ../../../../integration_tests/src/main/python/orc_test.py::test_simple_partitioned_read
razajafri commented 1 month ago

After setting the ANSI mode to false these are the failing tests 

orc_test.py::test_basic_read (missing gpu metrics gpuDecodeTime)
orc_test.py::test_compress_read_round_trip (missing gpu metrics gpuDecodeTime)
orc_test.py::test_input_meta (missing gpu metrics gpuDecodeTime)
test_merge_schema_read (missing gpu metrics gpuDecodeTime)
test_mixed_compress_read (missing gpu metrics gpuDecodeTime)
test_orc_read_avoid_coalesce_incompatible_files (missing gpu bufferTime)
test_orc_read_multiple_schema (missing gpu metrics gpuDecodeTime)
test_orc_read_with_corrupt_files (different lengths of output list)
test_pred_push_round_trip (missing gpu metrics gpuDecodeTime)
test_read_case_col_name (missing gpu metrics gpuDecodeTime)
test_read_nested_pruning (missing gpu bufferTime)
test_read_round_trip (missing gpu bufferTime)
test_read_with_more_columns (missing gpu bufferTime)
test_simple_partitioned_read (missing gpu bufferTime)