LakeSail's computation framework with a mission to unify stream processing, batch processing, and compute-intensive (AI) workloads.
506
stars
14
forks
source link
This Should Have Been Split Into Multiple PRs #278
Closed
shehabgamin closed 1 week ago
Spark Test Report
Commit Information
973f90d
refs/pull/278/merge
602db40
refs/heads/main
Test Summary
doctest-column
doctest-dataframe
doctest-functions
test-connect
Test Details
Error Counts
```text (-7) 629 Total (-2) 306 Total Unique -------- ---- ---------------------------------------------------------------------------------------------------------- 30 DocTestFailure 27 UnsupportedOperationException: map partitions 24 UnsupportedOperationException: co-group map 23 UnsupportedOperationException: group map 15 UnsupportedOperationException: streaming query manager command 14 UnsupportedOperationException: lambda function 10 UnsupportedOperationException: unsupported data source format: Some("text") 10 handle add artifacts 8 AssertionError: AnalysisException not raised 8 PySparkAssertionError: [DIFFERENT_PANDAS_DATAFRAME] DataFrames are not almost equal: 8 PythonException: 8 PythonException: KeyError: 0 8 UnsupportedOperationException: hint 7 AssertionError: False is not true 6 IllegalArgumentException: invalid argument: UDF function type must be Python UDF 6 UnsupportedOperationException: function in table factor 6 UnsupportedOperationException: write stream operation start 5 AnalysisException: Cannot cast to Decimal128(14, 7). Overflowing on NaN 5 UnsupportedOperationException: function: monotonically_increasing_id 4 AnalysisException: Error during planning: view not found: v 4 AnalysisException: Execution error: 'Utf8("INTERVAL '0 00:00:00.000123' DAY TO SECOND") = CAST(#1 AS... 4 PySparkNotImplementedError: [NOT_IMPLEMENTED] rdd() is not implemented. 4 UnsupportedOperationException: function: window 4 UnsupportedOperationException: interval unit: day-time 4 UnsupportedOperationException: sample 4 UnsupportedOperationException: sample by 4 UnsupportedOperationException: unknown aggregate function: hll_sketch_agg 4 UnsupportedOperationException: unpivot 3 AnalysisException: Error during planning: Table function 'range' not found 3 AnalysisException: Error during planning: The expression to get an indexed field is only valid for `... 3 AnalysisException: Execution error: Date part 'D' not supported 3 AssertionError: "[('a', [('b', 'c')])]" != "{'a': {'b': 'c'}}" 3 AssertionError: "{'col1': 1, 'struct(John, 30, struct(valu[87 chars]0}}}" != "Row(col1=1, col2=Row(c... 3 AssertionError: AnalysisException not raised byPassed Tests Diff
```diff --- before 2024-11-12 02:04:05.572762006 +0000 +++ after 2024-11-12 02:04:05.700762147 +0000 @@ -45,0 +46 @@ +.venvs/test/lib/python3.11/site-packages/pyspark/sql/dataframe.py::pyspark.sql.dataframe.DataFrame.crosstab @@ -67,0 +69 @@ +.venvs/test/lib/python3.11/site-packages/pyspark/sql/dataframe.py::pyspark.sql.dataframe.DataFrame.replace @@ -79,0 +82 @@ +.venvs/test/lib/python3.11/site-packages/pyspark/sql/dataframe.py::pyspark.sql.dataframe.DataFrame.to @@ -93,0 +97 @@ +.venvs/test/lib/python3.11/site-packages/pyspark/sql/dataframe.py::pyspark.sql.dataframe.DataFrameNaFunctions.replace @@ -95,0 +100 @@ +.venvs/test/lib/python3.11/site-packages/pyspark/sql/dataframe.py::pyspark.sql.dataframe.DataFrameStatFunctions.crosstab @@ -257,0 +263 @@ +.venvs/test/lib/python3.11/site-packages/pyspark/sql/functions.py::pyspark.sql.functions.reverse @@ -622,0 +629 @@ +.venvs/test/lib/python3.11/site-packages/pyspark/sql/tests/connect/test_parity_dataframe.py::DataFrameParityTests::test_replace ```