coiled / benchmarks

BSD 3-Clause "New" or "Revised" License
32 stars 17 forks source link

⚠️ CI failed ⚠️ - test_download_throughput timeout on all engines #1357

Closed github-actions[bot] closed 9 months ago

github-actions[bot] commented 9 months ago

Workflow Run URL

milesgranger commented 9 months ago

Looks like some S3 timeout issues across all engines:

ERROR tests/benchmarks/test_parquet.py::test_download_throughput[boto3] - TimeoutError: Timed out after 600 seconds waiting for 15 workers to arrive ERROR tests/benchmarks/test_parquet.py::test_download_throughput[s3fs] - TimeoutError: Timed out after 600 seconds waiting for 15 workers to arrive ERROR tests/benchmarks/test_parquet.py::test_download_throughput[pandas] - OSError: Timed out trying to connect to tls://3.145.187.56:8786 after 30 s ERROR tests/benchmarks/test_parquet.py::test_download_throughput[pandas+boto3] - OSError: Timed out trying to connect to tls://3.145.187.56:8786 after 30 s ERROR tests/benchmarks/test_parquet.py::test_download_throughput[dask] - RuntimeError: Trying to connect to an already closed or closing Cluster Cluster(parquet-d34ce6ac, 'tls://3.145.187.56:8786', workers=0, threads=0, memory=0

Then snowflake issue duplicate of #1345 #1341

and TPC-H correctness duplicate of https://github.com/coiled/benchmarks/issues/1344 #1341

FAILED tests/tpch/test_correctness.py::test_dask_results[22] - AssertionError: DataFrame.iloc[:, 1] (column name="numcust") are different

milesgranger commented 9 months ago

Hasn't occurred in recent runs, closing as a spurious error from AWS S3