search

snowflakedb / snowflake-ml-python

Apache License 2.0
38 stars 8 forks source link

SERVER_FAILED_FETCH_PANDAS error at .fit() #35

Closed ChuliangXiao closed 1 year ago

ChuliangXiao commented 1 year ago 
    clf = LGBMClassifier(
        input_cols=INPUT_COLUMN,
        label_cols=LABEL_COLUMN,
        output_cols=OUTPUT_COLUMN
    )
    clf.fit(train_df)

The same code ran successfully last week (8/9/23) but failed today (8/18/23).

  File "/usr/local/lib/python3.10/site-packages/snowflake/ml/modeling/lightgbm/lgbm_regressor.py", line 395, in fit_wrapper_sproc
  File "/usr/lib/python_udf/71441989a492f2dbedfea59e813975105f2b4dc2914c324185d22c02e583eb93/lib/python3.10/site-packages/snowflake/snowpark/_internal/telemetry.py", line 139, in wrap
    result = func(*args, **kwargs)
  File "/usr/lib/python_udf/71441989a492f2dbedfea59e813975105f2b4dc2914c324185d22c02e583eb93/lib/python3.10/site-packages/snowflake/snowpark/dataframe.py", line 782, in to_pandas
    check_is_pandas_dataframe_in_to_pandas(result)
  File "/usr/lib/python_udf/71441989a492f2dbedfea59e813975105f2b4dc2914c324185d22c02e583eb93/lib/python3.10/site-packages/snowflake/snowpark/_internal/utils.py", line 669, in check_is_pandas_dataframe_in_to_pandas
    raise SnowparkClientExceptionMessages.SERVER_FAILED_FETCH_PANDAS(
snowflake.snowpark.exceptions.SnowparkFetchDataException: (1406)

Here is the version info:

"snowpark.version" : 1.5.1,
“snowflake.ml.verion“: 1.0.4
"python.version" : 3.10.12,
"python.connector.version" : 3.0.4,
sfc-gh-sdas commented 1 year ago

Hi Chuliang, Thanks for reaching out to us.

This issue is caused by underlying snowpark-python layer. This issue only happens in anonymous stored proc in some specific accounts and snowpark-ML uses anonymous sproc. A server side fix is underway and it should resolve by end of this week. If it does not, let us know.

IIUC, you have been supplied with a temporary fix by your AE team already. I'll keep this issue open till end of this week.