databricks-demos / dbdemos

Demos to implement your Databricks Lakehouse
Other
286 stars 96 forks source link

dbdemos_fsi_fraud - Model inference REST endpoint not working #108

Closed kuldeep-in closed 1 month ago

kuldeep-in commented 9 months ago

While installing dbdemos_fsi_fraud, data setup job is failing at below stage: Notebook Name: 04.3-Model-serving-realtime-inference-fraud Notebook block: Starting the model inference REST endpoint using Databricks API Notebook execution stuck with below message: waiting for endpoint to start

Error at serving endpoint:

[94cbbdpbb8] [2024-02-18 12:39:44 +0000] [115] [INFO] Booting worker with pid: 115
[94cbbdpbb8] An error occurred while loading the model. No module named 'pandas.core.indexes.numeric'.
[94cbbdpbb8] [2024-02-18 12:39:46 +0000] [115] [INFO] Worker exiting (pid: 115)
[94cbbdpbb8] [2024-02-18 12:39:46 +0000] [7] [ERROR] Worker (pid:115) exited with code 1
[94cbbdpbb8] [2024-02-18 12:39:46 +0000] [7] [ERROR] Worker (pid:115) exited with code 1.
QuentinAmbard commented 1 month ago

Hey, this is because of a pandas version incompatibility. It shouldn't happen by default, here is the fix: https://docs.databricks.com/en/machine-learning/automl/train-ml-model-automl-api.html#:~:text=No%20module%20named%20pandas.&text=core.-,indexes.,pandas%2Ddependency.py%20script.