search

feast-dev / feast

The Open Source Feature Store for Machine Learning
https://feast.dev
Apache License 2.0
5.46k stars 976 forks source link

feast apply failed with error: "89531 segmentation fault feast apply" #3747

Closed mjzhaochenyi closed 1 year ago

mjzhaochenyi commented 1 year ago

Expected Behavior

"feast apply" works

Current Behavior

"feast apply" did not work

Steps to reproduce

pip install feast feast init my_feature_repo cd my_feature_repo/feature_repo feast apply

/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/feast/proto_json.py:4: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
  import pkg_resources
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/feast/feature_store.py:561: RuntimeWarning: On demand feature view is an experimental feature. This API is stable, but the functionality does not scale well for offline retrieval
  warnings.warn(
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:22:15 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
[1]    89180 segmentation fault  feast apply
(langchain-quickstart) ➜  feature_repo git:(main) ✗ pip show feast         
Name: feast
Version: 0.33.1
Summary: Python SDK for Feast
Home-page: https://github.com/feast-dev/feast
Author: Feast
Author-email: 
License: Apache
Location: /Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages
Requires: bowler, click, colorama, dask, dill, fastapi, fastavro, grpcio, grpcio-reflection, gunicorn, httpx, Jinja2, jsonschema, mmh3, numpy, pandas, pandavro, proto-plus, protobuf, pyarrow, pydantic, pygments, PyYAML, requests, SQLAlchemy, tabulate, tenacity, toml, tqdm, typeguard, uvicorn
Required-by: 
(langchain-quickstart) ➜  feature_repo git:(main) ✗ feast apply         
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/feast/proto_json.py:4: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html
  import pkg_resources
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/feast/feature_store.py:561: RuntimeWarning: On demand feature view is an experimental feature. This API is stable, but the functionality does not scale well for offline retrieval
  warnings.warn(
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
/Users/gazzhao/.local/share/virtualenvs/langchain-quickstart-R0WvQiXz/lib/python3.9/site-packages/pandas/core/dtypes/cast.py:1641: DeprecationWarning: np.find_common_type is deprecated.  Please use `np.result_type` or `np.promote_types`.
See https://numpy.org/devdocs/release/1.25.0-notes.html and the docs for more information.  (Deprecated NumPy 1.25)
  return np.find_common_type(types, [])
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
08/27/2023 07:26:19 PM feast.infra.registry.registry INFO: Registry cache expired, so refreshing
[1]    89531 segmentation fault  feast apply

Specifications

Possible Solution

wintonzheng commented 1 year ago

running into the same issue . is there any update?

hkszn commented 1 year ago

It is caused by a protobuf dependency. Version 4.24 causes it. Version 4.23.4 works fine for me.

snowron commented 1 year ago

@hkszn thx m8. i can confirm that one solves problem at m1 mac monterey 12.1

johanjordaan commented 1 year ago

Hi I can confirm same issue on: Windows 11, Python 3.10, feast 0.33.1 Windows 11 (WSL/Ubuntu), Python 3.10, feast 0.33.1 Ubuntu 22.04.3 LTS , Python 3.10.12, feast 0.33.1

jordanrule commented 1 year ago

Confirmed same issue - tried on both OSX Ventura M1 and Monterey Intel.

pip install protobuf==4.23 fixes the problem

adchia commented 1 year ago

Made a fix for this in the project. Hopefully this should make this workaround unnecessary going forward!