search

getindata / kedro-vertexai

Kedro Plugin to support running workflows on GCP Vertex AI Pipelines
https://kedro-vertexai.readthedocs.io
Apache License 2.0
33 stars 9 forks source link

installation fails with python 3.10 and 3.11 #139

Open venturozzaccio opened 6 months ago

venturozzaccio commented 6 months ago

Hi,

I am having issues installing this plugin with any python version with pip install kedro-vertexai

with python 3.10

AttributeError: cython_sources
[end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

cause pyyaml pinned version and cython doesn't live happily together.

with python 3.11 installation fails cause pinned grpcio=1.44 doesn't support python 3.11 but I guess that's fair since that version is not officially supported.

Any suggestion?

Thanks

Lasica commented 6 months ago

Hi, I've tried bumping up version to 3.11 but there are weird Assertion Errors from poetry when resolving dependencies - I'll look into that later. Most of our dependency problems stands from a long-standing task to update kfp to 2.0, as it keeps other versions old. https://github.com/getindata/kedro-vertexai/issues/44

That being said, python 3.10 should be working all well, although I had issues in bumping up its version in our github actions e2e test. I don't remember exact issue, but it was as you've said related to pyyaml/cython. I've left a comment in our pyproject.toml:

# pyaml in version 5 does problems with installing binaries/wheel in cicd env with python 3.10. The following fixes that:
# pyyaml = ">=6.0,<7"

So if you try to fix pyyaml's version, try using the following constraint? Don't expect python 3.11 to work yet. https://github.com/getindata/kedro-vertexai/issues/146

I'll try to update kfp when I have some more time to work on this project and then try to debug python updates.

cerlymarco commented 2 months ago

@Lasica that seems to be still a problem with python 3.11