kubeflow / pipelines

Machine Learning Pipelines for Kubeflow
https://www.kubeflow.org/docs/components/pipelines/
Apache License 2.0
3.56k stars 1.61k forks source link

Conflict in ${REPO_ROOT}/v2/test dependencies #10499

Closed hbelmiro closed 2 months ago

hbelmiro commented 7 months ago

When we try to install the v2/test dependencies, it fails due to a conflict:

The conflict is caused by:
    ml-metadata 1.14.0 depends on protobuf<4 and >=3.13
    kfp 2.6.0 depends on protobuf<5 and >=4.21.1
$ cd backend/src/v2/test/
$ pip install -r requirements.txt                    
Obtaining file:///home/hbelmiro/dev/opendatahub-io/data-science-pipelines/sdk/python (from -r requirements.txt (line 2))
  Preparing metadata (setup.py) ... done
Obtaining file:///home/hbelmiro/dev/opendatahub-io/data-science-pipelines/samples/test/utils (from -r requirements.txt (line 9))
  Preparing metadata (setup.py) ... done
Collecting absl-py<2,>=0.9 (from -r ../../../../sdk/python/requirements-deprecated.txt (line 2))
  Using cached absl_py-1.4.0-py3-none-any.whl.metadata (2.3 kB)
Collecting cloudpickle<3,>=2.0.0 (from -r ../../../../sdk/python/requirements-deprecated.txt (line 3))
  Using cached cloudpickle-2.2.1-py3-none-any.whl.metadata (6.9 kB)
Collecting Deprecated<2,>=1.2.7 (from -r ../../../../sdk/python/requirements-deprecated.txt (line 4))
  Using cached Deprecated-1.2.14-py2.py3-none-any.whl.metadata (5.4 kB)
Collecting fire<1,>=0.3.1 (from -r ../../../../sdk/python/requirements-deprecated.txt (line 5))
  Using cached fire-0.5.0.tar.gz (88 kB)
  Preparing metadata (setup.py) ... done
Collecting jsonschema<4,>=3.0.1 (from -r ../../../../sdk/python/requirements-deprecated.txt (line 6))
  Using cached jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
Collecting strip-hints<1,>=0.1.8 (from -r ../../../../sdk/python/requirements-deprecated.txt (line 7))
  Using cached strip-hints-0.1.10.tar.gz (29 kB)
  Preparing metadata (setup.py) ... done
Collecting uritemplate<4,>=3.0.1 (from -r ../../../../sdk/python/requirements-deprecated.txt (line 8))
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Collecting typer<1.0,>=0.3.2 (from -r ../../../../sdk/python/requirements-deprecated.txt (line 9))
  Using cached typer-0.9.0-py3-none-any.whl.metadata (14 kB)
Collecting ml-metadata==1.14.0 (from -r requirements.txt (line 5))
  Using cached ml_metadata-1.14.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB)
Collecting minio==7.0.4 (from -r requirements.txt (line 6))
  Using cached minio-7.0.4-py3-none-any.whl (75 kB)
Requirement already satisfied: google-cloud-storage in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (2.14.0)
Collecting attrs<22,>=20.3 (from ml-metadata==1.14.0->-r requirements.txt (line 5))
  Using cached attrs-21.4.0-py2.py3-none-any.whl (60 kB)
Collecting grpcio<2,>=1.8.6 (from ml-metadata==1.14.0->-r requirements.txt (line 5))
  Using cached grpcio-1.60.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB)
Collecting protobuf<4,>=3.13 (from ml-metadata==1.14.0->-r requirements.txt (line 5))
  Using cached protobuf-3.20.3-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.1 MB)
Requirement already satisfied: six<2,>=1.10 in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from ml-metadata==1.14.0->-r requirements.txt (line 5)) (1.16.0)
Requirement already satisfied: certifi in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from minio==7.0.4->-r requirements.txt (line 6)) (2024.2.2)
Requirement already satisfied: urllib3 in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from minio==7.0.4->-r requirements.txt (line 6)) (1.26.18)
Requirement already satisfied: click<9,>=8.0.0 in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from kfp==2.6.0->-r requirements.txt (line 2)) (8.1.7)
Requirement already satisfied: docstring-parser<1,>=0.7.3 in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from kfp==2.6.0->-r requirements.txt (line 2)) (0.15)
Requirement already satisfied: google-api-core!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.0,<3.0.0dev,>=1.31.5 in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from kfp==2.6.0->-r requirements.txt (line 2)) (2.17.1)
Requirement already satisfied: google-auth<3,>=1.6.1 in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from kfp==2.6.0->-r requirements.txt (line 2)) (2.28.0)
Requirement already satisfied: kfp-pipeline-spec==0.3.0 in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from kfp==2.6.0->-r requirements.txt (line 2)) (0.3.0)
Requirement already satisfied: kfp-server-api<2.1.0,>=2.0.0 in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from kfp==2.6.0->-r requirements.txt (line 2)) (2.0.5)
Requirement already satisfied: kubernetes<27,>=8.0.0 in /home/hbelmiro/miniconda3/envs/kubeflow/lib/python3.10/site-packages (from kfp==2.6.0->-r requirements.txt (line 2)) (26.1.0)
INFO: pip is looking at multiple versions of kfp to determine which version is compatible with other requirements. This could take a while.
ERROR: Cannot install -r requirements.txt (line 2) and -r requirements.txt (line 5) because these package versions have conflicting dependencies.

The conflict is caused by:
    ml-metadata 1.14.0 depends on protobuf<4 and >=3.13
    kfp 2.6.0 depends on protobuf<5 and >=4.21.1

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
github-actions[bot] commented 5 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

hbelmiro commented 5 months ago

/remove-lifecycle stale

github-actions[bot] commented 2 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] commented 2 months ago

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.