google / ml-metadata

For recording and retrieving metadata associated with ML developer and data scientist workflows.

https://www.tensorflow.org/tfx/guide/mlmd

Apache License 2.0

616 stars 145 forks source link

Cannot install ml-metadata v1.0.0 #161

Closed AlexandreBrown closed 2 years ago

AlexandreBrown commented 2 years ago

Description

Hello, I cannot install v1.0.0 of ml-metadata using pip even tho the version seems available on the PyPi page : . https://pypi.org/project/ml-metadata/#history Screenshot from 2022-07-20 07-17-46

Use Case

Use ml_metadata to acces Kubeflow artifacts information stored in the MySQL db.

codesue commented 2 years ago

If you're using an Apple M1 chip, this could be related to https://github.com/google/ml-metadata/issues/143.

AlexandreBrown commented 2 years ago

@codesue Interesting, I have an AMD CPU (normal x86 architecture cpu) but I feel like for me the issue is finding the package on PyPi when doing a pip install.
Could you paste in your pip command ? Maybe there are flags that I'm not aware of to find the package.

codesue commented 2 years ago

@AlexandreBrown I'm doing a regular pip install with the default resolver and no flags, e.g. pip install ml-metadata==1.9.0.

On my machine with an M1 Pro chip using Python 3.9.7, this produces the following error:

ERROR: Could not find a version that satisfies the requirement ml-metadata==1.9.0 (from versions: 0.12.0.dev0, 0.13.0.dev0, 0.13.1.dev0)
ERROR: No matching distribution found for ml-metadata==1.9.0

Installation works as expected on my machine with an Intel chip.

AlexandreBrown commented 2 years ago

@codesue Ok, yes installing the latest version works for me as well being on a x86 architecture cpu, can you try to install v1.0.0 on both your machines to see if you have the same issue as me?

codesue commented 2 years ago

@AlexandreBrown Ohhh, 1.0.0 doesn't install on either. Not related to https://github.com/google/ml-metadata/issues/143.

BrianSong commented 2 years ago

@AlexandreBrown Thanks for bringing this up. What version of pip are you using?

AlexandreBrown commented 2 years ago

Hello @BrianSong , I'm using pip version 21.2.4 (was also able to reproduce on latest version 22.2.1)

BrianSong commented 2 years ago

Hi @venkat2469, I wonder does release engineer have any idea why 1.0.0 is not available through pip although it is available on the PyPi page: https://pypi.org/project/ml-metadata/#history?

AlexandreBrown commented 2 years ago

@venkat2469 @BrianSong Hello, any update on this ?

rtg0795 commented 2 years ago

Hi @AlexandreBrown , may I know the python version you are using to install the ml-metadata package?

AlexandreBrown commented 2 years ago

Hello @rtg0795 , using Python 3.9 under Ubuntu (tried various Ubuntu versions, 18.04, 20.04, 22.04).

BrianSong commented 2 years ago

@AlexandreBrown , Python 3.9 is not supported until 1.8.0. Could you try to install 1.8.0 or 1.9.0?

AlexandreBrown commented 2 years ago

@BrianSong Unfortunately 1.8 and 1.9 cause errors. I must install a version that is compatible with Kubeflow (v1.4.1).

Kubeflow 1.4.1 uses a database scheme that seems to only work with lower versions like 1.0.

My use case is I want to use ml-metadata to query the mysql database that Kubeflow fills in during experiments (pipeline runs).

BrianSong commented 2 years ago

I see. Is it possible for you to upgrade Kubeflow with a higher version? v1.4.1 is a pretty old version so it might not be compatible with MLMD 1.8.0 and higher.

Also, downgrading your py version looks like another way to go.

AlexandreBrown commented 2 years ago

@BrianSong Well to be quite honest I wouldn't consider Kubeflow v1.4.1 as "old" since the latest version is v1.5.1 which was published only 13 days ago from AWS and upgrading Kubeflow installs can involve much more than a pip install (unfortunately).

I followed your alternative option and downgraded my python version from 3.9 to 3.8 and that did the trick for me.

Thanks!