search

Lightning-AI / pytorch-lightning

Pretrain, finetune ANY AI model of ANY size on multiple GPUs, TPUs with zero code changes.
https://lightning.ai
Apache License 2.0
28.39k stars 3.38k forks source link

Can no longer install versions 1.5.10-1.6.5 #20220

Open JonathanBhimani-Burrows opened 2 months ago

JonathanBhimani-Burrows commented 2 months ago

Bug description

Hey everyone, I have been working on the same server for the past few months ( w/ RTX6000) without issue Recently, I tried to re-install lightning 1.5.10 (new virtual environment, python 3.9.18), and got the error below I tried versions up to 1.6.5 with the same error I can't use the newest version, as that will require a torch upgrade (currently using 1.13.1 due to specific versioning issues) This popped up in the last month, I'm wondering if anyone else is seeing this problem or if it is to be expected for some reason? Thanks, Jonathan

What version are you seeing the problem on?

v1.x

How to reproduce the bug

Create a virtual environment with python 3.9.18
Activate
pip install pytorch-lightning==1.5.10

Error messages and logs

ERROR: Could not find a version that satisfies the requirement pytorch-lightning==1.5.10 (from versions: 0.0.2, 0.2, 0.2.2, 0.2.3, 0.2.4, 0.2.4.1, 0.2.5, 0.2.5.1, 0.2.5.2, 0.2.6, 0.3, 0.3.1, 0.3.2, 0.3.3, 0.3.4, 0.3.4.1, 0.3.5, 0.3.6, 0.3.6.1, 0.3.6.3, 0.3.6.4, 0.3.6.5, 0.3.6.6, 0.3.6.7, 0.3.6.8, 0.3.6.9, 0.4.0, 0.4.1, 0.4.2, 0.4.3, 0.4.4, 0.4.5, 0.4.6, 0.4.7, 0.4.8, 0.4.9, 0.5.0, 0.5.1, 0.5.1.2, 0.5.1.3, 0.5.2, 0.5.2.1, 0.5.3, 0.5.3.1, 0.5.3.2, 0.5.3.3, 0.6.0, 0.7.1, 0.7.3, 0.7.5, 0.7.6, 0.8.1, 0.8.3, 0.8.4, 0.8.5, 0.9.0, 0.10.0, 1.0.0, 1.0.1, 1.0.2, 1.0.3, 1.0.4, 1.0.5, 1.0.6, 1.0.7, 1.0.8, 1.1.0, 1.1.1, 1.1.2, 1.1.3, 1.1.4, 1.1.5, 1.1.6, 1.1.7, 1.1.8, 1.2.0rc0, 1.2.0rc1, 1.2.0rc2, 1.2.0, 1.2.1, 1.2.2, 1.2.3, 1.2.4, 1.2.5, 1.2.6, 1.2.7, 1.2.8, 1.2.9, 1.2.10, 1.3.0rc1, 1.3.0rc2, 1.3.0rc3, 1.3.0, 1.3.1, 1.3.2, 1.3.3, 1.3.4, 1.3.5, 1.3.6, 1.3.7, 1.3.7.post0, 1.3.8, 1.4.0rc0, 1.4.0rc1, 1.4.0rc2, 1.4.0, 1.4.1, 1.4.2, 1.4.3, 1.4.4, 1.4.5, 1.4.6, 1.4.7, 1.4.8, 1.4.9, 1.5.0rc0, 1.5.0rc1, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 1.5.7, 1.5.8, 1.5.9, 1.5.10, 1.6.0rc0, 1.6.0rc1, 1.6.0, 1.6.1, 1.6.2, 1.6.3, 1.6.4, 1.6.5, 1.7.0rc0, 1.7.0rc1, 1.7.0, 1.7.1, 1.7.2, 1.7.3, 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.8.0rc0, 1.8.0rc1, 1.8.0rc2, 1.8.0, 1.8.0.post1, 1.8.1, 1.8.2, 1.8.3, 1.8.3.post0, 1.8.3.post1, 1.8.3.post2, 1.8.4, 1.8.4.post0, 1.8.5, 1.8.5.post0, 1.8.6, 1.9.0rc0, 1.9.0, 1.9.1, 1.9.2, 1.9.3, 1.9.4, 1.9.5, 2.0.0rc0, 2.0.0, 2.0.1, 2.0.1.post0, 2.0.2, 2.0.3, 2.0.4, 2.0.5, 2.0.6, 2.0.7, 2.0.8, 2.0.9, 2.0.9.post0, 2.1.0rc0, 2.1.0rc1, 2.1.0, 2.1.1, 2.1.2, 2.1.3, 2.1.4, 2.2.0rc0, 2.2.0, 2.2.0.post0, 2.2.1, 2.2.2, 2.2.3, 2.2.4, 2.2.5, 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.4.0)
ERROR: No matching distribution found for pytorch-lightning==1.5.10

Environment

Current environment ``` Current environment * CUDA: - GPU: - NVIDIA RTX 6000 Ada Generation - available: True - version: 11.6 * Lightning: - pytorch-tabnet: 3.0.0 - torch: 1.13.1+cu116 - torchaudio: 0.13.1+cu116 - torchmetrics: 0.11.0 - torchvision: 0.14.1+cu116 * Packages: - absl-py: 1.3.0 - aiohttp: 3.8.3 - aiosignal: 1.3.1 - alembic: 1.13.2 - aniso8601: 9.0.1 - antlr4-python3-runtime: 4.9.3 - association-metrics: 0.0.1 - asttokens: 2.2.1 - async-timeout: 4.0.2 - attrs: 22.2.0 - autocommand: 2.2.2 - backcall: 0.2.0 - backports.tarfile: 1.2.0 - brotlipy: 0.7.0 - cachetools: 5.2.0 - category-encoders: 2.2.2 - certifi: 2020.6.20 - cffi: 1.17.0 - charset-normalizer: 2.1.1 - click: 8.1.3 - cloudpickle: 3.0.0 - comm: 0.1.2 - configparser: 5.3.0 - contourpy: 1.0.6 - cycler: 0.11.0 - databricks-cli: 0.17.4 - databricks-sdk: 0.30.0 - datasets: 2.10.1 - debugpy: 1.6.5 - decorator: 5.1.1 - deprecated: 1.2.14 - dill: 0.3.6 - docker: 7.1.0 - docker-pycreds: 0.4.0 - einops: 0.3.0 - entrypoints: 0.4 - executing: 1.2.0 - filelock: 3.9.0 - flask: 2.2.3 - fonttools: 4.38.0 - frozenlist: 1.3.3 - fsspec: 2022.11.0 - future: 0.18.2 - gitdb: 4.0.10 - gitpython: 3.1.30 - google-auth: 2.15.0 - google-auth-oauthlib: 0.4.6 - gputil: 1.4.0 - graphene: 3.3 - graphql-core: 3.2.3 - graphql-relay: 3.2.0 - greenlet: 3.0.3 - grpcio: 1.51.1 - gunicorn: 22.0.0 - huggingface-hub: 0.13.0 - idna: 3.4 - importlib-metadata: 6.0.0 - importlib-resources: 6.4.0 - inflect: 7.3.1 - ipykernel: 6.19.4 - ipython: 8.8.0 - ipywidgets: 8.0.4 - itsdangerous: 2.1.2 - jaraco.context: 5.3.0 - jaraco.functools: 4.0.1 - jaraco.text: 3.12.1 - jedi: 0.18.2 - jinja2: 3.1.4 - joblib: 1.2.0 - jupyter-client: 7.4.8 - jupyter-core: 5.1.2 - jupyterlab-widgets: 3.0.5 - kiwisolver: 1.4.4 - kornia: 0.7.3 - kornia-rs: 0.1.5 - llvmlite: 0.43.0 - mako: 1.3.5 - markdown: 3.4.1 - markupsafe: 2.1.1 - matplotlib: 3.6.2 - matplotlib-inline: 0.1.6 - mlflow: 2.15.1 - mlflow-skinny: 2.15.1 - more-itertools: 10.3.0 - multidict: 6.0.4 - multiprocess: 0.70.14 - nest-asyncio: 1.5.6 - numba: 0.60.0 - numpy: 1.24.2 - oauthlib: 3.2.2 - omegaconf: 2.3.0 - opentelemetry-api: 1.26.0 - opentelemetry-sdk: 1.26.0 - opentelemetry-semantic-conventions: 0.47b0 - ordered-set: 4.1.0 - packaging: 22.0 - pandas: 1.1.5 - parso: 0.8.3 - patsy: 0.5.3 - pexpect: 4.8.0 - pickleshare: 0.7.5 - pillow: 9.4.0 - pip: 24.2 - platformdirs: 2.6.2 - plotly: 4.14.3 - ply: 3.11 - promise: 2.3 - prompt-toolkit: 3.0.36 - protobuf: 3.20.3 - psutil: 5.9.4 - ptyprocess: 0.7.0 - pure-eval: 0.2.2 - pyarrow: 11.0.0 - pyasn1: 0.4.8 - pyasn1-modules: 0.2.8 - pycparser: 2.22 - pydeprecate: 0.3.1 - pygments: 2.14.0 - pyjwt: 2.6.0 - pyparsing: 3.0.9 - pyqt5-sip: 12.11.0 - python-dateutil: 2.8.2 - pytorch-tabnet: 3.0.0 - pytz: 2022.7 - pyyaml: 5.4.1 - pyzmq: 24.0.1 - querystring-parser: 1.2.4 - regex: 2022.10.31 - requests: 2.28.1 - requests-oauthlib: 1.3.1 - responses: 0.18.0 - retrying: 1.3.4 - rsa: 4.9 - scikit-learn: 1.2.0 - scipy: 1.10.0 - seaborn: 0.12.2 - sentry-sdk: 1.12.1 - setuptools: 72.1.0 - shap: 0.45.0 - shortuuid: 1.0.11 - six: 1.16.0 - slicer: 0.0.7 - smmap: 5.0.0 - sqlalchemy: 2.0.32 - sqlparse: 0.5.1 - stack-data: 0.6.2 - statsmodels: 0.13.5 - subprocess32: 3.5.4 - tabulate: 0.9.0 - tensorboard: 2.11.0 - tensorboard-data-server: 0.6.1 - tensorboard-plugin-wit: 1.8.1 - threadpoolctl: 3.1.0 - tokenizers: 0.13.2 - tomli: 2.0.1 - torch: 1.13.1+cu116 - torchaudio: 0.13.1+cu116 - torchmetrics: 0.11.0 - torchvision: 0.14.1+cu116 - tornado: 6.2 - tqdm: 4.64.1 - traitlets: 5.8.0 - transformers: 4.26.1 - typeguard: 4.3.0 - typing-extensions: 4.12.2 - urllib3: 1.26.13 - wandb: 0.10.11 - watchdog: 2.2.1 - wcwidth: 0.2.5 - webencodings: 0.5.1 - werkzeug: 2.2.2 - wheel: 0.43.0 - widgetsnbextension: 4.0.5 - wrapt: 1.16.0 - xxhash: 3.2.0 - yarl: 1.8.2 - zipp: 3.11.0 * System: - OS: Linux - architecture: - 64bit - ELF - processor: x86_64 - python: 3.9.18 - release: 6.2.0-37-generic - version: #38~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Thu Nov 2 18:01:13 UTC 2 ```

More info

No response

JonathanBhimani-Burrows commented 1 month ago

Any update on this? Is this a mistake on our side, or is this expected?

fsbarros98 commented 1 month ago

Same problem here!

heitorrapela commented 3 weeks ago

Hey, I am facing the same problem!

I hope they fix, otherwise it is going to break a lot of my dependencies.

Do you know what is happening here @Borda ?

Borda commented 3 weeks ago

This seems as pypi issue =/ Why would you need this very old version?

heitorrapela commented 3 weeks ago

In my case, I had some envs and projects with this version, so if someone wants to reproduce the results, I can at least guarantee that it is going to work; for the new version, I cannot say the same without re-run everything again with the latest version, which problem will not work due to lot of new modifications on the backend of the lib (like changes in some functions).

JonathanBhimani-Burrows commented 3 weeks ago

We have several models fpr our clients that use the older version For us to do a full migration, we would need to re-run all models for all clients to validate the results, and this is several weeks of work, which we do not have the time for now

Borda commented 3 weeks ago

Can try to install the version straight from pypi? pip install https://files.pythonhosted.org/packages/ba/6b/1b3ce55d6b83d68abfecabdd4e36e72ebbde1367c4a1d43aad809951ed50/pytorch-lightning-1.6.5.tar.gz

heitorrapela commented 3 weeks ago

Did you have any error in your side?

image

ps: maybe is my python version 3.8.19