search

lhw828 / timesfm

Google timesfm 实战部署/本地部署详细记录
71 stars 10 forks source link

能发一下你运行成功的环境吗？ #6

Open ChengEast opened 4 months ago

ChengEast commented 4 months ago

请问可以提供一下你运行成功的环境文件吗？比如：ubuntu版本、python版本、anaconda版本、yml文件等，谢谢！

ChengEast commented 4 months ago

安装了ubuntu的24.04、22.04，可是都出现了包版本冲突， The conflict is caused by: paxml 1.4.0 depends on seqio-nightly==0.0.17.dev20231010 paxml 1.3.1 depends on seqio-nightly paxml 1.3.0 depends on seqio-nightly paxml 1.2.0 depends on seqio-nightly paxml 1.1.0 depends on tfds-nightly==4.8.3.dev202303280045 The user requested praxis paxml 1.0.0 depends on praxis==1.0.0 paxml 0.4.0 depends on tfds-nightly==4.8.3.dev202303280045 paxml 0.2.1 depends on seqio-nightly paxml 0.2.0 depends on seqio-nightly paxml 0.1 depends on seqio-nightly

To fix this you could try to:

  1. loosen the range of package versions you've specified
  2. remove package versions to allow pip attempt to solve the dependency conflict

Pip subprocess error: ERROR: Cannot install -r /home/zd/timesfm/condaenv.8g628zq5.requirements.txt (line 11) and praxis because these package versions have conflicting dependencies. ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

failed

lhw828 commented 4 months ago

1、我尝试过导出一个docker，失败了。 2、Ubuntu版本： NoLSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 24.04 LTS Release: 24.04 Codename: noble 3、conda --version conda 24.1.2 4、yml文件： environment0.zip 5、如果需我可以打包一份Ubuntu的虚拟机镜像文件。

ChengEast commented 4 months ago

您好！ 来信收悉，感谢您的数据，我在我电脑上用您数据再调整一下，有不懂再向您请教！谢谢！

lhw828 @.***> 于2024年6月17日周一 11:17写道：

1、我尝试过导出一个docker，失败了。 2、Ubuntu版本： NoLSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 24.04 LTS Release: 24.04 Codename: noble 3、conda --version conda 24.1.2 4、yml文件： environment0.zip https://github.com/user-attachments/files/15861036/environment0.zip 5、如果需我可以打包一份Ubuntu的虚拟机镜像文件。

— Reply to this email directly, view it on GitHub https://github.com/lhw828/timesfm/issues/6#issuecomment-2172097692, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALQSPNMGDMEFBVEH4YDLUD3ZHZIK7AVCNFSM6AAAAABJLMJK3GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNZSGA4TONRZGI . You are receiving this because you authored the thread.Message ID: @.***>

ChengEast commented 4 months ago

您好！ 我在24.04环境里安装了一下您发来的yml文件，卡在了 graphviz这个包上。我单独安装这个包，再装环境（把>=0.20.1去掉），也还是不行，不知您能否抽空帮忙指导一下，谢谢您！具体环境和报错如下：

@.:~/timesfm$ python --version Python 3.11.7 @.:~/timesfm$ anaconda --version anaconda Command line client (version 1.12.3) @.***:~/timesfm$ conda --version conda 24.1.2

@.***:~/timesfm$ conda env create --file=environment0.yml Channels:

Downloading and Extracting Packages:

Preparing transaction: done Verifying transaction: done Executing transaction: done Installing pip dependencies: \ Ran pip subprocess with arguments: ['/home/zd/anaconda3/envs/tfm_env/bin/python', '-m', 'pip', 'install', '-U', '-r', '/tmp/condaenv._xkfsx8g.requirements.txt', '--exists-action=b'] Pip subprocess output: Collecting absl-py==1.4.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 1)) Using cached absl_py-1.4.0-py3-none-any.whl.metadata (2.3 kB) Collecting array-record==0.5.1 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 2)) Using cached array_record-0.5.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (699 bytes) Collecting astunparse==1.6.3 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 3)) Using cached astunparse-1.6.3-py2.py3-none-any.whl.metadata (4.4 kB) Collecting cachetools==5.3.3 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 4)) Using cached cachetools-5.3.3-py3-none-any.whl.metadata (5.3 kB) Collecting chex==0.1.86 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 5)) Using cached chex-0.1.86-py3-none-any.whl.metadata (17 kB) Collecting click==8.1.7 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 6)) Using cached click-8.1.7-py3-none-any.whl.metadata (3.0 kB) Collecting clu==0.0.11 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 7)) Using cached clu-0.0.11-py3-none-any.whl.metadata (1.9 kB) Collecting colorama==0.4.6 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 8)) Using cached colorama-0.4.6-py2.py3-none-any.whl.metadata (17 kB) Collecting contextlib2==21.6.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 9)) Using cached contextlib2-21.6.0-py2.py3-none-any.whl.metadata (4.1 kB) Collecting contourpy==1.2.1 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 10)) Using cached contourpy-1.2.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.8 kB) Collecting cycler==0.12.1 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 11)) Using cached cycler-0.12.1-py3-none-any.whl.metadata (3.8 kB) Collecting dm-tree==0.1.8 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 12)) Using cached dm_tree-0.1.8-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.9 kB) Collecting docstring-parser==0.16 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 13)) Using cached docstring_parser-0.16-py3-none-any.whl.metadata (3.0 kB) Collecting editdistance==0.8.1 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 14)) Using cached editdistance-0.8.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.9 kB) Collecting einops==0.7.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 15)) Using cached einops-0.7.0-py3-none-any.whl.metadata (13 kB) Collecting einshape==1.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 16)) Using cached einshape-1.0-py3-none-any.whl.metadata (706 bytes) Collecting etils==1.7.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 17)) Using cached etils-1.7.0-py3-none-any.whl.metadata (6.4 kB) Collecting fiddle==0.3.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 18)) Using cached fiddle-0.3.0-py3-none-any.whl.metadata (2.3 kB) Collecting filelock==3.14.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 19)) Using cached filelock-3.14.0-py3-none-any.whl.metadata (2.8 kB) Collecting flatbuffers==1.12 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 20)) Using cached flatbuffers-1.12-py2.py3-none-any.whl.metadata (872 bytes) Collecting flax==0.8.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 21)) Using cached flax-0.8.2-py3-none-any.whl.metadata (10 kB) Collecting fonttools==4.51.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 22)) Using cached fonttools-4.51.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (159 kB) Collecting fsspec==2024.5.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 23)) Using cached fsspec-2024.5.0-py3-none-any.whl.metadata (11 kB) Collecting future==1.0.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 24)) Using cached future-1.0.0-py3-none-any.whl.metadata (4.0 kB) Collecting gast==0.4.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 25)) Using cached gast-0.4.0-py3-none-any.whl.metadata (1.1 kB) Collecting gin-config==0.5.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 26)) Using cached gin_config-0.5.0-py3-none-any.whl.metadata (2.9 kB) Collecting google-auth==2.29.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 27)) Using cached google_auth-2.29.0-py2.py3-none-any.whl.metadata (4.7 kB) Collecting google-auth-oauthlib==0.4.6 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 28)) Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl.metadata (2.7 kB) Collecting google-pasta==0.2.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 29)) Using cached google_pasta-0.2.0-py3-none-any.whl.metadata (814 bytes) Collecting googleapis-common-protos==1.63.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 30)) Using cached googleapis_common_protos-1.63.0-py2.py3-none-any.whl.metadata (1.5 kB) Collecting graph-compression-google-research==0.0.4 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 31)) Using cached graph_compression_google_research-0.0.4-py3-none-any.whl.metadata (8.5 kB) Collecting grpcio==1.63.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 32)) Using cached grpcio-1.63.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.2 kB) Collecting h5py==3.11.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 33)) Using cached h5py-3.11.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (2.5 kB) Collecting huggingface-hub==0.23.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 34)) Using cached huggingface_hub-0.23.0-py3-none-any.whl.metadata (12 kB) Collecting immutabledict==4.2.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 35)) Using cached immutabledict-4.2.0-py3-none-any.whl.metadata (3.4 kB) Collecting inquirerpy==0.3.4 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 36)) Using cached InquirerPy-0.3.4-py3-none-any.whl.metadata (8.1 kB) Collecting ipywidgets==8.1.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 37)) Using cached ipywidgets-8.1.2-py3-none-any.whl.metadata (2.4 kB) Collecting jax==0.4.26 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 38)) Using cached jax-0.4.26-py3-none-any.whl.metadata (23 kB) Collecting jax-bitempered-loss==0.0.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 39)) Using cached jax_bitempered_loss-0.0.2-py3-none-any.whl.metadata (4.0 kB) Collecting jaxlib==0.4.26 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 40)) Using cached jaxlib-0.4.26-cp310-cp310-manylinux2014_x86_64.whl.metadata (1.8 kB) Collecting jaxtyping==0.2.28 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 41)) Using cached jaxtyping-0.2.28-py3-none-any.whl.metadata (6.4 kB) Collecting joblib==1.4.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 42)) Using cached joblib-1.4.2-py3-none-any.whl.metadata (5.4 kB) Collecting jupyter==1.0.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 43)) Using cached jupyter-1.0.0-py2.py3-none-any.whl.metadata (995 bytes) Collecting jupyter-console==6.6.3 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 44)) Using cached jupyter_console-6.6.3-py3-none-any.whl.metadata (5.8 kB) Collecting jupyter-http-over-ws==0.0.8 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 45)) Using cached jupyter_http_over_ws-0.0.8-py2.py3-none-any.whl.metadata (1.1 kB) Collecting jupyterlab-widgets==3.0.10 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 46)) Using cached jupyterlab_widgets-3.0.10-py3-none-any.whl.metadata (4.1 kB) Collecting keras==2.9.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 47)) Using cached keras-2.9.0-py2.py3-none-any.whl.metadata (1.3 kB) Collecting keras-preprocessing==1.1.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 48)) Using cached Keras_Preprocessing-1.1.2-py2.py3-none-any.whl.metadata (1.9 kB) Collecting kiwisolver==1.4.5 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 49)) Using cached kiwisolver-1.4.5-cp310-cp310-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (6.4 kB) Collecting libclang==18.1.1 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 50)) Using cached libclang-18.1.1-py2.py3-none-manylinux2010_x86_64.whl.metadata (5.2 kB) Collecting libcst==1.3.1 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 51)) Using cached libcst-1.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (17 kB) Collecting lingvo==0.12.7 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 52)) Using cached lingvo-0.12.7-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (1.5 kB) Collecting markdown==3.6 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 53)) Using cached Markdown-3.6-py3-none-any.whl.metadata (7.0 kB) Collecting markdown-it-py==3.0.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 54)) Using cached markdown_it_py-3.0.0-py3-none-any.whl.metadata (6.9 kB) Collecting matplotlib==3.9.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 55)) Using cached matplotlib-3.9.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (11 kB) Collecting mdurl==0.1.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 56)) Using cached mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB) Collecting mesh-tensorflow==0.1.21 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 57)) Using cached mesh_tensorflow-0.1.21-py3-none-any.whl.metadata (1.0 kB) Collecting ml-collections==0.1.1 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 58)) Using cached ml_collections-0.1.1.tar.gz (77 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting ml-dtypes==0.4.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 59)) Using cached ml_dtypes-0.4.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (20 kB) Collecting model-pruning-google-research==0.0.5 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 60)) Using cached model_pruning_google_research-0.0.5-py3-none-any.whl.metadata (627 bytes) Collecting mpmath==1.3.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 61)) Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB) Collecting msgpack==1.0.8 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 62)) Using cached msgpack-1.0.8-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (9.1 kB) Collecting nltk==3.8.1 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 63)) Using cached nltk-3.8.1-py3-none-any.whl.metadata (2.8 kB) Collecting notebook==7.2.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 64)) Using cached notebook-7.2.0-py3-none-any.whl.metadata (10 kB) Collecting oauthlib==3.2.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 65)) Using cached oauthlib-3.2.2-py3-none-any.whl.metadata (7.5 kB) Collecting opt-einsum==3.3.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 66)) Using cached opt_einsum-3.3.0-py3-none-any.whl.metadata (6.5 kB) Collecting optax==0.2.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 67)) Using cached optax-0.2.2-py3-none-any.whl.metadata (8.1 kB) Collecting optax-shampoo==0.0.6 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 68)) Using cached optax_shampoo-0.0.6-py3-none-any.whl.metadata (1.4 kB) Collecting orbax-checkpoint==0.5.9 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 69)) Using cached orbax_checkpoint-0.5.9-py3-none-any.whl.metadata (1.7 kB) Collecting paxml==1.4.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 70)) Using cached paxml-1.4.0-py3-none-any.whl.metadata (1.3 kB) Collecting pfzy==0.3.4 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 71)) Using cached pfzy-0.3.4-py3-none-any.whl.metadata (4.9 kB) Collecting pillow==10.3.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 72)) Using cached pillow-10.3.0-cp310-cp310-manylinux_2_28_x86_64.whl.metadata (9.2 kB) Collecting portalocker==2.8.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 73)) Using cached portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB) Collecting praxis==1.4.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 74)) Using cached praxis-1.4.0-py3-none-any.whl.metadata (1.2 kB) Collecting promise==2.3 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 75)) Using cached promise-2.3.tar.gz (19 kB) Preparing metadata (setup.py): started Preparing metadata (setup.py): finished with status 'done' Collecting protobuf==3.19.6 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 76)) Using cached protobuf-3.19.6-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (787 bytes) Collecting pyasn1==0.6.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 77)) Using cached pyasn1-0.6.0-py2.py3-none-any.whl.metadata (8.3 kB) Collecting pyasn1-modules==0.4.0 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 78)) Using cached pyasn1_modules-0.4.0-py3-none-any.whl.metadata (3.4 kB) Collecting pyglove==0.4.4 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 79)) Using cached pyglove-0.4.4-py3-none-any.whl.metadata (6.7 kB) Collecting pyparsing==3.1.2 (from -r /tmp/condaenv._xkfsx8g.requirements.txt (line 80)) Using cached pyparsing-3.1.2-py3-none-any.whl.metadata (5.1 kB)

Pip subprocess error: ERROR: Ignored the following versions that require a different python version: 1.8.0 Requires-Python >=3.11; 1.9.0 Requires-Python >=3.11; 1.9.1 Requires-Python >=3.11; 1.9.2 Requires-Python >=3.11 ERROR: Could not find a version that satisfies the requirement python-graphviz>=0.20.1 (from versions: none) ERROR: No matching distribution found for python-graphviz>=0.20.1

lhw828 @.***> 于2024年6月17日周一 11:17写道：

1、我尝试过导出一个docker，失败了。 2、Ubuntu版本： NoLSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 24.04 LTS Release: 24.04 Codename: noble 3、conda --version conda 24.1.2 4、yml文件： environment0.zip https://github.com/user-attachments/files/15861036/environment0.zip 5、如果需我可以打包一份Ubuntu的虚拟机镜像文件。

— Reply to this email directly, view it on GitHub https://github.com/lhw828/timesfm/issues/6#issuecomment-2172097692, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALQSPNMGDMEFBVEH4YDLUD3ZHZIK7AVCNFSM6AAAAABJLMJK3GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNZSGA4TONRZGI . You are receiving this because you authored the thread.Message ID: @.***>

lhw828 commented 4 months ago

把日志喂给ai看看有什么建议

ChengEast commented 4 months ago

把日志喂给ai看看有什么建议 AI 也是说要安装的资源包与python版本冲突了，我看你在environment0.yml里dependent段里写的python版本是3.10.14，但是Ubuntu24.04里自带的是3.11.07,你是不是安装在Ubuntu22.04里的呢？

lhw828 commented 4 months ago

我是在“conda”环境下运行这个项目的。

lhw828 commented 4 months ago

首先你要切换到到conda环境，在里面安装所需版本，再在里面运行demo

ChengEast commented 4 months ago

感谢感谢！我把python3.10设置为默认版本，再安装你发的yml文件，现在不报错了，环境安装完成了。谢谢！我继续搞接下来的步骤。

LouisLee1983 commented 4 months ago

WARNING:absl:No registered CheckpointArgs found for handler type: <class 'paxml.checkpoints.FlaxCheckpointHandler'> WARNING:absl:Configured CheckpointManager using deprecated legacy API. Please follow the instructions at https://orbax.readthedocs.io/en/latest/api_refactor.html to migrate by May 1st, 2024. WARNING:absl:train_state_unpadded_shape_dtype_struct is not provided. We assume train_state is unpadded. ERROR:absl:For checkpoint version > 1.0, we require users to provide train_state_unpadded_shape_dtype_struct during checkpoint saving/restoring, to avoid potential silent bugs when loading checkpoints to incompatible unpadded shapes of TrainState. Restored checkpoint in 0.75 seconds. Jitting decoding. Killed

请问这个错误提示是哪里出了问题？我的：orbax-checkpoint是0.5.9版本。

lhw828 commented 4 months ago

WARNING:absl:No registered CheckpointArgs found for handler type: <class 'paxml.checkpoints.FlaxCheckpointHandler'> WARNING:absl:Configured CheckpointManager using deprecated legacy API. Please follow the instructions at https://orbax.readthedocs.io/en/latest/api_refactor.html to migrate by May 1st, 2024. WARNING:absl:train_state_unpadded_shape_dtype_struct is not provided. We assume train_state is unpadded. ERROR:absl:For checkpoint version > 1.0, we require users to provide train_state_unpadded_shape_dtype_struct during checkpoint saving/restoring, to avoid potential silent bugs when loading checkpoints to incompatible unpadded shapes of TrainState. Restored checkpoint in 0.75 seconds. Jitting decoding. Killed

请问这个错误提示是哪里出了问题？我的：orbax-checkpoint是0.5.9版本。

这段警告和错误信息来自于一个使用Pax和Orbax库的机器学习训练脚本。Pax是Google开发的一个深度学习库，而Orbax是一个用于机器学习实验的Python库，用于管理训练过程中的数据和模型。 警告信息说明以下几点：

  1. No registered CheckpointArgs found for handler type：这表明在加载或保存检查点（checkpoint）时，没有为指定的处理程序类型找到注册的参数。检查点处理程序是用来序列化和反序列化模型和优化器状态的。
  2. Configured CheckpointManager using deprecated legacy API：这表明使用了Orbax库中已经弃用的旧版API。开发者被要求按照Orbax的官方文档迁移到新的API，以保持与新版本兼容。
  3. train_state_unpadded_shape_dtype_struct is not provided：这意味着在加载或保存检查点时，没有提供train_state_unpadded_shape_dtype_struct。这是一个结构，它包含了训练状态（TrainState）的形状和类型信息，用于确保在加载检查点时，训练状态的形状与检查点中的形状兼容。 错误信息说明：
    • 在检查点的版本大于1.0时，用户必须在保存或恢复检查点时提供train_state_unpadded_shape_dtype_struct，以避免在加载检查点时由于训练状态的未填充形状不兼容而可能出现的潜在静默错误。 解决这些问题的方法可能包括：
    • 确保你的代码使用了Orbax库的最新API，并且按照官方文档进行了迁移。
    • 在保存和加载检查点时，确保提供了train_state_unpadded_shape_dtype_struct。
    • 查阅Pax和Orbax的官方文档，了解如何正确地配置和操作检查点。 如果你需要更具体的帮助，你可能需要提供更多的代码上下文或错误日志，以便能够给出更精确的指导。 这是ai给的解释，提供一下思路吧。
LouisLee1983 commented 4 months ago

感谢这位兄弟。回馈：是wsl的内存分配不够。最好搞成12g+8g。在"C:\Users\xxx.wslconfig" 输入： [wsl2] memory=12GB swap=16GB localhostForwarding=true

然后重启wsl。

zhouzjj commented 2 months ago

安装了ubuntu的24.04、22.04，可是都出现了包版本冲突， The conflict is caused by: paxml 1.4.0 depends on seqio-nightly==0.0.17.dev20231010 paxml 1.3.1 depends on seqio-nightly paxml 1.3.0 depends on seqio-nightly paxml 1.2.0 depends on seqio-nightly paxml 1.1.0 depends on tfds-nightly==4.8.3.dev202303280045 The user requested praxis paxml 1.0.0 depends on praxis==1.0.0 paxml 0.4.0 depends on tfds-nightly==4.8.3.dev202303280045 paxml 0.2.1 depends on seqio-nightly paxml 0.2.0 depends on seqio-nightly paxml 0.1 depends on seqio-nightly

To fix this you could try to:

  1. loosen the range of package versions you've specified
  2. remove package versions to allow pip attempt to solve the dependency conflict

Pip subprocess error: ERROR: Cannot install -r /home/zd/timesfm/condaenv.8g628zq5.requirements.txt (line 11) and praxis because these package versions have conflicting dependencies. ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

failed

想问问你这个问题咋解决的呀，我一直解决不了

ham114 commented 1 month ago

Pip subprocess error: WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection object at 0x7fb2c58138e0>, 'Connection to pypi.tuna.tsinghua.edu.cn timed out. (connect timeout=15)')': /simple/absl-py/ ERROR: Ignored the following versions that require a different python version: 1.8.0 Requires-Python >=3.11; 1.9.0 Requires-Python >=3.11; 1.9.1 Requires-Python >=3.11; 1.9.2 Requires-Python >=3.11; 1.9.3 Requires-Python >=3.11 ERROR: Could not find a version that satisfies the requirement python-graphviz>=0.20.1 (from versions: none) ERROR: No matching distribution found for python-graphviz>=0.20.1

failed

你好，请问这个问题怎么解决？我是在ubuntu22.04上运行的