KLab / AAAI-23.6040

GenéLive! Generating Rhythm Actions in Love Live!
MIT License
57 stars 4 forks source link

[% mlflow run -e fetch --experiment-name fetch . ] fails on mac because the required packages in conda.yaml are not in the channels anymore #1

Open cerkut opened 1 year ago

cerkut commented 1 year ago

I am experimenting with the new/newest versions of the packages... I'll update when everything works. I'll also test on linux.

% mlflow run -e fetch --experiment-name fetch .
2023/01/06 07:16:58 INFO mlflow.projects: 'fetch' does not exist. Creating a new experiment
2023/01/06 07:17:00 INFO mlflow.utils.conda: === Creating conda environment mlflow-f3a887a8670b1c12ea791603ac8214bc2c2f0cc8 ===
Collecting package metadata (repodata.json): ...working... ls
done
Solving environment: ...working... failed

ResolvePackageNotFound: 
  - scikit-learn==0.22.1
  - torchaudio==0.7.2
  - pytorch==1.7.1=py3.7_cuda10.1.243_cudnn7.6.3_0
  - pandas==0.25.3
  - ignite==0.3.0
  - python==3.7.10
  - pytest==5.3.5
  - torchvision==0.8.2=py37_cu101
  - scipy==1.4.1
  - numpy==1.18.1
cerkut commented 1 year ago

pruning the versions on conda.yaml works but then I get a data download error `(torch-nightly) % mlflow run -e fetch --experiment-name fetch . 2023/01/06 09:03:31 INFO mlflow.utils.conda: Conda environment mlflow-762c55660d3ef06c42273cf930ff0c6df523e084 already exists. 2023/01/06 09:03:31 INFO mlflow.projects.utils: === Created directory /var/folders/j4/0lv7gs9s385byhj07wh6tch40000gp/T/tmpjp1rpwya for downloading remote URIs passed to arguments of type 'path' === 2023/01/06 09:03:31 INFO mlflow.projects.backend.local: === Running command 'source /opt/homebrew/Caskroom/miniforge/base/bin/../etc/profile.d/conda.sh && conda activate mlflow-762c55660d3ef06c42273cf930ff0c6df523e084 1>&2 && $SHELL scripts/fetch.sh data ' in run with ID '97ab94ac3c144ff58f5b1bfe709f7aa2' === +scripts/fetch.sh:5> SMDATA_DIR=data +scripts/fetch.sh:7> FRAXTIL_URLS=$'https://fra.xtil.net/simfiles/data/tsunamix/III/Tsunamix%20III%20%5BSM5%5D.zip\nhttps://fra.xtil.net/simfiles/data/arrowarrangements/Fraxtil%27s%20Arrow%20Arrangements%20%5BSM5%5D.zip\nhttps://fra.xtil.net/simfiles/data/beastbeats/Fraxtil%27s%20Beast%20Beats%20%5BSM5%5D.zip\n' +scripts/fetch.sh:11> ITG_URLS=$'https://search.stepmaniaonline.net/static/new/In%20The%20Groove%201.zip\nhttps://search.stepmaniaonline.net/static/new/In%20The%20Groove%202.zip\n' +scripts/fetch.sh:15> mkdir -p data/raw +scripts/fetch.sh:16> pushd data/raw +scripts/fetch.sh:18> mkdir -p fraxtil +scripts/fetch.sh:19> pushd fraxtil +scripts/fetch.sh:20> I=https://fra.xtil.net/simfiles/data/tsunamix/III/Tsunamix%20III%20%5BSM5%5D.zip https://fra.xtil.net/simfiles/data/arrowarrangements/Fraxtil%27s%20Arrow%20Arrangements%20%5BSM5%5D.zip https://fra.xtil.net/simfiles/data/beastbeats/Fraxtil%27s%20Beast%20Beats%20%5BSM5%5D.zip

+scripts/fetch.sh:22> curl $'https://fra.xtil.net/simfiles/data/tsunamix/III/Tsunamix%20III%20%5BSM5%5D.zip\nhttps://fra.xtil.net/simfiles/data/arrowarrangements/Fraxtil%27s%20Arrow%20Arrangements%20%5BSM5%5D.zip\nhttps://fra.xtil.net/simfiles/data/beastbeats/Fraxtil%27s%20Beast%20Beats%20%5BSM5%5D.zip\n' -o temp.zip curl: (3) URL using bad/illegal format or missing URL 2023/01/06 09:03:31 ERROR mlflow.cli: === Run (ID '97ab94ac3c144ff58f5b1bfe709f7aa2') failed === (torch-nightly) cer@AAU121633 6040 % `

NaokiHamada commented 1 year ago

Thanks for reporting. The download error was due to URLs in FRAXTIL_URLS and ITG_URLS that seem not to be separated by linebreak, fixed by #3.

I'm still working on the package not found issue.