search

ctuning / ck-env

CK repository with components and automation actions to enable portable workflows across diverse platforms including Linux, Windows, MacOS and Android. It includes software detection plugins and meta packages (code, data sets, models, scripts, etc) with the possibility of multiple versions to co-exist in a user or system environment.
https://github.com/mlcommons/ck
BSD 3-Clause "New" or "Revised" License
72 stars 25 forks source link

ck install package:imagenet-2012-val fails #101

Closed maxwillzq closed 3 years ago

maxwillzq commented 5 years ago

The error message:

   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   CK detected a PROBLEM in the third-party CK package:

   CK package:           imagenet-2012-val
   CK repo:              ck-env
   CK repo URL:          https://github.com/ctuning/ck-env
   CK package URL:       https://github.com/ctuning/ck-env/tree/master/package/imagenet-2012-val
   Issues URL:           https://github.com/ctuning/ck-env/issues
   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   Please, submit the log to the authors of this external CK package at "https://github.com/ctuning/ck-env/issues" to collaboratively fix this problem!

CK error: [package] package installation failed!
psyhtest commented 5 years ago

@maxwillzq Thanks for your interest in CK!

I was very surprised to see this last night as many of the MLPerf Inference v0.5 submitters used this package without any problems including Alibaba, Google, Intel and Qualcomm.

But it seems that the URL is no longer valid:

$ ck install package:imagenet-2012-val

Searching if CK environment for this package already exists using:
  * Tags: image-classification,dataset,imagenet,2012,val,full,raw,original,jpg,caffe,ilsvrc2012,channel-stable,host-os-linux-64,target-os-linux-64,64bits

CK environment not found for this package ...

*** Installation path used: /home/anton/CK_TOOLS/dataset-imagenet-ilsvrc2012-val

Installing to /home/anton/CK_TOOLS/dataset-imagenet-ilsvrc2012-val

Checking whether '/home/anton/CK_TOOLS/dataset-imagenet-ilsvrc2012-val/ILSVRC2012_img_val.tar' already exists ...

Downloading ILSVRC'12 validation dataset from 'http://www.image-net.org/challenges/LSVRC/2012/nnoupb/ILSVRC2012_img_val.tar' ...
--2019-11-07 09:29:31--  http://www.image-net.org/challenges/LSVRC/2012/nnoupb/ILSVRC2012_img_val.tar
Resolving www.image-net.org (www.image-net.org)... 171.64.68.16
Connecting to www.image-net.org (www.image-net.org)|171.64.68.16|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-11-07 09:29:31 ERROR 404: Not Found.

Error: Downloading ILSVRC'12 validation set from 'http://www.image-net.org/challenges/LSVRC/2012/nnoupb/ILSVRC2012_img_val.tar' failed!

It fails without CK too:

$ wget http://www.image-net.org/challenges/LSVRC/2012/nnoupb/ILSVRC2012_img_val.tar
--2019-11-07 10:09:28--  http://www.image-net.org/challenges/LSVRC/2012/nnoupb/ILSVRC2012_img_val.tar
Resolving www.image-net.org (www.image-net.org)... 171.64.68.16
Connecting to www.image-net.org (www.image-net.org)|171.64.68.16|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-11-07 10:09:29 ERROR 404: Not Found.

Perhaps the link is temporarily unavailable. Or perhaps it's been permanently removed. Hmm.

We know that ImageNet is available for download via torrents. We will see if we can make an alternative CK package.

psyhtest commented 4 years ago

FYI: We have started to discuss the ImageNet (un)availability in the MLPerf working group.

gfursin commented 4 years ago

Extra ideas here: https://codereef.ai/portal/c/package/imagenet-2012-val

gfursin commented 4 years ago

As suggested by @martinlightmatter, I updated those 2 CK packages (imagenet-2012-val and imagenet-2012-train) with the following error message:

D:\>ck install package:imagenet-2012-val

=============================================================================================
Unfortunately, ImageNet 2012 validation set is no longer publicly available
and this CK meta-package can not automatically download it!

See the related discussions:
* https://CodeReef.ai/portal/c/package/imagenet-2012-val
* https://github.com/pytorch/vision/issues/1453
* https://github.com/ctuning/ck-env/issues/101

However, if you already have it installed on your machine, you can detect
and register it to work with CK workflows using this command:

$ ck detect soft:dataset.imagenet.val --search_dir={directory where the dataset is installed}
=============================================================================================

CK error: [package] this package has a known problem - see the message above!

I uploaded the latest versions of those packages to the CodeReef platform:

One needs to update the ck-env repo to see this message:

$ ck pull repo:ck-env
gfursin commented 3 years ago

Somehow module:package stopped processing packages with "problem":"yes" meta. I fixed that problem. I also added a note about how to download ImageNet via Academic Torrents. I close this ticket ...