mlcommons / ck

Collective Knowledge (CK) is an educational community project to learn how to run AI, ML and other emerging workloads in the most efficient and cost-effective way across diverse models, data sets, software and hardware using MLCommons CM (Collective Mind workflow automation framework)
https://cKnowledge.org
Apache License 2.0
606 stars 114 forks source link

ck install package --tags=lib,tflite,v1.15 fails #139

Closed tom-gall closed 3 years ago

tom-gall commented 3 years ago

Same problem as the issue with trying to install tflite v1.13

Download dependencies ...

downloading https://bitbucket.org/eigen/eigen/get/49177915a14a.tar.gz

gzip: stdin: not in gzip format tar: Child returned status 1 tar: Error is not recoverable: exiting now

wget https://bitbucket.org/eigen/eigen/get/49177915a14a.tar.gz --2021-04-02 15:06:59-- https://bitbucket.org/eigen/eigen/get/49177915a14a.tar.gz Resolving bitbucket.org (bitbucket.org)... 104.192.141.1, 2406:da00:ff00::6b17:d1f5, 2406:da00:ff00::22c2:513, ... Connecting to bitbucket.org (bitbucket.org)|104.192.141.1|:443... connected. HTTP request sent, awaiting response... 404 Not Found 2021-04-02 15:06:59 ERROR 404: Not Found.

gfursin commented 3 years ago

Hi @tom-gall . Thank you very much for reporting!

The problem is that eigen was moved from bitbucket to gitlab. I found a solution here and added "eigen.patch" to CK tflite packages v1.13,1.14 and 1.15 (see it in "files section" at cKnowledge.io):

Please, update your CK repos as follows and try again:

ck pull all
ck install package --tags=lib,tflite,v1.15

Hope it works! Thanks again for reporting!

ghost commented 3 years ago

Running the same command I still run into issues, it outputs:

...
--------------------------------
Download dependencies ...

downloading https://bitbucket.org/eigen/eigen/get/49177915a14a.tar.gz

gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error is not recoverable: exiting now

   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   CK detected a PROBLEM in the third-party CK package:

   CK package:           lib-tflite-1.15.0-rc2-src-static
   Native package URL:   https://github.com/tensorflow/tensorflow
   Git checkout:         v1.15.0-rc2
   CK repo:              ck-mlperf
   CK repo URL:          https://github.com/krai/ck-mlperf
   CK package URL:       https://github.com/krai/ck-mlperf/tree/master/package/lib-tflite-1.15.0-rc2-src-static
   Issues URL:           https://github.com/krai/ck-mlperf/issues

   CK stable package URL: https://cKnowledge.io/c/package/lib-tflite-1.15.0-rc2-src-static

   Please, check that there is no discussion about this issue at https://cKnowledge.io/c/package/lib-tflite-1.15.0-rc2-src-static

   Please, submit the original comand line and the *full* log to:
     * https://github.com/ctuning/ck/issues
     * https://github.com/ctuning/ck-mlops/issues
   ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

CK error: [package] package installation failed!

I think is because the https://bitbucket.org/eigen/eigen/get/49177915a14a.tar.gz is not detected. You mentioned it moved to gitlab. Shouldn't be then directed to gitlab in the package/lib-tflite-1.15.0-rc2-src-static/patch.linux/eigen.patch? Would you know how I can fix it? (I did ck pull all).

ghost commented 2 years ago

I had to wget manually the eigen file, the ck pull all wouldn't fetch it.

gfursin commented 2 years ago

Hi @tom-gall . I have to admit that I didn't check the KRAI's fork. I have been fixing the packages in the official MLCommons repository:

By the way, I had a discussion with KRAI's colleagues to merge their updates to the official MLCommons repository and there is an interest to do so - we just need to find time ;) ...

Thanks!