ctuning / reproduce-milepost-project

Collective Knowledge workflow for the MILEPOST GCC (machine learning based compiler). See how it is used in the collaborative project with the Raspberry Pi foundation to support collaborative research for multi-objective autotuning and machine learning techniques, and prototype reproducible papers with portable workflows:
http://cKnowledge.org/rpi-crowd-tuning
GNU General Public License v2.0
47 stars 6 forks source link

Cannot reproduce milepost project via given tutorial #3

Closed hydai closed 7 years ago

hydai commented 7 years ago

Hi, I followed README to get Milepost GCC. But I got some error.

My environment:

Distributor ID: Ubuntu
Description:    Ubuntu 16.04.3 LTS
Release:        16.04
Codename:       xenial
CPU: Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz

Here is the script I used:

$ pip install ck
$ sudo apt-get install m4
$ sudo apt-get install build-essential automake autoconf libncurses-dev uuid-runtime
$ ck pull repo:reproduce-milepost-project
$ ck install package:compiler-ctuning-cc-2.5-src

When I type ck install package:compiler-ctuning-cc-2.5-src, the ck reports the following error messages:

https://gist.github.com/hydai/9a7aee806e438e45600d3aa84ec43277

gfursin commented 7 years ago

Hi,

It's now becoming increasingly difficult to rebuild MILEPOST GCC on the latest environment and with latest packages.

I remember that Abdul (in CC) had related problems. Abdul, do you remember how did you fix that? Can you help with that, please?

I am now very busy with current projects, but I see two longer-term solutions:

Cheers, Grigori

On 2017-09-06 05:29, hydai wrote:

Hi, I followed README to get Milepost GCC. But I got some error.

My environment:

|Distributor ID: Ubuntu Description: Ubuntu 16.04.3 LTS Release: 16.04 Codename: xenial CPU: Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz |

Here is the script I used:

|$ pip install ck $ sudo apt-get install m4 $ sudo apt-get install build-essential automake autoconf libncurses-dev uuid-runtime $ ck pull repo:reproduce-milepost-project $ ck install package:compiler-ctuning-cc-2.5-src |

When I type |ck install package:compiler-ctuning-cc-2.5-src|, the ck reports the following error messages:

https://gist.github.com/hydai/9a7aee806e438e45600d3aa84ec43277

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/ctuning/reproduce-milepost-project/issues/3, or mute the thread https://github.com/notifications/unsubscribe-auth/AHCu5avsorqN6euO92J4ck4FV8hsje6Sks5sfhGvgaJpZM4PNyu6.

gfursin commented 7 years ago

Hi again,

I tried to check installation on a clean Ubuntu 16.04.03 using Docker and it seems that I didn't specify all the dependencies that may result in this crash.

I now added Docker image which builds MILEPOST GCC:

Basically, I install the following deps:

|$ sudo apt-get update && apt-get install -y python-all git bzip2 sudo wget zip $ sudo pip install ck $ sudo apt-get install -y libjpeg8 libjpeg62-dev libfreetype6 libfreetype6-dev python-pillow $ sudo apt-get install -y build-essential automake autoconf libncurses-dev uuid-runtime m4 $ sudo apt-get install -y gcc g++ g++-multilib libc6-dev-i386 $ sudo apt-get install -y texinfo libisl-dev libcloog-isl-dev libmpc-dev libgmp-dev libmpfr-dev | But maybe more importantly I suggest you to use another package which rebuilds old GMP, MPFR, etc (because the new ones have different API): |$ ck pull repo:reproduce-milepost-project $ ck install package:compiler-gcc-4.4.4-milepost-src-deps $ ck install package:compiler-ctuning-cc-2.5-plugins-src $ ck install package:compiler-ctuning-cc-2.5-src | Please, tell me if it works.

You can also try Docker version: $ (sudo) docker run -it ctuning/ck-milepost-gcc-ubuntu16.04 $ cd ck find demo:ctuning-cc $ ./_use_ctuning_cc_directly_extract_features.sh

I updated Readme with these steps ...

Hope it will be useful and thanks for your feedback, Grigori

On 2017-09-06 05:29, hydai wrote:

Hi, I followed README to get Milepost GCC. But I got some error.

My environment:

|Distributor ID: Ubuntu Description: Ubuntu 16.04.3 LTS Release: 16.04 Codename: xenial CPU: Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz |

Here is the script I used:

|$ pip install ck $ sudo apt-get install m4 $ sudo apt-get install build-essential automake autoconf libncurses-dev uuid-runtime $ ck pull repo:reproduce-milepost-project $ ck install package:compiler-ctuning-cc-2.5-src |

When I type |ck install package:compiler-ctuning-cc-2.5-src|, the ck reports the following error messages:

https://gist.github.com/hydai/9a7aee806e438e45600d3aa84ec43277

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/ctuning/reproduce-milepost-project/issues/3, or mute the thread https://github.com/notifications/unsubscribe-auth/AHCu5avsorqN6euO92J4ck4FV8hsje6Sks5sfhGvgaJpZM4PNyu6.

hydai commented 7 years ago

Hi,

Thank you for the information about this issue. I can build Milepost GCC from the dockerfile and extract features from C source code. My next step is to use Milepost GCC to recommend options for the programs.

Thank you for all your assistance. I really appreciate your help in resolving the problem.

Sincerely, hydai

gfursin commented 7 years ago

Sure, you are welcome! Glad that it worked and good luck!