ml-infra build fails due to HUGE logs

src-d / infrastructure-dockerfiles

Dockerfile-s to build the images which power source{d}'s computing infrastructure.

Other

22 stars 13 forks source link

ml-infra build fails due to HUGE logs #40

Open vmarkovtsev opened 5 years ago

vmarkovtsev commented 5 years ago

I have noticed that if I update the lowest image in our stack - ml-infra-base-python - the CI build fails due to the log exceeding the maximum length limit.

This is most likely due to building numpy and scipy, which floods the console with verbose compilation commands.

I am not sure what's the best way to solve this problem:

Silence numpy and scipy
Invent something else in the CI scripts and avoid this problem once and for all

vmarkovtsev commented 5 years ago

What's your opinion, @src-d/infrastructure?

rporres commented 5 years ago

I would start limiting the amount of output of the most verbose parts of the build but done in a way that you know where the problem is so that you can reproduce it.