colcon / colcon-parallel-executor

Extension for colcon to process packages in parallel
http://colcon.readthedocs.io
Apache License 2.0
2 stars 4 forks source link

all `cc1plus` processes are in `D = uninterruptible sleep` while using parallel-executor #33

Open razr opened 1 year ago

razr commented 1 year ago

I have tried to build Autoware as

colcon build --symlink-install --merge-install  \
--cmake-args -DCMAKE_BUILD_TYPE=Release -DBUILD_TESTING=OFF

and my 24-core system literally dies (no response, need to reboot). top shows all cc1plus processes are in D = uninterruptible sleep

The only escape is to add --executor sequential Something is wrong with the way the colcon-parallel-executor works.

I'm using docker to build it:

rocker -e LIBGL_ALWAYS_SOFTWARE=1 --x11 --user --volume $HOME/github/autowarefoundation/autoware/ -- ghcr.io/autowarefoundation/autoware-universe:latest-cuda

colcon build --symlink-install --merge-install  \
--cmake-args -DCMAKE_BUILD_TYPE=Release -DBUILD_TESTING=OFF
cottsay commented 9 months ago

Does reducing the parallelism (--parallel-workers 8) show the same behavior?

Is there some way I can reproduce this locally to debug the problem?