The road to _more_ packages on OSX/Win/Linux-aarch

Tobias-Fischer commented 3 years ago

Hi @wolfv, I think it would be a good idea to follow a similar approach as in #94 and build as many packages as possible for the other platforms. I am not sure which script you used to create the list(s) in #94 (successful vs unsuccessful builds); could you please add it to the repo? Then we can build the successful packages for the other platforms as well, which will be nice.

Let me know if/how I can assist.

Best, Tobi

wolfv commented 3 years ago

Hi, IIRC I generated all recipes with vinca using the build_all: true option (I added that option here: https://github.com/RoboStack/vinca/commit/e7dfa6d53746d59adb03c4d5a7c99d79fea1a5fa#diff-104bf9378a734ee0fc4cb7d8842f9cf7b422f2bf2dc6a8b5731baf830a6601ca)

I probably generated multiple recipes.

Then I run boa build recipes/ --skip-existing=fast. The --skip-existing=fast option makes a less accurate comparison of wether a package has already been built (it only checks the name + version and doesn't compute the hash).

Then I let it run until a package doesn't build. Once that happens, I manually moved them from mv ./recipes/mybrokenpkg ./broken_recipes and re-ran boa. It was quite the manual process, unfortunately.

wolfv commented 3 years ago

We could also extend boa to "continue-on-failure" and automatically remove packages with unsatisfiable deps (because an earlier build didn't go through). That could be quite cool (and would be similar to how catkin does things with the -c flag).

Tobias-Fischer commented 3 years ago

Oh gosh, that must have been cumbersome ;). And it would be even more painful on the other platforms as more packages will fail. A continue on failure feature would be great! It shouldn't be too bad to implement, is it?

wolfv commented 3 years ago

No, it shouldn't be too bad ... just need to continue skipping all packages where some parent has been skipped ...

wolfv commented 3 years ago

On Windows, I got the following to build (not tested, though)

06/28/2021  11:03 PM            36,328 ros-noetic-abb-egm-msgs-0.5.2-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:04 PM            58,928 ros-noetic-abb-rapid-msgs-0.5.2-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:05 PM            97,665 ros-noetic-abb-robot-msgs-0.5.2-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:06 PM            32,303 ros-noetic-ackermann-msgs-1.0.2-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:08 PM            44,549 ros-noetic-actionlib-tools-1.13.2-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:16 PM            10,852 ros-noetic-allocators-1.0.25-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:17 PM           119,412 ros-noetic-app-manager-1.2.0-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:18 PM             8,239 ros-noetic-arbotix-firmware-0.11.0-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:19 PM            43,629 ros-noetic-arbotix-msgs-0.11.0-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:21 PM            87,114 ros-noetic-assisted-teleop-0.3.4-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:22 PM            11,741 ros-noetic-async-comm-0.2.1-py38h7c8cae0_9.tar.bz2
06/28/2021  11:24 PM           659,957 ros-noetic-audibot-description-0.2.1-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:25 PM            29,468 ros-noetic-audio-common-msgs-0.3.11-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:27 PM            46,088 ros-noetic-autoware-can-msgs-1.14.0-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:29 PM           110,887 ros-noetic-autoware-config-msgs-1.14.0-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:29 PM            28,010 ros-noetic-autoware-lanelet2-msgs-1.14.0-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:31 PM            92,501 ros-noetic-autoware-map-msgs-1.14.0-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:32 PM            48,844 ros-noetic-autoware-system-msgs-1.14.0-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:33 PM            55,240 ros-noetic-auv-msgs-0.1.1-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:39 PM            23,988 ros-noetic-baldor-0.1.3-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:46 PM            96,623 ros-noetic-calibration-msgs-0.10.15-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:47 PM            28,096 ros-noetic-can-msgs-0.8.5-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:48 PM           136,527 ros-noetic-capabilities-0.3.1-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:50 PM            82,179 ros-noetic-cartesian-control-msgs-0.1.0-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:51 PM            12,633 ros-noetic-cartesian-interface-0.1.3-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:52 PM            26,932 ros-noetic-cartesian-msgs-0.0.3-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:55 PM            53,703 ros-noetic-catkin-virtualenv-0.6.1-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:57 PM            90,940 ros-noetic-cob-actions-0.7.4-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:58 PM            62,252 ros-noetic-cob-android-msgs-0.1.9-py38h4b9bc1a_9.tar.bz2
06/28/2021  11:59 PM            29,528 ros-noetic-cob-android-resource-server-0.1.9-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:00 AM             9,713 ros-noetic-cob-android-settings-0.1.9-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:04 AM           369,280 ros-noetic-cob-cam3d-throttle-0.6.17-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:05 AM            46,524 ros-noetic-cob-control-mode-adapter-0.8.13-py38h7c8cae0_9.tar.bz2
06/29/2021  12:07 AM            40,537 ros-noetic-cob-control-msgs-0.8.13-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:08 AM           106,302 ros-noetic-cob-default-env-config-0.6.12-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:11 AM         8,809,548 ros-noetic-cob-description-0.7.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:11 AM             9,182 ros-noetic-cob-docker-control-0.6.10-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:21 AM            47,214 ros-noetic-cob-gazebo-tools-0.7.5-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:25 AM            40,710 ros-noetic-cob-interactive-teleop-0.6.21-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:28 AM           712,413 ros-noetic-cob-lookat-action-0.7.5-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:32 AM            20,276 ros-noetic-cob-moveit-config-0.7.5-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:33 AM            50,373 ros-noetic-cob-msgs-0.7.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:34 AM            15,151 ros-noetic-cob-navigation-config-0.6.11-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:36 AM            80,836 ros-noetic-cob-perception-msgs-0.6.17-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:36 AM             8,470 ros-noetic-cob-reflector-referencing-0.6.10-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:37 AM             9,026 ros-noetic-cob-safety-controller-0.6.10-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:41 AM            40,701 ros-noetic-cob-srvs-0.7.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:42 AM             8,485 ros-noetic-cob-supported-robots-0.6.15-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:44 AM            50,060 ros-noetic-cob-vision-utils-0.6.17-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:48 AM            77,572 ros-noetic-computer-status-msgs-2.0.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:52 AM        15,892,175 ros-noetic-control-box-rst-0.0.7-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:53 AM            13,418 ros-noetic-controller-manager-tests-0.19.5-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:55 AM            36,700 ros-noetic-costmap-cspace-msgs-0.8.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:58 AM           150,521 ros-noetic-cv-camera-0.5.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  12:59 AM            59,805 ros-noetic-darknet-ros-msgs-1.1.5-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:00 AM            52,247 ros-noetic-dataspeed-pds-msgs-1.0.6-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:01 AM            35,900 ros-noetic-dataspeed-ulc-msgs-0.0.5-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:03 AM         8,820,100 ros-noetic-dbw-fca-description-1.2.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:05 AM           115,925 ros-noetic-dbw-fca-msgs-1.2.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:07 AM        26,532,247 ros-noetic-dbw-mkz-description-1.4.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:08 AM           129,978 ros-noetic-dbw-mkz-msgs-1.4.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:10 AM         3,444,250 ros-noetic-dbw-polaris-description-1.0.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:11 AM            61,645 ros-noetic-dbw-polaris-msgs-1.0.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:13 AM           279,471 ros-noetic-ddynamic-reconfigure-0.3.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:15 AM            13,478 ros-noetic-ddynamic-reconfigure-python-0.0.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:19 AM           317,594 ros-noetic-depthimage-to-laserscan-1.0.8-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:21 AM            38,859 ros-noetic-dialogflow-task-executive-2.1.21-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:24 AM            36,444 ros-noetic-driver-base-1.6.9-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:25 AM        13,888,751 ros-noetic-drone-assets-1.4.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:27 AM            19,091 ros-noetic-drone-wrapper-1.4.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:32 AM            64,785 ros-noetic-dynamic-tf-publisher-2.2.11-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:35 AM            38,530 ros-noetic-easy-markers-0.3.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:36 AM            10,204 ros-noetic-ecl-license-0.61.8-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:43 AM         3,753,537 ros-noetic-exotica-val-description-1.0.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:44 AM           121,994 ros-noetic-explore-lite-2.1.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:46 AM            28,635 ros-noetic-fadecandy-msgs-0.2.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:49 AM            63,205 ros-noetic-fetch-auto-dock-msgs-1.2.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:51 AM         7,004,222 ros-noetic-fetch-description-0.9.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:54 AM           279,983 ros-noetic-fetch-maps-0.9.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  01:55 AM           151,809 ros-noetic-fetch-teleop-0.9.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:00 AM            67,944 ros-noetic-fkie-multimaster-msgs-1.2.7-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:03 AM           135,091 ros-noetic-flexbe-msgs-1.3.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:05 AM            32,892 ros-noetic-four-wheel-steering-msgs-1.1.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:06 AM            29,408 ros-noetic-foxglove-msgs-1.0.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:11 AM            46,380 ros-noetic-gazebo-video-monitor-msgs-0.6.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:12 AM            42,270 ros-noetic-gdrive-ros-2.1.21-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:13 AM            31,738 ros-noetic-generic-throttle-0.6.21-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:14 AM            47,990 ros-noetic-genmypy-0.3.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:16 AM            66,381 ros-noetic-goal-passer-0.3.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:18 AM            11,869 ros-noetic-gpp-interface-0.1.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:19 AM           105,122 ros-noetic-gps-common-0.3.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:21 AM            16,405 ros-noetic-graceful-controller-0.4.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:24 AM           158,683 ros-noetic-grasping-msgs-0.3.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:25 AM            14,606 ros-noetic-grid-map-costmap-2d-1.6.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:30 AM            77,367 ros-noetic-grid-map-sdf-1.6.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:35 AM           181,333 ros-noetic-hector-gazebo-thermal-camera-0.5.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:36 AM         1,296,260 ros-noetic-hector-gazebo-worlds-0.5.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:38 AM            28,292 ros-noetic-hector-imu-attitude-to-tf-0.5.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:40 AM            39,887 ros-noetic-hector-imu-tools-0.5.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:41 AM            13,488 ros-noetic-hector-map-tools-0.5.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:43 AM           188,196 ros-noetic-hector-mapping-0.5.2-py38h7c8cae0_9.tar.bz2
06/29/2021  02:44 AM            13,258 ros-noetic-hector-marker-drawing-0.5.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:45 AM            50,059 ros-noetic-hector-nav-msgs-0.5.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:47 AM             9,451 ros-noetic-hector-xacro-tools-0.5.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  02:55 AM           304,630 ros-noetic-image-view2-2.2.11-py38h3ef910b_9.tar.bz2
06/29/2021  02:58 AM            47,347 ros-noetic-imu-processors-0.3.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:00 AM           458,998 ros-noetic-imu-transformer-0.3.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:02 AM            65,520 ros-noetic-industrial-msgs-0.7.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:03 AM            10,979 ros-noetic-industrial-robot-status-interface-0.1.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:05 AM            37,379 ros-noetic-ipa-3d-fov-visualization-0.6.17-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:07 AM            32,403 ros-noetic-ixblue-ins-msgs-0.1.5-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:08 AM           235,509 ros-noetic-ixblue-stdbin-decoder-0.2.0-py38h508dd2d_9.tar.bz2
06/29/2021  03:10 AM            11,797 ros-noetic-joy-listener-0.3.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:11 AM            79,020 ros-noetic-jsk-footstep-msgs-4.3.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:12 AM            67,635 ros-noetic-jsk-gui-msgs-4.3.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:13 AM            27,891 ros-noetic-jsk-hark-msgs-4.3.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:16 AM           176,658 ros-noetic-jsk-network-tools-2.2.11-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:17 AM             9,898 ros-noetic-kalman-filter-0.3.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:19 AM            31,193 ros-noetic-key-teleop-0.4.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:20 AM            98,334 ros-noetic-kobuki-msgs-0.7.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:22 AM            81,120 ros-noetic-laser-filters-jsk-patch-2.1.21-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:25 AM           475,158 ros-noetic-laser-ortho-projector-0.3.3-py38h9784821_9.tar.bz2
06/29/2021  03:27 AM           117,717 ros-noetic-laser-scan-densifier-0.7.5-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:29 AM           176,657 ros-noetic-laser-scan-sparsifier-0.3.3-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:30 AM           188,005 ros-noetic-laser-scan-splitter-0.3.3-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:32 AM            37,990 ros-noetic-led-msgs-0.0.11-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:33 AM         5,909,085 ros-noetic-leo-description-1.2.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:39 AM             8,331 ros-noetic-lpg-planner-2.1.21-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:42 AM            30,272 ros-noetic-map-laser-0.0.5-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:43 AM            28,965 ros-noetic-map-organizer-msgs-0.8.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:44 AM            55,219 ros-noetic-marker-msgs-0.0.6-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:45 AM            28,487 ros-noetic-marti-can-msgs-0.10.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:46 AM            62,500 ros-noetic-marti-common-msgs-0.10.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:47 AM            10,748 ros-noetic-marti-data-structures-2.14.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:48 AM            38,358 ros-noetic-marti-dbw-msgs-0.10.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:49 AM            27,016 ros-noetic-marti-perception-msgs-0.10.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:51 AM            60,695 ros-noetic-marti-sensor-msgs-0.10.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:52 AM            29,952 ros-noetic-marti-status-msgs-0.10.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:53 AM            39,285 ros-noetic-marti-visualization-msgs-0.10.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:57 AM         1,102,211 ros-noetic-mbf-abstract-nav-0.3.4-py38h4b9bc1a_9.tar.bz2
06/29/2021  03:59 AM            37,766 ros-noetic-mcl-3dl-msgs-0.6.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:00 AM           110,737 ros-noetic-mesh-msgs-1.0.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:02 AM            52,911 ros-noetic-message-to-tf-0.4.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:04 AM            66,362 ros-noetic-mini-maxwell-2.1.21-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:06 AM            71,286 ros-noetic-mir-actions-1.1.3-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:07 AM         1,552,651 ros-noetic-mir-description-1.1.3-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:09 AM           196,025 ros-noetic-mir-msgs-1.1.3-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:13 AM            30,992 ros-noetic-mouse-teleop-0.4.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:14 AM            58,958 ros-noetic-move-base-sequence-0.0.1-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:17 AM            61,746 ros-noetic-moveit-python-0.4.2-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:19 AM             5,484 ros-noetic-moveit-resources-0.8.0-py38h4b9bc1a_9.tar.bz2
06/29/2021  04:21 AM             5,461 ros-noetic-moveit-runtime-1.1.5-py38h4b9bc1a_9.tar.bz2

I think the build stopped in ros-noetic-mpc-local-planner, unfortunately.

Tobias-Fischer commented 3 years ago

Trigged a build of those packages + the osx packages that built successfully: https://github.com/RoboStack/ros-noetic/commit/388dee6a0ae0c5a3e54ade73dac0b2db383f27bb

Let's see ;)

Tobias-Fischer commented 3 years ago

I think https://github.com/RoboStack/ros-noetic/issues/94 is enough

RoboStack / ros-noetic

The road to _more_ packages on OSX/Win/Linux-aarch #143