search

ros-infrastructure / ros_buildfarm

ROS buildfarm based on Docker
Apache License 2.0
82 stars 96 forks source link

sourcedeb upload directories are not getting cleaned up #304

Closed tfoote closed 8 years ago

tfoote commented 8 years ago

It only appears to be a few. I suspect these are the failed import jobs.

The data here is slowly accumulating. It's not a huge rate but it should be cleaned up. 

root@ip-172-31-9-243:/var/repos/ubuntu/building/queue/trusty# du -hcs *
16K Ibin_uT64__arbotix_controllers__ubuntu_trusty_amd64__binary__3
28K Isrc_uT__ax2550__ubuntu_trusty__source__10
28K Isrc_uT__ax2550__ubuntu_trusty__source__11
28K Isrc_uT__ax2550__ubuntu_trusty__source__17
28K Isrc_uT__ax2550__ubuntu_trusty__source__21
28K Isrc_uT__ax2550__ubuntu_trusty__source__23
28K Isrc_uT__ax2550__ubuntu_trusty__source__8
2.2M    Isrc_uT__baxtereus__ubuntu_trusty__source__14
20K Isrc_uT__imu_monitor__ubuntu_trusty__source__10
20K Isrc_uT__imu_monitor__ubuntu_trusty__source__13
20K Isrc_uT__imu_monitor__ubuntu_trusty__source__8
24K Isrc_uT__jsk_201504_miraikan__ubuntu_trusty__source__14
856K    Isrc_uT__jsk_baxter_desktop__ubuntu_trusty__source__14
2.4M    Isrc_uT__jsk_baxter_startup__ubuntu_trusty__source__14
20K Isrc_uT__jsk_baxter_web__ubuntu_trusty__source__14
1.1M    Isrc_uT__jsk_fetch_startup__ubuntu_trusty__source__6
20K Isrc_uT__jsk_nao_startup__ubuntu_trusty__source__14
28K Isrc_uT__jsk_pepper_startup__ubuntu_trusty__source__14
20K Isrc_uT__jsk_pr2_calibration__ubuntu_trusty__source__14
2.2M    Isrc_uT__jsk_pr2_startup__ubuntu_trusty__source__14
392K    Isrc_uT__jsk_robot_startup__ubuntu_trusty__source__14
20K Isrc_uT__jsk_robot__ubuntu_trusty__source__4
24K Isrc_uT__jsk_robot_utils__ubuntu_trusty__source__14
20K Isrc_uT__marti_data_structures__ubuntu_trusty__source__9
488K    Isrc_uT__mavlink__ubuntu_trusty__source__12
36K Isrc_uT__moveit_commander__ubuntu_trusty__source__8
20K Isrc_uT__moveit_fake_controller_manager__ubuntu_trusty__source__8
20K Isrc_uT__moveit_plugins__ubuntu_trusty__source__8
24K Isrc_uT__moveit_simple_controller_manager__ubuntu_trusty__source__8
1.2M    Isrc_uT__moveit_visual_tools__ubuntu_trusty__source__10
28K Isrc_uT__naoeus__ubuntu_trusty__source__14
24K Isrc_uT__naoqieus__ubuntu_trusty__source__14
148K    Isrc_uT__naoqi_libqicore__ubuntu_trusty__source__8
520K    Isrc_uT__naoqi_libqi__ubuntu_trusty__source__9
20K Isrc_uT__parrot_arsdk__ubuntu_trusty__source__2
20K Isrc_uT__parrot_arsdk__ubuntu_trusty__source__4
20K Isrc_uT__peppereus__ubuntu_trusty__source__14
28K Isrc_uT__pid__ubuntu_trusty__source__8
24K Isrc_uT__pr2_app_manager__ubuntu_trusty__source__9
20K Isrc_uT__pr2_apps__ubuntu_trusty__source__9
28K Isrc_uT__pr2_base_trajectory_action__ubuntu_trusty__source__14
28K Isrc_uT__pr2_bringup__ubuntu_trusty__source__10
32K Isrc_uT__pr2_bringup__ubuntu_trusty__source__13
28K Isrc_uT__pr2_bringup__ubuntu_trusty__source__8
32K Isrc_uT__pr2_camera_synchronizer__ubuntu_trusty__source__10
32K Isrc_uT__pr2_camera_synchronizer__ubuntu_trusty__source__13
32K Isrc_uT__pr2_camera_synchronizer__ubuntu_trusty__source__8
36K Isrc_uT__pr2_computer_monitor__ubuntu_trusty__source__10
36K Isrc_uT__pr2_computer_monitor__ubuntu_trusty__source__13
36K Isrc_uT__pr2_computer_monitor__ubuntu_trusty__source__8
24K Isrc_uT__pr2_controller_configuration__ubuntu_trusty__source__10
24K Isrc_uT__pr2_controller_configuration__ubuntu_trusty__source__13
24K Isrc_uT__pr2_controller_configuration__ubuntu_trusty__source__8
28K Isrc_uT__pr2_ethercat__ubuntu_trusty__source__10
28K Isrc_uT__pr2_ethercat__ubuntu_trusty__source__13
28K Isrc_uT__pr2_ethercat__ubuntu_trusty__source__8
40K Isrc_uT__pr2_mannequin_mode__ubuntu_trusty__source__9
20K Isrc_uT__pr2_position_scripts__ubuntu_trusty__source__9
20K Isrc_uT__pr2_robot__ubuntu_trusty__source__10
20K Isrc_uT__pr2_robot__ubuntu_trusty__source__13
20K Isrc_uT__pr2_robot__ubuntu_trusty__source__8
20K Isrc_uT__pr2_run_stop_auto_restart__ubuntu_trusty__source__10
20K Isrc_uT__pr2_run_stop_auto_restart__ubuntu_trusty__source__13
20K Isrc_uT__pr2_run_stop_auto_restart__ubuntu_trusty__source__8
44K Isrc_uT__pr2_teleop_general__ubuntu_trusty__source__9
52K Isrc_uT__pr2_teleop__ubuntu_trusty__source__9
104K    Isrc_uT__pr2_tuckarm__ubuntu_trusty__source__9
3.0M    Isrc_uT__romeo_description__ubuntu_trusty__source__8
40K Isrc_uT__romeo_moveit_actions__ubuntu_trusty__source__9
20K Isrc_uT__romeo_robot__ubuntu_trusty__source__8
24K Isrc_uT__rosapi__ubuntu_trusty__source__9
68K Isrc_uT__rosbridge_library__ubuntu_trusty__source__9
316K    Isrc_uT__rosbridge_server__ubuntu_trusty__source__9
20K Isrc_uT__rosbridge_suite__ubuntu_trusty__source__9
24K Isrc_uT__roseus_remote__ubuntu_trusty__source__13
1.2M    Isrc_uT__rtabmap_ros__ubuntu_trusty__source__8
17M Isrc_uT__rtabmap__ubuntu_trusty__source__10
17M Isrc_uT__rtabmap__ubuntu_trusty__source__12
17M Isrc_uT__rtabmap__ubuntu_trusty__source__8
36K Isrc_uT__softkinetic__ubuntu_trusty__source__1
36K Isrc_uT__softkinetic__ubuntu_trusty__source__10
36K Isrc_uT__softkinetic__ubuntu_trusty__source__11
36K Isrc_uT__softkinetic__ubuntu_trusty__source__12
36K Isrc_uT__softkinetic__ubuntu_trusty__source__13
36K Isrc_uT__softkinetic__ubuntu_trusty__source__14
36K Isrc_uT__softkinetic__ubuntu_trusty__source__15
36K Isrc_uT__softkinetic__ubuntu_trusty__source__16
36K Isrc_uT__softkinetic__ubuntu_trusty__source__17
36K Isrc_uT__softkinetic__ubuntu_trusty__source__18
36K Isrc_uT__softkinetic__ubuntu_trusty__source__19
36K Isrc_uT__softkinetic__ubuntu_trusty__source__2
36K Isrc_uT__softkinetic__ubuntu_trusty__source__20
36K Isrc_uT__softkinetic__ubuntu_trusty__source__21
36K Isrc_uT__softkinetic__ubuntu_trusty__source__22
36K Isrc_uT__softkinetic__ubuntu_trusty__source__23
36K Isrc_uT__softkinetic__ubuntu_trusty__source__24
36K Isrc_uT__softkinetic__ubuntu_trusty__source__25
36K Isrc_uT__softkinetic__ubuntu_trusty__source__26
36K Isrc_uT__softkinetic__ubuntu_trusty__source__27
36K Isrc_uT__softkinetic__ubuntu_trusty__source__28
20K Isrc_uT__softkinetic__ubuntu_trusty__source__29
36K Isrc_uT__softkinetic__ubuntu_trusty__source__3
20K Isrc_uT__softkinetic__ubuntu_trusty__source__30
20K Isrc_uT__softkinetic__ubuntu_trusty__source__31
20K Isrc_uT__softkinetic__ubuntu_trusty__source__32
20K Isrc_uT__softkinetic__ubuntu_trusty__source__33
20K Isrc_uT__softkinetic__ubuntu_trusty__source__34
20K Isrc_uT__softkinetic__ubuntu_trusty__source__35
36K Isrc_uT__softkinetic__ubuntu_trusty__source__4
36K Isrc_uT__softkinetic__ubuntu_trusty__source__5
36K Isrc_uT__softkinetic__ubuntu_trusty__source__6
36K Isrc_uT__softkinetic__ubuntu_trusty__source__7
36K Isrc_uT__softkinetic__ubuntu_trusty__source__8
36K Isrc_uT__softkinetic__ubuntu_trusty__source__9
20K Isrc_uT__swri_console_util__ubuntu_trusty__source__9
24K Isrc_uT__swri_geometry_util__ubuntu_trusty__source__9
40K Isrc_uT__swri_image_util__ubuntu_trusty__source__9
32K Isrc_uT__swri_math_util__ubuntu_trusty__source__9
24K Isrc_uT__swri_opencv_util__ubuntu_trusty__source__9
20K Isrc_uT__swri_prefix_tools__ubuntu_trusty__source__9
32K Isrc_uT__swri_roscpp__ubuntu_trusty__source__9
24K Isrc_uT__swri_serial_util__ubuntu_trusty__source__9
20K Isrc_uT__swri_string_util__ubuntu_trusty__source__9
24K Isrc_uT__swri_system_util__ubuntu_trusty__source__9
44K Isrc_uT__swri_transform_util__ubuntu_trusty__source__9
20K Isrc_uT__swri_yaml_util__ubuntu_trusty__source__9
96K Isrc_uT__tf_keyboard_cal__ubuntu_trusty__source__9
36K Isrc_uT__uavc_v4lctl__ubuntu_trusty__source__2
23M Isrc_uT__visp__ubuntu_trusty__source__5
444K    Jsrc_uT__checkerboard_detector__ubuntu_trusty__source__3
444K    Jsrc_uT__checkerboard_detector__ubuntu_trusty__source__5
444K    Jsrc_uT__checkerboard_detector__ubuntu_trusty__source__8
676K    Jsrc_uT__imagesift__ubuntu_trusty__source__3
676K    Jsrc_uT__imagesift__ubuntu_trusty__source__5
676K    Jsrc_uT__imagesift__ubuntu_trusty__source__8
24M Jsrc_uT__jsk_pcl_ros__ubuntu_trusty__source__3
24M Jsrc_uT__jsk_pcl_ros__ubuntu_trusty__source__5
24M Jsrc_uT__jsk_pcl_ros__ubuntu_trusty__source__8
456K    Jsrc_uT__jsk_pcl_ros_utils__ubuntu_trusty__source__2
456K    Jsrc_uT__jsk_pcl_ros_utils__ubuntu_trusty__source__4
456K    Jsrc_uT__jsk_pcl_ros_utils__ubuntu_trusty__source__7
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__10
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__11
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__12
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__13
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__14
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__15
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__16
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__17
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__18
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__19
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__20
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__21
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__3
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__4
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__5
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__6
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__7
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__8
27M Jsrc_uT__jsk_perception__ubuntu_trusty__source__9
24K Jsrc_uT__jsk_recognition_msgs__ubuntu_trusty__source__3
24K Jsrc_uT__jsk_recognition_msgs__ubuntu_trusty__source__5
24K Jsrc_uT__jsk_recognition_msgs__ubuntu_trusty__source__8
20K Jsrc_uT__jsk_recognition__ubuntu_trusty__source__3
20K Jsrc_uT__jsk_recognition__ubuntu_trusty__source__5
20K Jsrc_uT__jsk_recognition__ubuntu_trusty__source__8
72K Jsrc_uT__jsk_recognition_utils__ubuntu_trusty__source__3
72K Jsrc_uT__jsk_recognition_utils__ubuntu_trusty__source__5
68K Jsrc_uT__jsk_recognition_utils__ubuntu_trusty__source__8
1.5M    Jsrc_uT__libg2o__ubuntu_trusty__source__2
1.5M    Jsrc_uT__libg2o__ubuntu_trusty__source__3
488K    Jsrc_uT__mavlink__ubuntu_trusty__source__6
24K Jsrc_uT__ntpd_driver__ubuntu_trusty__source__2
80K Jsrc_uT__open_karto__ubuntu_trusty__source__2
2.9M    Jsrc_uT__openrtm_aist__ubuntu_trusty__source__2
28K Jsrc_uT__pid__ubuntu_trusty__source__2
28K Jsrc_uT__pid__ubuntu_trusty__source__3
28K Jsrc_uT__resized_image_transport__ubuntu_trusty__source__3
28K Jsrc_uT__resized_image_transport__ubuntu_trusty__source__5
28K Jsrc_uT__resized_image_transport__ubuntu_trusty__source__8
24K Jsrc_uT__romeo_bringup__ubuntu_trusty__source__2
3.0M    Jsrc_uT__romeo_description__ubuntu_trusty__source__2
20K Jsrc_uT__romeo_robot__ubuntu_trusty__source__2
24K Jsrc_uT__romeo_sensors_py__ubuntu_trusty__source__2
24K Jsrc_uT__rosapi__ubuntu_trusty__source__3
68K Jsrc_uT__rosbridge_library__ubuntu_trusty__source__3
316K    Jsrc_uT__rosbridge_server__ubuntu_trusty__source__3
20K Jsrc_uT__rosbridge_suite__ubuntu_trusty__source__3
1.3M    Jsrc_uT__rospilot__ubuntu_trusty__source__3
92K Jsrc_uT__rplidar_ros__ubuntu_trusty__source__2
1.2M    Jsrc_uT__rtabmap_ros__ubuntu_trusty__source__2
1.2M    Jsrc_uT__rtabmap_ros__ubuntu_trusty__source__6
17M Jsrc_uT__rtabmap__ubuntu_trusty__source__2
17M Jsrc_uT__rtabmap__ubuntu_trusty__source__4
17M Jsrc_uT__rtabmap__ubuntu_trusty__source__6
40K Jsrc_uT__sophus__ubuntu_trusty__source__2
23M Jsrc_uT__visp__ubuntu_trusty__source__2
749M    total
dirk-thomas commented 8 years ago

Just looking at this job (http://build.ros.org/job/Isrc_uT__ax2550__ubuntu_trusty__source/) I seems that the left over artifacts are from failed builds. Looking at a recently the failed build (http://build.ros.org/job/Isrc_uT__baxtereus__ubuntu_trusty__source/14/console#console-section-12) specifically the sourcedeb job worked as expected. But in the triggered import job (http://build.ros.org/job/Irel_import-package/83488/console) reprepro fails and doesn't clean up the files in that case.

@tfoote Can you please either move this ticket to reprepro if it is supposed to clean up the files as requested - even in the case of a problem. Or modify how reprepro is being invoked in the import job to ensure the files are being cleaned up in case reprepro fails.

tfoote commented 8 years ago

refiled at: https://github.com/ros-infrastructure/reprepro-updater/issues/33