SBNSoftware / icarus-production

The repository is intended to support ICARUS production activities
GNU General Public License v3.0
0 stars 0 forks source link

SBNDataPool1 clean-up #49

Open mt82 opened 2 hours ago

mt82 commented 2 hours ago

Dear all, Here is the link to the spreadsheet with the list of the disk paths and their size.

https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_spreadsheets_d_1tHPpwNtrGI46mrg7xGuyzjDVFo5JEjpcYW-5Fz4Y-2D9kQ8_edit-3Fusp-3Ddrivesdk&d=DwIFaQ&c=gRgGjJ3BkIsb5y6s49QqsA&r=qHHNaX-FyUtD4tU3KqK1Mk3WgKA-Lvl1miRd5-369hijK9BUzO34NWsFLWcaqb_o&m=ZsBj7JCb5JShpx__0eWyJm2ofN6kdIW8kZpDOpXZXW8PCtE7Ee6_BxLVjvAWsqXY&s=hZ0UFzkOapbfBtvfEx_KE0pCR8ylj-WROOdnR8fXkUk&e= (Please refer to DU-SBN_FD-Datapool1 sheet)

It would be very important to identify all of those that can be safetly deleted. Their deletion will increase the efficiency of the furthcoming productions.

I would propose a reverse approach: consider all of these paths candidate to be deleted and let me know which ones you are interested in.

Thank you in Advance, Matteo

mt82 commented 2 hours ago

Dear all, I didn't get any feedback regarding the mail below. This means all the data listed in the spreadsheet can be safely deleted and I will proceed to delete them if there are no concerns.

If this is not the case please let me know as soon as possible.

Matteo

mt82 commented 2 hours ago

Thanks for the extra ping, Minerba! And also thank you Matteo!

Gray generated all the samples that I am using in my analysis, and I am checking with them if any are on this list. (I am using slimmed down Pandas Dataframes made from these events, so I am not exactly sure of their source.) If any of these were used for Gray's analysis, which should be a superset of what I am using, we as a collaboration would need to keep them indefinitely for reproducability of the analysis, I would think.

Matteo, if you could wait to hear from me once I've been in touch with Gray that would be great.

Thanks, and sorry for not checking this sooner.

Best, Jamie

mt82 commented 2 hours ago

from @brucehoward-physics Hi Matteo! I see /pnfs/sbn/data/sbn_fd/poms_production/2023A_ICARUS_NuMI_MC_RHC/reverse_horn_current/ on the list of things to be deleted. Please keep this area unless the stuff here has been saved somewhere else too! Wondering if there may be others we are using too :sweat_smile:

mt82 commented 2 hours ago

SBNDataPool1

Paths Requester
/pnfs/sbn/data/sbn_fd/poms_production/2023A_ICARUS_NuMI_MC_RHC/reverse_horn_current/ @brucehoward-physics