search

XENONnT / straxen

Streaming analysis for XENON
BSD 3-Clause "New" or "Revised" License
20 stars 32 forks source link

Potential memory leak #1255

Closed FaroutYLq closed 1 year ago

FaroutYLq commented 1 year ago

Describe the bug This issue is very ambiguous and of lower urgency. I will keep updating every time I have more information.

This was first observed on OSG. This time, it is reproducible on midway2 and midway3. 45GB is NOT enough for processing 5hr long bkg run and 1hr long Kr83m run from raw_records to event_info_double, using 1 CPU for each job.

To Reproduce Insert the MWE of how to reproduce the error

st.make(...)

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Versions Tag: 2023.07.2

dachengx commented 1 year ago

Sorry, are you processing directly from raw_records to event_info_double?

dachengx commented 1 year ago

If we directly process from raw_records to event_info_double on purpose, you will need a large amount of memory. Because the plugins in the middle will be temporarily saved in memory.

FaroutYLq commented 1 year ago

Does it mean that all peaklets+merged_s2s+lone_hits will be staged in RAM instead of disk?

On Sep 6, 2023, at 1:48 PM, Dacheng Xu @.***> wrote:



If we directly process from raw_records to event_info_double on purpose, you will need a large amount of memory. Because the plugins in the middle will be temporarily saved in memory.

— Reply to this email directly, view it on GitHubhttps://github.com/XENONnT/straxen/issues/1255#issuecomment-1708189420, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ALG57ASRJLV5OAPUPVIPMIDXZBPH3ANCNFSM6AAAAAA4LIDUDM. You are receiving this because you authored the thread.Message ID: @.***>

dachengx commented 1 year ago

Does it mean that all peaklets+merged_s2s+lone_hits will be staged in RAM instead of disk? On Sep 6, 2023, at 1:48 PM, Dacheng Xu @.> wrote:  If we directly process from raw_records to event_info_double on purpose, you will need a large amount of memory. Because the plugins in the middle will be temporarily saved in memory. — Reply to this email directly, view it on GitHub<#1255 (comment)>, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ALG57ASRJLV5OAPUPVIPMIDXZBPH3ANCNFSM6AAAAAA4LIDUDM. You are receiving this because you authored the thread.Message ID: @.>

Yes.

FaroutYLq commented 1 year ago

Thanks! Then let me close this just for now. I believe there are still something fishy here but I will explore in that thread.