search

threeML / hawc_hal

HAWC Accelerated Likelihood - python-only framework for HAWC data analysis
BSD 3-Clause "New" or "Revised" License
11 stars 22 forks source link

High HD5 memory usage #28

Closed lundeenj closed 3 years ago

lundeenj commented 5 years ago

Reading in maptrees in .hd5 format with HAL consumes large amounts of memory (order 20GB) even with fairly small ROIs (~ 4 degree data radius, 9 degree model radius).

github-actions[bot] commented 3 years ago

This issue has become stale. Is there an update? We will close in 14 days

grburgess commented 3 years ago

It could be related to pandas handling of HDF5. One way around this would be to write a direct interface via h5py

github-actions[bot] commented 3 years ago

This issue has become stale. Is there an update? We will close in 14 days