astronomy-commons / hipscat-import

HiPSCat import - generate HiPSCat-partitioned catalogs
https://hipscat-import.readthedocs.io
BSD 3-Clause "New" or "Revised" License
5 stars 3 forks source link

Use index mask filtering for margin generation #353

Closed delucchi-cmu closed 1 month ago

delucchi-cmu commented 1 month ago

Similar to the splitting stage of the catalog import pipeline, create the margin shards via loop through possible margin pixels and creating an index mask. This avoids the expensive groupby/apply.