LSSTDESC / SprintWeek2022

Meeting repository for the LSST DESC 2022 Sprint Week
Creative Commons Zero v1.0 Universal
1 stars 0 forks source link

Scaling up PM simulations on Perlmutter for Cosmological Forward Modeling #7

Open EiffL opened 1 year ago

EiffL commented 1 year ago

Scaling up differentiable PM simulations on Perlmutter for Cosmological Forward Modeling

Improving the framework for running differentiable lensing and clustering simulations to scale to larger volumes (i.e. multi-gpu parallelisation; pretty technical), and adding currently missing components (IA models, pz models, galaxy bias models, etc.; new contributor friendly!)

Contacts: @EiffL Day/Time: All week Main communication channel: #desc-sprint-bayescosmo GitHub repo: https://github.com/LSSTDESC/bayesian-pipelines-cosmology Zoom room (if applicable): DESC #19

Goals and deliverable

Resources and skills needed

This sprint has two different skills requirements:

Detailed description

(coming soon)

EiffL commented 1 year ago

Big progress yesterday! 2048^3 FFT successfully distributed on 8 GPUs across two nodes with NCCL

The report is here: https://github.com/DifferentiableUniverseInitiative/JaxPM/issues/8#issuecomment-1281826189