search

simonsobs / sotodlib

Simons Observatory: Time-Ordered Data processing library.
MIT License
15 stars 17 forks source link

Preprocess: Speedup run time #981

Open msilvafe opened 1 week ago

msilvafe commented 1 week ago

This is a general effort for profiling, and then speeding up underlying code by:

  1. Evaluating if there are inefficiencies in the implementation
  2. Evaluating if there's repeated or unneeded steps
  3. Replacing the slowest steps with python wrapped C-code where appropriate
  4. Evaluating our top-bottom parallelization strategy
skhrg commented 1 week ago

I had brought this up on slack before. But I think numba is a pretty safe and stable way to speed up a lot of this stuff without needing to write as much C. Or at least to provide intertim speedups.

At one point @mhasself seemed to be anti-JIT but I would be curious to know if that stance has softened.