ratt-ru / arcae

Arrow C++ and Python Bindings for casacore
BSD 3-Clause "New" or "Revised" License
4 stars 1 forks source link

Refactor arcae to use a finer-grained execution model #101

Closed sjperkins closed 2 months ago

sjperkins commented 3 months ago

This PR:

by using fine-grained parallelism when accessing the CTDS.

Previously, both CASA Table I/O and Compute operations were performed in a single thread. Now, responsibility for I/O and compute is separated into different threadpool executors. Promises and futures are used to schedule each component of data read/write operations on the appropriate executors.