Decide on the final data structure of the analysis module

imperialCHEPI / healthgps

Global Health Policy Simulation model (Health-GPS)

https://imperialchepi.github.io/healthgps/

BSD 3-Clause "New" or "Revised" License

5 stars 1 forks source link

Open jamesturner246 opened 2 weeks ago

jamesturner246 commented 2 weeks ago

We should meet to discuss what the options are, and what they would look like, for the final data structure in the analysis module.

Candidates so far:

A raw std::vector
Eigen Tensor
Apache Arrow Table
Apache Arrow, but offload data analysis to a Python process with PySpark, Polars, Pandas, etcetera

alexdewar commented 2 weeks ago

Sounds good! And I guess once we've tackled the analysis module, we can hopefully adopt a similar approach for the main simulation too 😄