mmcdermott / MEDS_Tabular_AutoML

Limited automatic tabular ML pipelines for generic MEDS datasets.
MIT License
5 stars 2 forks source link

Sparse static aggregations #41

Open Oufattole opened 1 month ago

Oufattole commented 1 month ago

We should make the pivot operation sparse and efficient for static variables as well. Currently, we do a dense pivot.

mmcdermott commented 1 month ago

We should examine the extent to which static data is actually sparse vs. dense -- if it is dense in practice then using a dense pivot is appropriate.