bunnech / cellot

Learning Single-Cell Perturbation Responses using Neural Optimal Transport
BSD 3-Clause "New" or "Revised" License
109 stars 9 forks source link

OOD train test split question #12

Closed DanLesman closed 6 months ago

DanLesman commented 6 months ago

Hi!

I am using CellOT in the OOD setting and I was wondering why you were using a test_size > 0 for split_cell_data_train_test in the ood setting? My thinking is that in OOD you would want to use all the data you can that's outside of the holdout group. Is it for evaluating the performance of the non-ood tasks or maybe something else I am missing?

Thank you so much!

stefangstark commented 6 months ago

Hi Dan,

We wanted the test set to be the same for all experiments, iid and ood

Best, Stefan