Open bencottier opened 3 years ago
Yeah, that's intentional cause it's pretty common to wanna drop dimensions and not have it error. We could have map
impose that all shared dims remain... and require users to reconstruct the KeyedDataset
from scratch if they want to change that, but that seems like it might get annoying.
it's pretty common to wanna drop dimensions and not have it error. We could have
map
impose that all shared dims remain...
Dropping dimensions is common but I thought it should error because the :train
and :predict
components (in my example) become inconsistent. I don't think we should impose that all shared dims remain. Rather the same dim must be dropped across components, if there is a constraint on that dim between components.
So it would force the user to do map(A -> A(id=:a), ds, (:_, :id))
rather than map(A -> A(id=:a), ds, (:predict, :_))
.
But maybe there is a good reason to only drop a dim on one component, which would make that annoying?
I thought this would throw an error.
MWE:
Whereas it throws an error if the dim preserved: