search

octoenergy / timeserio

Better `keras` models for time series and beyond
MIT License
60 stars 16 forks source link

Support Tensor extension dtype in PandasValueSelector #25

Closed ig248 closed 4 years ago

ig248 commented 4 years ago

Support for (somewhat experimental) extension defined in https://github.com/ig248/tensorpandas

image

Instead of using a multiindex, higher-dimensional features like embeddings or even images/videos are stored in a custom ExtensionArray type backed by a single ndarray. As a data container, it supports the usual slicing/iloc operations.

PandasValueSelector will work correctly with a mix of 1D tensors (2D including index dimension) + regular columns, OR with one or more higher-dimensional tensor columns of same dimensionality (e.g. if we store two images per row each as a 2D tensor - 3D including index dim)

ig248 commented 4 years ago

probably be a good idea to add tensorpandas to the Pipenv dev dependencies

I remember why I didn't, trying to lock it is a pain :D when are you embracing Poetry? 😄

ig248 commented 4 years ago

Oh...

ig248 commented 4 years ago

Appears related to recently introduced https://github.com/spulec/moto/issues/3259