with_decoded=True giving wrong predictions in get_X_preds()

timeseriesAI / tsai

Time series Timeseries Deep Learning Machine Learning Python Pytorch fastai | State-of-the-art Deep Learning library for Time Series and Sequences in Pytorch / fastai

https://timeseriesai.github.io/tsai/

Apache License 2.0

5.21k stars 651 forks source link

with_decoded=True giving wrong predictions in get_X_preds() #605

Closed lwachowiak closed 1 year ago

lwachowiak commented 2 years ago

The automated decoding functionality in get_X_preds does not work reliably for me. Sometimes it decodes the probabilities in a way that the decoding for an individual sample is an array with 3 labels instead of a single label. With some datasets it works correctly with others it gives multiple labels. See this screenshot:

The workaround is simple as you can just decode the probabilities yourself as in the screenshot; but it is still a weird bug.

My setup:

oguiza commented 1 year ago

Hi @lwachowiak, Thanks for sharing this. It's a bit difficult to debug it if I don't understand what's the input and expected output. Could you please share a code snippet to reproduce the issue?