search

fzi-forschungszentrum-informatik / TSInterpret

An Open-Source Library for the interpretability of time series classifiers
BSD 3-Clause "New" or "Revised" License
121 stars 9 forks source link

LEFTIST Output Is Independent of Data/Model #57

Closed shrezaei closed 7 months ago

shrezaei commented 8 months ago

Describe the bug Regardless of the model and data, the output of the LEFTIST is either the first few time steps or last few time steps. In a few experiment I did, it seems that it purely depends on the class label, not the model or data. Even in the documentation (https://fzi-forschungszentrum-informatik.github.io/TSInterpret/Notebooks/Leftist_torch/) the same issue presents. Here are a few examples where the distinguishable feature is the Sine wave segment of the time series. 0 1 2 3

To Reproduce Steps to reproduce the behavior. Also State the OS and the versions you are using.

Additional context Add any other context about the problem here.

JHoelli commented 8 months ago

Hi @shrezaei,

Thanks for reporting the issue.

I found a small bug in the generation of the heatmaps from the explanations, it is fixed here: pip install https://github.com/fzi-forschungszentrum-informatik/TSInterpret/archive/refs/heads/LEFTIST.zip. (I will publish a new release when I am sure that everything is fixed.)

Other than that, I could not really find anything wrong. LEFTIST is unfortunately quite prone to the parameter settings used, so if you still have problems, providing yours would help me localize the issue.

I also pushed a new notebook: https://github.com/fzi-forschungszentrum-informatik/TSInterpret/blob/LEFTIST/docs/Notebooks/Leftist_torch.ipynb

Hope that helps

JHoelli commented 7 months ago

Closed due to inactivity.