Open kylethieringer opened 1 year ago
upon a fresh reinstall, I encountered an Index error in line 582 of datasets.py where it was trying to load in labels with a range of the length of the video however because of python indexing the last label is out of bounds.
I added a non permanent fix that allows the model to train however there are caveats. The biggest is that it shifts my labels for the last chunk of data one frame off. For the behavior Im studying this shouldnt matter (1 frame is within the expected noise for trying to label the behavior, plus very rare for the behavior to be at the very end of the video). I think this might be the result of some padding when loading the labels but not exactly sure where the source is. Heres the lines of code I added if it helps anyone else:
in /deepethogram/data/datasets.py lines 578-581:
if not self.reduce:
# new code start
if label_indices[-1]>=self.label.shape[1]:
label_indices = [i-1 for i in label_indices]
# new code end
labels = self.label[:, label_indices].astype(np.int64)
When training a new sequence model, I am running into an error where the model checkpoint is searching for 'val/f1_class_mean' in the metrics file but none is found. If I open the metrics file externally, no f1_class_mean dataset has been saved.
This error quits out of the currently running epoch and moves to the next one rather than finishing the current epoch.
Any help with this would be greatly appreciated! Thanks