Model does not converge

lucidrains / TimeSformer-pytorch

Implementation of TimeSformer from Facebook AI, a pure attention-based solution for video classification

MIT License

686 stars 86 forks source link

Model does not converge #6

Open duduheihei opened 3 years ago

duduheihei commented 3 years ago

I use TimesFormer to train on my own dataset, the input channel is 1, num_frame is 8. I got nearly 46% accuracy， I guess it was because imbalance of the dataset classes. I want to know if anyone has trained this model sucessfully?

doursand commented 3 years ago

I am waiting for the pre trained weights from the official repo to get started. Eager to see how well it will perform compared to slowfast ...