search

cvlab-columbia / expert

Code for Learning to Learn Language from Narrated Video
MIT License
33 stars 6 forks source link

About splits.pth #6

Closed barisbatuhan closed 2 years ago

barisbatuhan commented 2 years ago

Is it possible that you provide more information on the content of splits.pth? I am trying to create a custom dataset to run your model but I cannot figure out what some individual elements stand for in this specific file.

surisdi commented 2 years ago

Hi @barisbatuhan , splits.pth is a python dictionary that can be loaded using torch.load('splits.pth'), and contains information about training and test splits, vocabulary, action ids, and other information used in the dataloader. See this line and the following ones to see how it is used. It is basically a way of separating clips of actions into training and testing splits, so that everyone has access to the same splits. But it is specific to the Epic Kitchens dataset, so if you are creating a custom dataset and you prefer to use a different format (different from what we used for splits.pth), it may be more convenient (the format we used is very specific for Epic Kitchens).