thunlp / ConceptFlow

MIT License
122 stars 18 forks source link

RAM consumption improvements #19

Closed ilyalasy closed 3 years ago

ilyalasy commented 3 years ago
  1. Changed autograd.Function extension according to the latest version. commit
  2. Using IterableDataset and DataLoader for batching. In this case its not necessary to load all the dataset into RAM. commit
  3. Small repository clear. commit