twitter-archive / torch-dataset

An extensible and high performance method of reading, sampling and processing data for Torch
Apache License 2.0
76 stars 24 forks source link

Cannot handle inputDims when using IndexDirectory.lua, it will load the whole file #35

Open chienlinhuang1116 opened 8 years ago

chienlinhuang1116 commented 8 years ago

Hi,

We cannot handle inputDims when using IndexDirectory.lua . It will load the whole file. For example, there are several files with the size of {2048,600}. We would like to read files by the size of {600} but it will load the whole file when using IndexDirectory.lua. Although we can do post-processing, is there anything we can do when opening files using IndexDirectory.lua like IndexTensor.lua?

Thank you, Chien-Lin