search

twitter-archive / torch-dataset

An extensible and high performance method of reading, sampling and processing data for Torch
Apache License 2.0
76 stars 24 forks source link

walk through index.csv file in order? #13

Closed willfrey closed 4 years ago

willfrey commented 8 years ago

How can I walk through my index.csv file from the first entry to the last? For example, if I've sorted the index.csv file by sample length — since I have variable length training data — I'd like to walk through from the shortest to the longest.

Setting samplerKind = 'linear' appears to walk through in the same order but not in the order given in the index.csv file.

Is there any way to achieve this behavior?

zakattacktwitter commented 8 years ago

Unfortunately there is currently no way to do this, however its been on my list to fix for some time now.

On Mon, Feb 8, 2016 at 11:55 AM, willfrey notifications@github.com wrote:

How can I walk through my indexcsv file from the first entry to the last? For example, if I've sorted the indexcsv file by sample length — since I have variable length training data — I'd like to walk through from the shortest to the longest

Setting samplerKind = 'linear' appears to walk through in the same order but not in the order given in the indexcsv file

Is there any way to achieve this behavior?

— Reply to this email directly or view it on GitHub https://github.com/twitter/torch-dataset/issues/13.

zakattacktwitter commented 8 years ago

See issue #9, I'll try and implement this soon. Thanks!