search

guoguibing / librec

LibRec: A Leading Java Library for Recommender Systems, see
https://www.librec.net/
Other
3.23k stars 1.03k forks source link

ArffDataModel.buildModel() stops indefinitely after building Converter #290

Open Vivraan opened 5 years ago

Vivraan commented 5 years ago

When I call ArffModel.buildModel(), I find that after ArffModel.buildConvert() is called, ArffModel.buildSplitter() takes indefinitely long to execute.

        Configuration conf = new Configuration();
        conf.set("dfs.data.dir", directory.toString());
        conf.set("data.input.path", Paths.get("ml-1m", "ratings.arff").toString());
        ArffDataModel dataModel = new ArffDataModel(conf);
        dataModel.buildDataModel();

Output:

Dec 23, 2018 11:04:46 AM net.librec.data.model.ArffDataModel buildDataModel
INFO: Transform data to Convertor successfully!
SunYatong commented 5 years ago

Yes, it cost a lot of time when converting a tensor to a matrix for splitting.

Vivraan commented 5 years ago

How long should it typically take to do that? My run lasted for more than 40 minutes when I tried it on my PC (Core i5 6th gen at 2.7GHz, 16GB RAM, Windows 10).