Current release of loads.js doesn't load properly url entries on redis

[remagio]

I'm confirming my comment on #9 "I'm still using the old version of loads.js. The old loads.js works fine with same json, delta tweets or full reload on a fresh earls. The current loads.js doesn't load entry in redis also if trying a fresh install. You could check it by yourself with your user, if planning it: to not brake the live instance of earls and using both current and old loads.js with the same json.

[edsu]

I don't understand this. Please provide a clear description of the problem, and how to reproduce it.

[remagio]

I verified, on the same instance you worked on, that current release of loads.js do not load all URLs of same twarc. But previous release of "loads.js" load it correctly.

To simulate your can twarc #ijf15 and load it with current and previous load.js. Or verify it on the instance you know, with your active account.

[edsu]

Oh interesting, it looks like with long files it is exiting before the queue has been emptied? I've only been testing with small files and hadn't noticed this behavior before, thanks!

[remagio]

Ok, debugging I realized too it stops in something but without stopping the evaluate phase of json. It confused me. In this case the #ijf15 json is less than 1300 urls but nearly 1200 tweets.