search

omc / searchyll

GNU General Public License v3.0
48 stars 15 forks source link

Batch size keeps growing #46

Open alranel opened 5 years ago

alranel commented 5 years ago

I had bundle exec jekyll serve running for a few hours, and I noticed the following output in console:

Increased batch to 94777449436701609667188297781665503819030517220054107171082413431520640121778638383647367110547101173319817390034308454741829257133119992736870009797795596146331645789887004672
Increased batch to 200593728672035931732768693399865394589774672587325838890939151914483838602731795427929701601580512710605213727191985246954165249313228158379774992635263303952590755845660674621440
Increased batch to 18368504659304856136350155220078100239893869168967793447586326566762192167108094577698989302780888185491791238388332456749221831046657710308578700526160122250397424242244190208
Increased batch to 277271443668342844774702843187183923013839381558598037623706775909080314800410578046290760507714583250559156411054944938133818412179429338058541858072772201074249307795750912
Increased batch to 9873695207846506853946225222129548294174173481472380761094969262719211345924829493206651477802892616369342958461547297909307914910857517697703872790440830012951016964156723804556492

I think the timestamp in indexer.rb needs to be renewed :)

dtpxl commented 4 years ago

This eventually causes an overflow / can't cast infinity to integer error:

Increased batch to 161951851244304127220492665392021151643395223960970715060499392063564598483865213734633679843620936832250723691510992075496889882765335934201714846501461773338290481711989807971269854631862267108269591519142212617880376029723244992598863390259031817638576350385567730798870379384224813833703935747396514873344
#<Thread:0x00007f96b5c3cc08 /Users/username/gems/gems/searchyll-0.10.2/lib/searchyll/indexer.rb:44 run> terminated with exception (report_on_exception is true):
Traceback (most recent call last):
    7: from /Users/username/gems/gems/searchyll-0.10.2/lib/searchyll/indexer.rb:45:in `block in start'
    6: from /Users/username/gems/gems/searchyll-0.10.2/lib/searchyll/indexer.rb:109:in `http_start'
    5: from /Users/username/gems/gems/searchyll-0.10.2/lib/searchyll/indexer.rb:46:in `block (2 levels) in start'
    4: from /Users/username/gems/gems/searchyll-0.10.2/lib/searchyll/indexer.rb:61:in `indexer_loop'
    3: from /Users/username/gems/gems/searchyll-0.10.2/lib/searchyll/indexer.rb:69:in `tempo_loop'
    2: from /Users/username/gems/gems/searchyll-0.10.2/lib/searchyll/indexer.rb:69:in `loop'
    1: from /Users/username/gems/gems/searchyll-0.10.2/lib/searchyll/indexer.rb:77:in `block in tempo_loop'
/Users/username/gems/gems/searchyll-0.10.2/lib/searchyll/indexer.rb:77:in `round': Infinity (FloatDomainError)