Akuukis / sepraisal

Analyse and compare Space Engineers blueprints - either uploaded or browse 100k+ steam workshop items.
https://spaceengineerspraisal.net
GNU General Public License v3.0
2 stars 4 forks source link

fix(crawler): check 20 pages since Steam is flaky #32

Closed Akuukis closed 4 years ago

Akuukis commented 4 years ago

Crawler is checking 10 pages (~300 blueprints) of most recent blueprints for new ones every 3 hours. Usually that's few pages full of new IDs, but always there's at least that one new blueprint being at 7th page or so, because Steam ordering is totally not exact.

It turns out there usually was also a blueprint beyond the 10th, which got skipped. So I bumped crawler to check 20 pages in order not to skip any. Hopefully that's enough.

Also re-rediscovered all 1670 most recent pages to catch already skipped blueprints. They should be ready within 6 hours after the full crawler cycle is done.

sonarcloud[bot] commented 4 years ago

Kudos, SonarCloud Quality Gate passed!

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities (and Security Hotspot 0 Security Hotspots to review)
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication