How long is a temporary block? I haven't been able to get results since yesterday.

mwpenny / kijiji-scraper

A lightweight node.js module for retrieving and scraping ads from Kijiji

MIT License

96 stars 44 forks source link

How long is a temporary block? I haven't been able to get results since yesterday. #74

Open Nillows opened 7 months ago

Nillows commented 7 months ago

Error: Error parsing Kijiji search results: Kijiji denied access. You are likely temporarily blocked. This can happen if you scrape too aggressively. Try scraping again later, and more slowly....

how long can I expect this block to occur?

Nillows commented 7 months ago

at step (C:\Users\xxxxxxxxxx\Desktop\LAB\Kijiji Scraper - v3.0\node_modules\kijiji-scraper\dist\lib\search.js:46:23)
at Object.throw (C:\Users\xxxxxxxxxx\Desktop\LAB\Kijiji Scraper - v3.0\node_modules\kijiji-scraper\dist\lib\search.js:27:53)
at rejected (C:\Users\xxxxxxxxxx\Desktop\LAB\Kijiji Scraper - v3.0\node_modules\kijiji-scraper\dist\lib\search.js:19:65)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

mwpenny commented 7 months ago

Can you share the code you used to scrape?

Nillows commented 7 months ago

sure, here's a repo.

https://github.com/Nillows/vigilant-enigma

in the public folder, script.js has the logic for querying ads to display in index3, or index1.