search

jim256 / ebay

0 stars 0 forks source link

Question: 6PM Daily Spike #24

Closed jim256 closed 4 years ago

jim256 commented 4 years ago

Hey @james-carpenter , I'm not asking that you spend any time on this, but just wanted to get your thoughts.

I've noticed while reviewing my data that there is a very dramatic spike for new listings at about 6 PM (UTC) every day. This doesn't happen with any of my other (3) data sources. Do you think there's a possibility that there's a problem with the scraper? I simply have it running via cron once every 20 min. I just thought it seemed odd.

image

james-carpenter commented 4 years ago

That is definitely an interesting illustration. 6pm UTC would be midnight central time. I wonder if that is a batch process window on the eBay servers to process pending transactions or something similar that would result in a larger than typical volume of new listings.

jim256 commented 4 years ago

That would make sense. Thanks