davidhodge931 / vape-scrape

MIT License
0 stars 1 forks source link

loop only returns 6 products #6

Closed davidhodge931 closed 3 hours ago

davidhodge931 commented 3 hours ago
image
skittogh commented 3 hours ago

you can change the url filter lines 31-33 here. if you want to run the whole lot, it is a LONG loop, so you probably would only want to do it overnight or on a scheduler: image

davidhodge931 commented 3 hours ago

Oh whoops, thanks!

skittogh commented 3 hours ago

sweet. might be worth looking into doing something like this to run the code. might not even need whitelisted domains on rstudio server if it can be run this way. https://www.youtube.com/watch?v=u-TcADhWosA