search

SimonGulix / colruyt_scraper

Not really a scraper, but uses the hidden API of www.colruyt.be in order to scrape their products.
MIT License
10 stars 1 forks source link

missing modules #2

Open korneel69 opened 2 years ago

korneel69 commented 2 years ago

Hi Simon,

Love the project and would love to build upon it! One issue I have is that some of the modules (database and proxy_requests) and seem to be missing. Any suggestions on how to resolve this?

Kind regards, Korneel

SimonGulix commented 2 years ago

Hi Korneel,

Thanks! I've added the proxy_requests module, that's a module I got from GitHub to handle the proxy requests. (otherwise Colruyt just blocks your requests.) I've also updated the colruyt_specific.py and commented all database requirements. That module did the database handling in my system but it's not necessary to get data from the Colruyt API.

Let me know if you have any more struggles. Best regards, Simon