k1m0ch1 / BiBiT

the yogyaonline.co.id, alfacart and klikindomaret scrapper
12 stars 2 forks source link

fixing crawler yogyaonline #13

Closed k1m0ch1 closed 5 months ago

k1m0ch1 commented 5 months ago

just working on feat/scrapper-yogyaonline

k1m0ch1 commented 5 months ago

UPDATE

done:

issue:

  1. page detector isn't working
  2. need price checker, when "today" price isn't change, we didn't need to save the data into sqlite
  3. proper to insert to database

image

image

k1m0ch1 commented 5 months ago

dor dl4Object.json

data-parsed.json