hejiheji001 / Web-Scraper-Plus

Web data extraction tool implemented as chrome extension with much more features
46 stars 18 forks source link

"Dynamic StartUrls only support when MySQL is used" #14

Open virusnuke opened 3 years ago

virusnuke commented 3 years ago

Any reason why this is showing up?

image

If I add one URL it works fine but it starts getting this error as soon as I add multiple URLs.

{"selectors":[{"parentSelectors":["_root"],"type":"SelectorText","multiple":false,"id":"title","selector":"div.box-dettagli strong:nth-of-type(1) a.ng-binding","regex":"","datafilter":"","delay":""},{"parentSelectors":["_root"],"type":"SelectorText","multiple":false,"id":"URL","selector":"location.href","regex":"","datafilter":"location.href","delay":""},{"parentSelectors":["_root"],"type":"SelectorText","multiple":false,"id":"Preço PVP","selector":"div.color-price span.prezzo","regex":"","datafilter":"","delay":""},{"parentSelectors":["_root"],"type":"SelectorText","multiple":false,"id":"Preço WEB","selector":"a span.prezzo","regex":"","datafilter":"","delay":""},{"parentSelectors":["_root"],"type":"SelectorText","multiple":false,"id":"Stock","selector":"div.box-price","regex":"","datafilter":"","delay":""}],"startUrl":[""],"dynamic":{"location":"","limit":""},"_id":"test"}

Update: Removing "dynamic":{"location":"","limit":" and importing it again seems to have worked on one ID, but as soon as I add another URL save through "Edit Metadata" (even if there's no changes) the error comes back, though this didn't seem to work on another ID that I'm working on, although it did remove the error "Dynamic StartUrls only support when MySQL is used" instead it is stuck on "Scraping in progress..." without opening any URLs.