Scrap data as button child element.

jwillmer / web-scraper-chrome-extension

Web data extraction tool implemented as chrome extension

GNU Lesser General Public License v3.0

28 stars 5 forks source link

Scrap data as button child element. #16

Open jwillmer opened 6 years ago

jwillmer commented 6 years ago

Tested on this page: https://brickseek.com/walmart-inventory-checker?sku=54594250 Goal: Get address of stores. Issue: Does not find the addresses while scraping (only finds it in configuration mode) Site configuration: Scrap text element is child of button click element. Note:

This bug exists in branch of @martinsbalodis as well.
Brickseek needs a logged in user to display stores

button

text

jwillmer commented 6 years ago

I don' have time to fix this. Feel free to help me out!

jwillmer commented 6 years ago

I looked into this issue and noticed that the problem is that the zip code needs to be filled in order to get search results. Since the zip code can't be filled by extending the URL with query parameters we might need to create a module that enables us to fill out forms in order to make this example work.