Query generator with GUI and pattern recognition?

tribbloid / spookystuff

Scalable query engine for web scrapping/data mashup/acceptance QA, powered by Apache Spark

Apache License 2.0

142 stars 36 forks source link

Open tribbloid opened 9 years ago

tribbloid commented 9 years ago

This is a long-term proposal for necessity to build a client with GUI and features similar to:

webscraper.io
kimono
import.io
parsehub The client should be able to generate selectors & queries by clicking on a small set of web elements as training example, then export as scala code.

Do you have any suggestion on this?

l2yao commented 8 years ago

modifying https://github.com/martinsbalodis/web-scraper-chrome-extension to do correct export for scala, or even provide option to directly run on a spark cluster