philippta / flyscrape

Flyscrape is a command-line web scraping tool designed for those without advanced programming skills.
https://flyscrape.com
Mozilla Public License 2.0
1.02k stars 29 forks source link

Add multiple starting URLs #12

Closed rafiramadhana closed 9 months ago

rafiramadhana commented 9 months ago

Resolves https://github.com/philippta/flyscrape/issues/8

Add multiple starting URLs by adding Module.URLs.

rafiramadhana commented 9 months ago

@philippta sry I haven't done any changes related to documentation (e.g. config and example)

would u mind to LMK which files that should get updated? tks

philippta commented 9 months ago

This is great, thanks!

Examples If you like you can add an example under examples/multiple_starting_urls.js. For that, take the basic hackernews.js example, remove everthing from the config and add these two urls:

Documentation Please document the urls option in between these two: https://github.com/philippta/flyscrape/blob/190056ee8d6a4eca61d92a79cc25aad645e69d4a/README.md?plain=1#L121-L122

rafiramadhana commented 9 months ago

If you like you can add an example under examples/multiple_starting_urls.js.

Please document the urls option in between these two:

@philippta updated

philippta commented 9 months ago

Nice, thanks!