search

jakopako / goskyr

A configurable command-line web scraper written in go with auto configuration capability
GNU General Public License v3.0
32 stars 4 forks source link

make wait time of dynamic fetcher configurable #161

Open jakopako opened 1 year ago

jakopako commented 1 year ago

for the -g flag (generate a config) add another flag (eg -w) to pass the wait time in seconds. For the scraping itself read the wait time from the yaml config.

jakopako commented 2 months ago

possible via config:

page_load_wait: 3000

not yet available for config generation