search

N0taN3rd / Squidwarc

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
https://n0tan3rd.github.io/Squidwarc/
Apache License 2.0
168 stars 26 forks source link

Support a simple list of URIs #18

Closed machawk1 closed 6 years ago

machawk1 commented 6 years ago

Are you submitting a bug report or a feature request?

Feature request.

What is the current behavior?

Reads JSON list of URIs as input.

What is the expected behavior?

Also allow a simple CRLF list of URIs

What's your environment?

N/A

Other information

Scenario put forth by @ibnesayeed but I can imagine this being useful for others.

N0taN3rd commented 6 years ago

@ibnesayeed want to contribute :wink:

N0taN3rd commented 6 years ago

this is implemented

N0taN3rd commented 6 years ago

see https://n0tan3rd.github.io/Squidwarc/manual/configuration.html