N0taN3rd / Squidwarc

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
https://n0tan3rd.github.io/Squidwarc/
Apache License 2.0
168 stars 26 forks source link

Add node-warc as a sub-module #11

Closed N0taN3rd closed 7 years ago

N0taN3rd commented 7 years ago

To facilitate ease of development for both Squidwarc and node-warc make node-warc a submodule node-warcs remote Chrome request capturer and WARC generator are developed using Squidwarc Kill two birds with one stone