Add fixes to how the crawler handles errors during the setup and the crawl.
Another thing worth testing is the new functionality I added to the rest-api. Running npm start wipe will truncate the SQL tables. Helpful if you want to re-do a crawl.
@JoeChampeau For testing the error handling, try running a site that crashes Firefox Nightly multiple times in a row. In my case, looperman.com was helpful. Maybe you can find some others?
Add fixes to how the crawler handles errors during the setup and the crawl.
Another thing worth testing is the new functionality I added to the rest-api. Running
npm start wipewill truncate the SQL tables. Helpful if you want to re-do a crawl.@JoeChampeau For testing the error handling, try running a site that crashes Firefox Nightly multiple times in a row. In my case, looperman.com was helpful. Maybe you can find some others?