search

webrecorder / browsertrix-crawler

Run a high-fidelity browser-based web archiving crawler in a single Docker container
https://crawler.docs.browsertrix.com
GNU Affero General Public License v3.0
657 stars 83 forks source link

One or more workers are not working. #93

Closed rmfkdehd closed 3 years ago

rmfkdehd commented 3 years ago

Below is my command... workers is 6 and it keeps coming out as 1. My cpu has 6 cores and 12 threads. The ram is 64gb, no problem.....

docker run -v $PWD/crawls:/crawls/ -it webrecorder/browsertrix-crawler crawl --url https://example.com/ --generateWACZ --text --collection test --scopeType any -workers 6

ikreymer commented 3 years ago

It looks like you have a typo, missing dash, it should be --workers not -workers

rmfkdehd commented 3 years ago

Thanks... I should have checked more closely...