Start multiple scrapers at once

kinoute / moviestills

A small CLI app to scrap high-quality movie snapshots from various websites.

17 stars 1 forks source link

Open kinoute opened 2 years ago

kinoute commented 2 years ago

Right now, we can only scrap one website at a time.

A user could pass multiple websites like:

An option to scrap everything at the same time (all) could also be added.

gedw99 commented 2 years ago

Nats would be perfect for scaling this out i think.

you can import and run the nats server in your code. so you dont have to run it as a separate server btw.