Glutexo / onigumo

Parallel web scraping framework
MIT License
3 stars 1 forks source link

Utilize a supervisor #233

Open Glutexo opened 3 months ago

Glutexo commented 3 months ago

Make mix run launch a supervisor that would run and scale the actual components (microservices): feeder, downloader, parser, operator, materializer…

Related to #128 and #228.