my8100 / scrapydweb

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:
https://github.com/my8100/files
GNU General Public License v3.0
3.13k stars 554 forks source link

Is it possible to run multiple spider at the same time in a tmux machine with scrapydweb automatically #206

Open Canahmetozguven opened 1 year ago

Canahmetozguven commented 1 year ago

I have more then 300 spiders which needs to work periodically and I need to follow their logs one by one so I need exactly scrapyd web for this but I couldn't find any answer for my question. Is there anyone made it before?