Open CDyWeb opened 4 years ago
I think it's a bad idea if we all run the crawler for our own purposes, it will DDOS the lcbo website. I'm looking for people to collaborate with, to run one instance of the crawler and share the results. Ideas?
Someone should take up the torch since Carsten has passed An official fork with an official instance
I think it's a bad idea if we all run the crawler for our own purposes, it will DDOS the lcbo website. I'm looking for people to collaborate with, to run one instance of the crawler and share the results. Ideas?