CrawlerX - Develop Extensible, Distributed, Scalable Crawler System which is a web platform that can be used to crawl URLs in different kind of protocols in a distributed way.
Apache License 2.0
22
stars
16
forks
source link
[GSoC 2021] Update Readme.md file with the progress #99
At the end of the project, Readme.md file needs to be updated with the relevant step by step user guide.