search

GraveHag / CyberspaceSpider

CyberspaceSpider is a visualization-based web crawling project that maps the path a web crawler takes as it navigates through the internet. With CyberspaceSpider, you can gain insights into the structure of the web and the relationships between different sites. It is a simple and intuitive tool that provides a unique perspective on web crawling.
1 stars 0 forks source link

Choose a programming language and framework #2

Closed GraveHag closed 1 year ago

GraveHag commented 1 year ago

Choose a programming language and framework:

Decide which programming language and framework will be used to build the web walker, taking into consideration factors such as ease of use, speed, and scalability.

GraveHag commented 1 year ago

ASP.Net + .NET7 + JS + docker + memory storage

Html agility pack MIT

https://github.com/zzzprojects/html-agility-pack