hegyiadam / RemoteScraping

Repo for a distributed user friendly web scraping DotNet and Python solution
1 stars 0 forks source link

Create page iteration command on Processing server #18

Open hegyiadam opened 4 years ago

hegyiadam commented 4 years ago

Create a scraping command on Processing server. This command should collect all the links in a multiple page website.

For example

in a google search the first page contains 10 elements the second, the third etc is the same, the required data in this case is that how many page can be loaded.