BruceDone / awesome-crawler

A collection of awesome web crawler,spider in different languages
MIT License
6.5k stars 709 forks source link

Added Mercator URL frontier implementation #62

Closed moredure closed 4 years ago

moredure commented 4 years ago

Added reference to mercator crawler URL frontier implementation in Golang