Added Mercator URL frontier implementation

BruceDone / awesome-crawler

A collection of awesome web crawler,spider in different languages

MIT License

6.33k stars 685 forks source link

Closed moredure closed 3 years ago

moredure commented 3 years ago

Added reference to mercator crawler URL frontier implementation in Golang