Added Mercator URL frontier implementation

BruceDone / awesome-crawler

A collection of awesome web crawler,spider in different languages

MIT License

6.45k stars 706 forks source link

Closed moredure closed 4 years ago

moredure commented 4 years ago

Added reference to mercator crawler URL frontier implementation in Golang