Add Mercator URL Frontier implementation

BruceDone / awesome-crawler

A collection of awesome web crawler,spider in different languages

MIT License

6.5k stars 709 forks source link

Closed moredure closed 4 years ago

moredure commented 4 years ago

Added link to Go mercator url frontier implementation example.

moredure commented 4 years ago

@BruceDone any recommendations?