Add Mercator URL Frontier implementation

BruceDone / awesome-crawler

A collection of awesome web crawler,spider in different languages

MIT License

6.33k stars 685 forks source link

Closed moredure closed 3 years ago

moredure commented 3 years ago

Added link to Go mercator url frontier implementation example.

moredure commented 3 years ago

@BruceDone any recommendations?