search

BruceDone / awesome-crawler

A collection of awesome web crawler,spider in different languages
MIT License
6.33k stars 685 forks source link

Fastest crawler or indexer in Rust [spider] #88

Closed j-mendez closed 1 year ago

j-mendez commented 1 year ago

Rust based crawler or indexer https://github.com/spider-rs/spider. Also the fastest and most efficient OSS crawler.

j-mendez commented 1 year ago

A gRPC https://github.com/a11ywatch/crawler

BruceDone commented 1 year ago

@j-mendez you can open a pull request, i will merge it

j-mendez commented 1 year ago

@j-mendez you can open a pull request, i will merge it

done 🙌 https://github.com/BruceDone/awesome-crawler/pull/89