search

DedSecInside / gotor

This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.
GNU General Public License v3.0
159 stars 44 forks source link

Randomized Headers #44

Open thehappydinoa opened 2 years ago

thehappydinoa commented 2 years ago

I found this wonderful snippet in gocolly, this file could make random headers rather simple: https://github.com/gocolly/colly/blob/master/extensions/random_user_agent.go

KingAkeem commented 2 years ago

Looks interesting, feel free to submit a PR with this change and I'll check it out

PSNAppz commented 1 year ago

@thehappydinoa Any updates on this? or can I close this for now?

thehappydinoa commented 1 year ago

Hey there sorry for the delay, I will take a stab at this tomorrow.

PSNAppz commented 1 year ago

Cool! I'll transfer this issue to gotor project repo.