Set User agent string while fetching documents from the web

internetarchive / liveweb

Liveweb proxy of the Wayback Machine project

https://web.archive.org/

44 stars 13 forks source link

Closed nibrahim closed 12 years ago

nibrahim commented 12 years ago

We need to set the user-agent string while fetching documents to what the current proxy uses.

anandology commented 12 years ago

The current liveweb uses "ia_archiver(OS-Wayback)" as User-Agent.