search

internetarchive / umbra

A queue-controlled browser automation tool for improving web crawl quality
Apache License 2.0
60 stars 25 forks source link

Change user-agent to Chrome instead of Chromium. This is due to twitt… #56

Closed vonrosen closed 8 years ago

vonrosen commented 8 years ago

…er serving incomplete content to Chromium user-agent, specifically for https://twitter.com/hashtag/TheBlackExperience/