taganaka / polipus

Polipus: distributed and scalable web-crawler framework
MIT License
92 stars 32 forks source link

invalid byte sequence in US-ASCII (ArgumentError) #40

Closed taganaka closed 9 years ago

taganaka commented 10 years ago
/usr/lib/ruby/1.9.1/uri/common.rb:304:in `gsub': invalid byte sequence in US-ASCII (ArgumentError)
from /usr/lib/ruby/1.9.1/uri/common.rb:304:in `escape'
from ./vendor/bundle/ruby/1.9.1/gems/polipus-0.3.2/lib/polipus/page.rb:169:in `to_absolute

Note:

export LANG=en_US.UTF-8
export LANGUAGE=en_US.UTF-8
export LC_ALL=en_US.UTF-8

doesn't help here