dmaclean / dfs-python

Tools for DFS data collection and projection creation.
11 stars 2 forks source link

Unicode error while scraping for Ramon Sessions #25

Closed dmaclean closed 10 years ago

dmaclean commented 10 years ago

No clue why this is happening. I think there's a bad character coming over.

dmaclean commented 10 years ago

Fixed. Some strange character 0xa1 was written into a sponsored message on the page. I got around this by adding a second argument to the decode() method, which tells the decoder to ignore a non-unicode character if it encounters it. This looks like it solved the problem.

Files modified: