search

spjewkes / unicorn_twitter_scroll

MIT License
0 stars 0 forks source link

Tweets that are just URLs cause a warning from Beautiful Soup #1

Open spjewkes opened 7 years ago

spjewkes commented 7 years ago

Example of the warning is: /usr/local/lib/python2.7/dist-packages/bs4/init.py:282: UserWarning: "https://t.co/X_X" looks like a URL. Beautiful Soup is not an HTTP client. You should probably use an HTTP client like requests to get the document behind the URL, and feed that document to Beautiful Soup. ' that document to Beautiful Soup.' % decoded_markup