search

Benny- / Yahoo-ticker-symbol-downloader

A web scraper for ticker symbols from yahoo finance
https://pypi.python.org/pypi/Yahoo-ticker-downloader/
Other
247 stars 87 forks source link

Yahoo returns funny things sometimes #27

Closed Benny- closed 7 years ago

Benny- commented 7 years ago

Compare the following two HTML files: https://bennyjacobs.nl/issues/yahoo-finance/A1.html https://bennyjacobs.nl/issues/yahoo-finance/A2.html

Both can be returned when fetching https://finance.yahoo.com/lookup/M?bypass=true&s=ma&b=148&m=ALL&t=m

Something like A1.html is returned sometimes. Its content is absolutely funny. It lists at item offset 148 while at the same item telling there are only 56 items in the list. And it lists totally different items.

This corrupts the results between runs. And one point you might have a few more results while another time you have a few less.

Here is another pair of HTML files: https://bennyjacobs.nl/issues/yahoo-finance/B1.html https://bennyjacobs.nl/issues/yahoo-finance/B2.html Both returned by fetching https://finance.yahoo.com/lookup/B?s=c&b=360&m=ALL&t=B&bypass=true

At the moment I have no solution.

Benny- commented 7 years ago

The HTML interface is no longer used as of 2.0.0 so this is probably no longer a issue