Scraping now fails - has oddsportal site changed?

philbywalsh commented 1 year ago

I've re-run some commands usingFinalScraper.py which now fail, despite these same commands completeing successfully in December

This is the error I get. The scripts looks to be cycling through pages and getting this error every time.

Page not found This page not exist on Oddsportal.com!

Sample commands run:

scrape_oddsportal_current_season(sport = 'soccer', country = 'england', league = 'premier-league', season = '2022', max_page = 20)
scrape_oddsportal_historical(sport = 'soccer', country = 'england', league = 'premier-league', start_season = '2022-2023', nseasons = 1, current_season = 'yes', max_page = 25)
scrape_oddsportal_historical(sport = 'soccer', country = 'world', league = 'world-cup', start_season = '2018', nseasons = 1, current_season = 'no', max_page = 2)

I note that the oddsportal site looks different visually and has the word "beta" in the logo.

Has the structure of the oddsportal site changed and hence resulted in these scraping fails?

MathieuGery commented 1 year ago

Hello yes the site has changed and new version is in place. Unfortunately the old website is no longer available.

philbywalsh commented 1 year ago

Hi @MathieuGery - Have you found a way to use this python scraper on the new oddsportal site?

MathieuGery commented 1 year ago

Hi @philbywalsh I found that because I use my own scrapper to scrap the website and now it's broken

gingeleski / odds-portal-scraper