probberechts / soccerdata

⛏⚽ Scrape soccer data from Club Elo, ESPN, FBref, FiveThirtyEight, Football-Data.co.uk, FotMob, Sofascore, SoFIFA, Understat and WhoScored.
https://soccerdata.readthedocs.io/en/latest/
Other
619 stars 105 forks source link

[SoFifa] Not downloading league data for women leagues #702

Open tomerarazy opened 1 month ago

tomerarazy commented 1 month ago

I'm trying to get league composition for Women leagues from SoFifa, but for some reason the downloaded HTML is missing the whole teams table. Minimal code example:

sofifa = SoFIFA(data_dir=data_dir_raw, version_id="230001")
teams = sofifa.read_teams("2216")

The URL of the page it attempts to scrape is: https://sofifa.com/teams?lg=2216&r=230001&set=true When looking at the HTML downloaded by Chrome the table is there and structure is similar to the Men's leagues.

I've uploaded the HTML file (changed to txt since github doesn't allow me to upload)

teams_2216_230001.txt

probberechts commented 6 days ago

When I try to access the URL in Chrome, I don't see a table.

sofifa com_teams_lg=2216 r=230001 set=true(iPad Pro)