prashantghimire / sofifa-web-scraper

JavaScript scrapper for over 18k detailed players info and stats from EA FC 25 from SoFIFA.com.
33 stars 5 forks source link

i want to use this for FC25 #23

Open Kyu1120 opened 3 weeks ago

Kyu1120 commented 3 weeks ago

Hi, I'm studying data analysis. I want to analyze FC25 but there is no dataset about FC25. Then, I found out your sofifa web scraper. I try to understand your code but I'm not good at Java. I changed URL in your file. But I don't know why when I run your program I have this problem

Error: Error reading page=https://sofifa.com/player/239085/erling-haaland/250005, statusCode=403 at getPageContent (/Users/kyujinkim/Desktop/sofifa scrapper/sofifa-web-scraper/services/scraper.js:12:15) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async getPlayerDetailsCsvRow (/Users/kyujinkim/Desktop/sofifa scrapper/sofifa-web-scraper/services/parser.js:22:18) at async download (/Users/kyujinkim/Desktop/sofifa scrapper/sofifa-web-scraper/main.js:23:19) at async start (/Users/kyujinkim/Desktop/sofifa scrapper/sofifa-web-scraper/main.js:36:9)

I think there is a 403 page error. How can i fix it?

And also i would like to scrape the new player roles added in FC25.

Thanks