trydis / FIFA-Ultimate-Team-Toolkit

FIFA Ultimate Team Toolkit
MIT License
233 stars 110 forks source link

FIFA 17 database of players #285

Closed bigdt21 closed 7 years ago

bigdt21 commented 8 years ago

I am looking to create a database of FIFA 17 players and their information (nation, club, league, etc.) and stats (pace, long passing, etc.). I've found the below API URL which returns all the relevant information, but only one page at a time (out of 600+ pages)

https://www.easports.com/fifa/ultimate-team/api/fut/item?page=1

Anyone have a better URL to use or way to modify this one to dump the whole thing or at least multiple pages?

robbrad91 commented 8 years ago

Could you not just scrape it one page at a time?

robbrad91 commented 8 years ago

Also, that is the same link that is used for Fifa 16, is it definitely updated?

artielange commented 8 years ago

A kind gentleman by the name of @Bogenschuetze posted the link to the players.json which is a great starting point

https://fifa17.content.easports.com/fifa/fltOnlineAssets/CC8267B6-0817-4842-BB6A-A20F88B05418/2017/fut/items/web/players.json

bigdt21 commented 8 years ago

@Bradders591 thanks for the replies. It seems to be updated as it has Ronaldo, Messi, and Neymar's base cards at 94, 93, and 92. It also refers to their pictures using a 17 URL. Example for Neymar

https://fifa17.content.easports.com/fifa/fltOnlineAssets/CC8267B6-0817-4842-BB6A-A20F88B05418/2017/fut/items/images/players/html5/120x120/190871.png

As for scraping it one page at a time, my understanding of this stuff is low, so I was doing this manually by updating the ending digit for the URL for each page number and dumping it to CSV/Excel.

@artielange Thanks. I saw the link for the players.json, but that does not have all the players attributes in it, so I was looking for other options.

artielange commented 8 years ago

Ah, I remember seeing a nice table floating around with the base attributes...

There are sites like Futhead or FutWiz that have already done a lot of work collecting player stats, You could scrape from them (scraping is quite easy compared to what's implemented in this toolkit, don't be intimidated).

robbrad91 commented 8 years ago

I've got a scrape of that URL you sent now, all the pages. I'll see if i can upload it later

mfsdcool commented 8 years ago

Do anyone know the link for items / consumables?

Bogenschuetze commented 8 years ago

I know you can search for playernames in the api like that: (just replace ronaldo) http://www.easports.com/fifa/ultimate-team/api/fut/item?jsonParamObject={"name":"ronaldo"}

bigdt21 commented 8 years ago

@Bradders591 that would be awesome if you could upload your scrape

@Bogenschuetze Thanks. That is really useful.

tomosh22 commented 7 years ago

@Bogenschuetze is it possible to search in that table by nationality? I tried http://www.easports.com/fifa/ultimate-team/api/fut/item?jsonParamObject={%22nation%22:%22Portugal%22} but that didn't work

EDIT: Never mind I figured it out, you need to use the "country" parameter

For example to search players from France: http://www.easports.com/fifa/ultimate-team/api/fut/item?jsonParamObject={%22country%22:%22France%22}

EDIT: Unfortunately now I cant change page by using ?page=number. Anyone know how to do it?

davkh commented 7 years ago

Hi guys. Is there any link for consumables?

davkh commented 7 years ago

Contracts.

CoverJ commented 7 years ago

@bigdt21 The parsed file is too large to upload.

https://dotnetfiddle.net/2GiIof

thats the code I used to produce a huge player.json file. its 50mb~ and it crashed any program i try to open it with but it works fine when you work with it programmatically.

pulkitsharma commented 7 years ago

Anything for Staff cards?

Telexx commented 7 years ago

I have a sql server database that I ripped if anyones interested

kauefelipe commented 7 years ago

@Telexx Send to me please! kaueffreitascampeonatofifa@gmail.com

Telexx commented 7 years ago

Okay I've sent it

kauefelipe commented 7 years ago

I did not receive the email. Maybe gmail declined because of file size. Can you put it on some hosting and send us the link?

Telexx commented 7 years ago

https://1drv.ms/u/s!Arrzbyqmfy0Za-u7w9tTzuS3Iys it's a work in progress, I still need to add player team & nationality but names and all stats are there.

israeldesigner commented 7 years ago

Hi buddies, I got doubt here. I´m building one api databe like https://sofifa.com/, but I´m using EA SPORTS API and I´ve not found atributte COMPOSTURE, cuz https://sofifa.com/ show it composture and API EA SPORTS NOT SHOW. How can I put this atributte?

blakedalmeida commented 7 years ago

Hi guys,

Would anyone have the API documentation or endpoints for Pro Clubs?

Thus far we've identified the following but certain we're missing some, this is for a new app.

https://www.easports.com/iframe/fifa17proclubs/api/platforms/PS4/clubs/search (replace search with word to return all clubs with word in name) https://www.easports.com/iframe/fifa17proclubs/api/platforms/PS4/clubs/308452 https://www.easports.com/iframe/fifa17proclubs/api/platforms/PS4/clubs/308452/info https://www.easports.com/iframe/fifa17proclubs/api/platforms/PS4/clubs/308452/matches https://www.easports.com/iframe/fifa17proclubs/api/platforms/PS4/clubs/308452/members https://www.easports.com/iframe/fifa17proclubs/api/platforms/PS4/clubs/308452/stats

ntaboada commented 7 years ago

Hey @blakedalmeida could you find any endpoint to Pro Clubs to get info of a Player?

For example, in the club each player have a blazeID. Something like >>> https://www.easports.com/iframe/fifa17proclubs/api/platforms/PS4/clubs/308452/members/o0z19g16nmYhkAhT9kLaoQ!!:x-ISu8sMTkPZ2J-OQ81VaQ!!

HardMode2015 commented 7 years ago

@Telexx can u send database for me twistleech@gmail.com thank you

joshuavandermeer commented 7 years ago

Can anybody help me find the api for the teams on FIFA like there is an api for the players (https://www.easports.com/fifa/ultimate-team/api/fut/item?page=2)? I don't know exactly where to search for but as blakedalmeida already stated he found some api's for proclubs, so I guess there should be one for the teams.

MrImman commented 7 years ago

@ntaboada I have found one to get stats for the members of the club. Only the current stats.

Would be great if someone has found the endpoint to get the actual stats of a pro clubs player, not tied to the club. More like the overall stats till date.

FelixBaum commented 7 years ago

Is there a way to get all Standard Teams like "FC Bayern München" and their Ratings or Images? Find a way to search for Players but nothing for Teams..

Telexx commented 7 years ago

Hi Felix,

A while ago I created something to loop through every page of the API and insert that into a local sql server database. From there you can do whatever you want with the data so in my opinion this is the best approach.

On Wed, Jul 19, 2017 at 3:25 PM, Felix Baum notifications@github.com wrote:

Is there a way to get all Standard Teams like "FC Bayern München" and their Ratings or Images? Find a way to search for Players but nothing for Teams..

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/trydis/FIFA-Ultimate-Team-Toolkit/issues/285#issuecomment-316404242, or mute the thread https://github.com/notifications/unsubscribe-auth/AFSCp-oUTzrJZlNpTqyMfMf3NsCBWVnsks5sPhG7gaJpZM4KFBwD .

FelixBaum commented 7 years ago

Hi @Telexx ,

thank you! I will give it a try!

EDIT: What Version of MSSQL-Server do I Need? I tried it with 2014 but that didn't work.

EDIT#2: Got it running on SQL Server 2016. But there is only 1 table only with Player data and no Teams at all.

mauriciord commented 7 years ago

@tomosh22 How did you know to use country? because doesn't have a property named country, in fact there is a property named nation

@Bogenschuetze is it possible to search in that table by nationality? I tried http://www.easports.com/fifa/ultimate-team/api/fut/item?jsonParamObject={%22nation%22:%22Portugal%22} but that didn't work

EDIT: Never mind I figured it out, you need to use the "country" parameter

For example to search players from France: http://www.easports.com/fifa/ultimate-team/api/fut/item?jsonParamObject={%22country%22:%22France%22}

EDIT: Unfortunately now I cant change page by using ?page=number. Anyone know how to do it?

hcarrasc commented 7 years ago

anyone has some info of FIFA18 API??

xAranaktu commented 7 years ago

@hcarrasc I've managed to get GUID from demo, but no luck with finding fut database. :(

B003E1A2-724A-4D3A-ADA4-1CF508510D72

solorinka commented 7 years ago

https://fifa18.content.easports.com/fifa/fltOnlineAssets/B1BA185F-AD7C-4128-8A64-746DE4EC5A82/2018/fut/items/web/players.json

cethak89 commented 7 years ago

Hello, I just want to learn that this https://www.easports.com/fifa/ultimate-team/api/fut/item this is returning fifa17 or fifa18 data right now? Thanks

Telexx commented 7 years ago

Many of the links in there point to https:\/\/fifa17.content.easports.com so I'd say it's still 17

On Thu, Sep 28, 2017 at 11:18 AM, hakan çetin notifications@github.com wrote:

Hello, I just want to learn that this https://www.easports.com/fifa/ ultimate-team/api/fut/item http://url this is returning fifa17 or fifa18 data right now? Thanks

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/trydis/FIFA-Ultimate-Team-Toolkit/issues/285#issuecomment-332793498, or mute the thread https://github.com/notifications/unsubscribe-auth/AFSCpzhu4eKiAML_y_KIkjiyYtD5KMsCks5sm3KBgaJpZM4KFBwD .

cethak89 commented 7 years ago

@solorinka could you tell me where we can find FIFA 18 data include all players stats?

Thanks alot

oscady commented 7 years ago

There is a .csv available here which you could convert to json

EDIT: The names of the players in that list don't come through properly due to the accents on letters. If anyone has got a sorted version would be much appreciated. Also first name/surname would be a plus, I'll keep looking

kauefelipe commented 7 years ago

This is not a FUT mode file, but a h2h file. For example, in this file appear 3 defenders in the Bordeaux team. But if you look at the FUT there are only 2. Besides not having the actual position of the player (in fut we only have one option), because in the spreadsheet we have all the positions that the player can play. But no doubt is already a help for those who want to do a survey to know the id of the player by name ...

oscady commented 7 years ago

Ah I get you, I am just looking for the data for the full stats with images I must have blocked out the FUT bit.

robbrad91 commented 7 years ago

https://www.easports.com/uk/fifa/ultimate-team/api/fut/item?jsonParamObject=%7B%22name%22:%22t%22%7D

This seems to be 18? its what they use for the player DB anyway. Scan through each page and Database them... thats what ive done the past few years. I'd do it again sometime if i had the time!

oscady commented 7 years ago

How do you go about finding the other pages? :/

tibiahardcore1 commented 7 years ago

@Telexx Could you please send me the fifa 18 database? email: tibiahardcore1@gmail.com

I'd like to know if it's possible to download all pages instead of 1 at a time

Telexx commented 7 years ago

On Thu, 12 Oct 2017 at 08:14, tibiahardcore1 notifications@github.com wrote:

@Telexx https://github.com/telexx Could you please send me the fifa 18 database? email: tibiahardcore1@gmail.com

I'd like to know if it's possible to download all pages instead of 1 at a time

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/trydis/FIFA-Ultimate-Team-Toolkit/issues/285#issuecomment-336041666, or mute the thread https://github.com/notifications/unsubscribe-auth/AFSCpwvp4A27qyjOWmVq9NMkzaDuFcw5ks5srbxHgaJpZM4KFBwD .

I haven’t done one just yet but I will send it over as soon as I have

oscady commented 7 years ago

@Telexx if you do get through it all, could I also have the database please?

muschip@outlook.com

:)

Telexx commented 7 years ago

I wrote something for FIFA 17 to loop through each page and parse the players, the information was somewhat incomplete because I got bored but I might try a bit hard on this one.

I will send it to here when I've got it

On Thu, Oct 12, 2017 at 10:25 AM, oscady notifications@github.com wrote:

@Telexx https://github.com/telexx if you do get through it all, could I also have the database please?

muschip@outlook.com

:)

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/trydis/FIFA-Ultimate-Team-Toolkit/issues/285#issuecomment-336072897, or mute the thread https://github.com/notifications/unsubscribe-auth/AFSCp-wlILY197BD_8rFI_tOFfN2pjMHks5srdsBgaJpZM4KFBwD .

robbrad91 commented 7 years ago

playerimport.txt

Thats the nodeJS script i used for last year (or year before? can't remember). Not bothering with autobuying this year as trying to do it old school but it might be a good start point. It sends it to a mongodb.

Hopefully a good starting point for you guys though, its probably a bit outdated and its not my best work! haha

Telexx commented 7 years ago

On Thu, 12 Oct 2017 at 10:36, Bradders591 notifications@github.com wrote:

playerimport.txt https://github.com/trydis/FIFA-Ultimate-Team-Toolkit/files/1378821/playerimport.txt

Thats the nodeJS script i used for last year (or year before? can't remember). Not bothering with autobuying this year as trying to do it old school but it might be a good start point. It sends it to a mongodb.

Hopefully a good starting point for you guys though, its probably a bit outdated and its not my best work! haha

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/trydis/FIFA-Ultimate-Team-Toolkit/issues/285#issuecomment-336075691, or mute the thread https://github.com/notifications/unsubscribe-auth/AFSCp4qpotoy4sZsyJlp3pzHVPJ4CF6Vks5srd2IgaJpZM4KFBwD .

Very similar to what I threw together in .net

adailsonm commented 7 years ago

this require models player.js is necessary to have because it gave an error using this playerimport

memsprop commented 6 years ago

Hi, Is there an api to get online seasons match-history. Before was a way to visualize the match history but I did not find it.

Please help

jim1138 commented 6 years ago

For searching through the lists, does anybody know a full list of search params?

I've seen name and country mentioned for example. Country being used instead of "nation" that is shown in the json output.

What's the relationship between the search param name and the json therefore also?

Thanks.

k3lh4m commented 6 years ago

@Bradders591 I don’t suppose you have the players.js file you can upload?