erengy / taiga

A lightweight anime tracker for Windows
https://taiga.moe
GNU General Public License v3.0
2.1k stars 224 forks source link

MAL API is down #588

Closed Akamaru closed 4 years ago

Akamaru commented 6 years ago

It seems that MyAnimeList has had a vulnerability in the API and has now disabled it. Taiga does not work anymore and shows an error.

MyAnimeList returned an error: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>404 Not Found</title> </head><body> <h1>Not Foud</h1> <p>The requested URL /api/account/verify_credentials.xml was not found on this server.</p> <p>Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocu...

image

I know it's not an taiga issue and erengy can't fix this. We have to wait for MAL.

Akamaru commented 6 years ago

@Zorua see the comment from 30. May here

I added an export feature to Taiga in 6af570e to make things a bit easier:

  1. Get the latest build of Taiga.
  2. Use the new feature via Tools → Export anime list → Export as MyAnimeList XML.
  3. Upload the generated XML file to AniList or Kitsu. This file will include your queued updates. However, my previous warning still stands:

Note that Taiga may not have your entire list data (e.g. how many times you've re-watched a series) due to limitations of MAL API (sigh).

lucypero commented 6 years ago

I know that this has already been said but I'll emphasize it: There is no good reason to continue using MAL, or waiting for them to re-enable their API. Export your list to Kitsu and use Taiga that way. I've been using Kitsu for about a month and I can see it has a much better looking website, has all the features MAL has and more, and their API is fully functional. I have not looked back since.

Only problem I had with Kitsu was the simplified ranking system, but I later found out that you can change it to a 10 point system in the settings, just like MAL. It is fully integrated into Taiga as well. I freaking love Kitsu/Taiga.

MAL used to be great, but it is time to move on, sadly.

aftadizca commented 6 years ago

Use Anilist now. Good feature..

erengy commented 6 years ago

If you have a large amount of changes waiting to be synced with MAL, here's something new you can do:

  1. Upgrade to Taiga v1.3.1, if you haven't done so already.
  2. Export your anime list via Tools → Export anime list → Export as MyAnimeList XML.
  3. Import that file to MyAnimeList by choosing the MyAnimeList Import option.
  4. Check your online anime list at MAL to make sure it's up to date now.
  5. Go to History page of Taiga, right-click on the page, then select Clear queue → Merge.

Note that MAL will overwrite the entries you import, and Taiga doesn't have all the data for your list entries (e.g. how many times you've re-watched a series) due to limitations of MAL API. This shouldn't cause any issues for most people, though.

Also make sure to select the Merge option rather than the Delete option at the final step. Otherwise your local list will lose all the changes you made since MAL API went offline.

Kovaelin commented 6 years ago

Another month before we get an update on the API. https://twitter.com/myanimelist/status/1027084541268295681

ifonefox commented 6 years ago

There's a little more detail in the forum post:

What about the API? MAL is concentrating on bringing the site back to its full functionality before work on the API can begin. At this time, the work on the API has not yet been scheduled, but we will provide an update later this month.

At least its better than radio silence on the API

erengy commented 6 years ago

The previously-announced announcement announces a series of announcements regarding the API in the upcoming weeks:

We are currently reviewing the steps necessary to complete development of a new API, which would allow third party applications to function again. Up until this point, third party applications have made use of an older API to interface with MAL, allowing them to interact with the site and function. When the API was disabled at the end of May, this caused the majority of third party applications to stop functioning, as they were no longer able to interact with the site.

At this point we have no other information to share, but aim to provide bi-weekly updates on the situation.

In addition, after 99 days of silence, a DeNA representative brought forward an apology in an internal post, claiming their limited resources in a billion-dollar company as the reason the API was put on-hold for so long. They promised to provide actual new information in time, while mentioning that they do not have a release date for the new API yet. We will see how long it takes for them to deliver.

Volatar commented 6 years ago

It's been four months now and the API is still not restored. I was patiently waiting, but I am now done.

As @erengy said

a DeNA representative brought forward an apology in an internal post, claiming their limited resources in a billion-dollar company as the reason the API was put on-hold for so long.

When it comes down to it, API users are the absolutely last priority for this kind of company. Facebook revealed for it's IPO that they simply could not figure out how to monetize (via advertising) their mobile users, which had that that time (IIRC) become over 2/3rds of the userbase. API users are even lower on the totem pole. You can try and deliver ads to API users, and the application developers will throw the ads away. Reddit also ran into this problem, and ended up trying to solve it by buying up and killing the largest mobile apps that were using their API. Twitter bought their largest API application so they could put ads in it. They all know they can't fully kill their API's -- no one can if they want the vocal and influential power users that draw others to stick to their service, as such people do not use the web interfaces as a rule, but they can do their best to discourage the common man from such applications.

MAL has gone a step beyond all of those and actually killed their API. Not permanently (or so they say) but I have no faith at this point they actually even want to bring it back.

Thank you everyone for keeping up with this thread and it's discussion.

Today I evaluate the competition and decide where I am moving my database to, and I am not going back.

:wave:

EDIT: I do hope I can find a good iOS app for whatever I move to though...

EDIT2: AniList impressed me right off the bat, and they have not only mobile apps, but they actually list Taiga among their apps list. That's just awesome. I have made the move.

o7 MAL. It was fun while it lasted, but AniList has a night mode :3

moyitpro commented 6 years ago

Actually, there was an update recently regarding the API

We are currently working a new terms of use for third party application developers. Also, we have mostly finished reviewing all the tasks necessary for completing development. We are planning to start work on the remaining development some time next week.

I wouldn't lose hope yet, but it will be a while and we still don't know if they will restore the beta or not.

BlackJoe23 commented 6 years ago

Ye also I hate all the other services AI's myanimelist has the most decent desktop friendly one. And the other don't even store your entry update dates and have a shittier database. mal is the most anidb like without being out there to use.

Volatar commented 6 years ago

@moyitpro I was directly responding to that terrible ambiguous MAL update on their API

timw4mail commented 6 years ago

If you really want MAL updates, and you use Kitsu, you can enable syncing on your Kitsu account. They use screen-scraping, but their syncing continues to work in spite of the MAL API nonsense.

F1r3w477 commented 5 years ago

MAL was just acquired by Media Do, while the legal stuff is being worked out DeNA is still doing day to day maintenance and stuff (Source: MAL Official Twitter), but after that when Media Do takes over, maybe we can all spam the twitter asking for the API to be fixed?

moepoi commented 5 years ago

Now i'm using notify.moe and kitsu

ghost commented 5 years ago

thanks for the link i didnt know notify.moe

heard of https://jikan.moe/ ?

Akamaru commented 5 years ago

The API has been down for 1 year now

taigalover commented 5 years ago

An entire 1 year and still nothing on the API, at this point i don't think I'm going back even if the API is restored.

ifonefox commented 5 years ago

An entire 1 year and still nothing on the API

The last status update was "only" about six and a half months ago https://myanimelist.net/forum/?topicid=1740204&show=400#msg56198138

And the last mention from an admin that I could find was about four and a half months ago in relation to the Media Do acquisition

https://myanimelist.net/forum/?topicid=1761834&show=0#msg56726126

moyitpro commented 5 years ago

I am part of the Slack for MyAnimeList and all I can say is Xinil said that the closed betafor the new API is coming soon.

Nevalopo commented 5 years ago

I am part of the Slack for MyAnimeList and all I can say is Xinil said that the closed beta is coming soon.

Closed beta for what?

ifonefox commented 5 years ago

Closed beta for what?

Moyitpro edited their comment and specified its for the new API.

Is the slack public, or invite only?

moyitpro commented 5 years ago

Closed beta for what?

Moyitpro edited their comment and specified its for the new API.

Is the slack public, or invite only?

it's private, so you have to wait until the public release.

ifonefox commented 5 years ago

https://malupdaterosx.moe/2019/06/21/myanimelist-api-update-3/

At last, the light is at the end of the tunnel. The owners of MyAnimeList will open the API up for closed beta for certain developers soon, which I am a part of. Since the public cannot use the apps that use the API during the closed beta, there will be no public testing for any of the apps nor any public commits pushed to the public repos until it’s made public again. The open beta will happen in September, meaning that there won’t be any public beta builds until then.

Kovaelin commented 5 years ago

It's rich that still none of this news is coming from MAL themselves.

kiriya-aoi commented 5 years ago

They got around to announcing it themselves. https://myanimelist.net/forum/?topicid=1794878

Nevalopo commented 5 years ago

I wonder if @erengy will use MAL's new api. Seems the admins of MAL really want him to use it and invited him to closed beta but as we last saw he said he was done with MAL and would never go back to anything related to MAL. I really hope he changed his mind because Taiga + MAL is best combo.

ifonefox commented 5 years ago

he said he was done with MAL and would never go back to anything related to MAL

That's not exactly what the post said.

I'm not going to spend any more time working with the old API, checking out unofficial ones, or devising my own workarounds. I should note that I'm not burning bridges here. I will certainly reconsider my position, especially if the new MAL API becomes available.

Then again, that post is from over a year ago, so I don't know if Erengy still feels that way.

erengy commented 5 years ago

I've personally moved on from MyAnimeList. I also decided not to support them in any way, until a decent official API becomes available. I put up with their problems for ten years. I say, no more.

But yes, I will be participating in the closed beta. I can't promise anything until actually using the new API. Hopefully we will see a public release in the following months.

erengy commented 5 years ago

Closed beta of the new MAL API has begun. It currently lacks some features and has some minor issues, but works better than the old API overall. Several developers including myself are providing feedback on it. We'll see how the new owners will handle things this time around. If all goes well, I'll release a test version of Taiga in the following months, soon after the API goes into open beta.

darkred3 commented 5 years ago

It's finally time. MAL API is in open beta: https://myanimelist.net/forum/?topicid=1804432

erengy commented 5 years ago

I'm about halfway there at implementing the new API to Taiga. Next week, I'll continue from where I left off, then open a new issue to release a test version and collect some feedback.

asakurato commented 5 years ago

I'll jump on testing new API right away when test version is released, thanks!

tokiioKH commented 5 years ago

Can't wait for the test version to be released :D!

Gliscor commented 4 years ago

Glad things are (finally!) working out!

darkred3 commented 4 years ago

Really interested in that test version. You got an ETA for the release yet?

tophf commented 4 years ago

First MAL will need to make their API public.

Public API Release We are still some months away from a public API release. After considering and incorporating the feedback of the closed/open beta participants, we hope to return to you with news of a better and public API in early 2020.

darkred3 commented 4 years ago

erengy is in the closed beta so taiga doesn't need to wait for that.

tophf commented 4 years ago

The API was open to the developers, not to the general public. Just because the program's author is able to use it doesn't mean everyone can. We'll need to wait for the API to go public.

darkred3 commented 4 years ago

Read some of the previous comments. There's already a different app that's gone public and erengy is working on releasing a test version soon.

tophf commented 4 years ago

I see, apparently I've mistaken what "public" means in their terminology. They mean it'll be open to those who writes their own apps. Gee, I wonder if more than 3.5 users even need that.

erengy commented 4 years ago

Taiga's integration with the new MAL API is done, except for a few issues (e.g. handling of expired tokens and different season intervals). Seeing how things are going, I decided to merge it with v1.4 rather than releasing v1.3.2.

Development on MAL's side is rather slow. I've reported about a dozen issues in the past two months, but AFAIK none have been fixed so far. There isn't even an app management page at their website, so users cannot see or revoke apps accessing their accounts. While the new API is better than the previous one, it's not quite ready for public consumption yet.

I'm currently trying to get them to invite more people to the "open" beta, hoping that it'll speed things up. In the meantime, I'll continue working on some other features of v1.4.

darklinkpower commented 4 years ago

at least there's light at the end of the tunnel. I'm not a programmer but I wonder why it took so long to develop the API? Was it something very difficult or did it have to do with something unrelated, like mismanagement of the site?

erengy commented 4 years ago

We've been waiting for a better MAL API for almost ten years. Can't explain that with technical difficulty, especially since I've personally seen people deploy similar APIs within a few weeks.

I believe it was a mixture of the following:

tokiioKH commented 4 years ago

So, basically MAL just messin up then? Any ETA when you are going to push the Taiga v1.4 update?

IAmBlackat commented 4 years ago

Any ETA when you are going to release Taiga v1.4 update? I am waiting for the update from last 2 months

serjflint commented 4 years ago

@movibeast It was only 2 months for you. Last release 1.3.1 was in 2018. AFAIK there is a huge rework going for the next release. It is not even at alpha stage now.

IAmBlackat commented 4 years ago

Yay, that's true. For real?? Wow I am gonna wait for some more time and really excited for new version!

tokiioKH commented 4 years ago

Any ETA yet for v1.4?

xRUSSELL commented 4 years ago

How many times have I checked this Github page since last year! Every time I had my hopes up & after scrolling down my hopes also gets down. Looks like I need to settle down in Anilist because taiga sucks with Kitsu & it doesn't support Simkl. no more waiting for the API but the Taiga v1.4 update. Can't wait XD

crse commented 4 years ago

Sorry for a little bit OOT. @xRUSSELL Can you explain which part Taiga - Kitsu integration "sucks"? I'm using it everyday and it works as intended.