oscarotero / Embed

Get info from any web service or page
MIT License
2.09k stars 312 forks source link

Twitter.com to X.com migration giving errors #536

Open JanMisker opened 6 months ago

JanMisker commented 6 months ago

I suspect there is a migration happening over at Twitter, all URLs seem to redirect to x.com. But I also see a form like this as the final destination of the redirects, not sure what that is about.

I put some debug code somewhere to see the response body.

If I submit the form I just end up at x.com...

<!DOCTYPE html>

<head>
    <title>x.com</title>
    <meta http-equiv="refresh" content="5; url = https://twitter.com?mx=1" />
</head>
<form action="https://x.com/x/migrate" method="post" name="f">
    <input type="hidden" name="tok"
        value="[SEEMS LIKE A JWT TOKEN]" />
    <input type="hidden" name="data"
        value="[SOME LONG DATA]" />
</form>
<script type="text/javascript" charset="utf-8"
    nonce="[NONCE]">document.forms.f.submit()</script>
</body>

</html>

Posting here in case others find the same issue, maybe we figure it out or maybe it again changes along the way.

JanMisker commented 6 months ago

Maybe the oembed API can be utilized? https://developer.x.com/en/docs/twitter-for-websites/oembed-api

oscarotero commented 6 months ago

It's already using it.

Screenshot from my local:

imaxe
JanMisker commented 6 months ago

Ah of course. Sorry I didn't do much digging yet.

But still, the data collecting fails, I think because first there is an attempt to load the actual url, and only after that the oembed is fetched.