pablouser1 / ProxiTok

Open source alternative frontend for TikTok made using PHP
https://github.com/pablouser1/ProxiTok/wiki/Public-instances
GNU Affero General Public License v3.0
1.86k stars 135 forks source link

Changes on tiktok side breaks user posts retreival (new signature?) #94

Open vdemay opened 2 years ago

vdemay commented 2 years ago

Get user videos does not work anymore probably due to a change on tiktok tt-parameter generation

How to reproduce: 1/ go to https://proxitok.pabloferreiro.es/@willsmith -> working because content has been captured while getting user info 2/ go to the bottom of the page and click Next -> Error

Actually I suppose the end point user/item_list needs a new signing method or new parameters to work properly.

vdemay commented 2 years ago

Same ticket open here : https://github.com/carcabot/tiktok-signature/issues/168

pablouser1 commented 1 year ago

Fixed thanks to https://github.com/carcabot/tiktok-signature/issues/168#issuecomment-1311920063, thanks @carcabot!

If anyone reading this is a webmaster hosting ProxiTok, remember to also upgrade tiktok-signature/SignTok!

vdemay commented 1 year ago

Hello,

Thanks for the update. But unfortunately, it still does not work.

I suppose the first page for willsmith account is now in cache so it display well. But if you try with another account it does not work.

Tiktok puts probably a short expiration time on one of the parameters of the request leading the fix of @carcabot to work only for a short period of time - see https://github.com/carcabot/tiktok-signature/issues/168

This can also be useful - same issue - https://github.com/davidteather/TikTok-Api/issues/974

Thanks for your work on this

pablouser1 commented 1 year ago

Thanks for the heads up, I'll check it out and implement it when I have time.

I suppose the first page for willsmith account is now in cache so it display well. But if you try with another account it does not work.

The first page is scraped from the html in order to save a request to the API, that's why the first page always works correctly.

pablouser1 commented 1 year ago

Looks like changing the User Agent of the scraper to a smartphone (Mozilla/5.0 (Linux; Android 11; SAMSUNG SM-G973U) AppleWebKit/537.36 (KHTML, like Gecko) SamsungBrowser/14.2 Chrome/87.0.4280.141 Mobile Safari/537.36 is currently in use) helps.

Why? ¯\_(ツ)_/¯ I really don't know. I don't know if this will work with many requets, we'll see.

NoPlagiarism commented 1 year ago

I guess, it's time to create /health endpoint? Or idk.

LukeLR commented 1 year ago

In #126 I exposed the user_agent parameter of the TikScraper API as an environment variable. However, setting the value recommended by @pablouser1 there does not fix the 503 Error when clicking next on a user's page. Am I doing something wrong, or does this approach no longer work?

desbest commented 1 year ago

Is there an update on this?

SuperSonicHub1 commented 1 year ago

This is still a problem for me, both with ProxiTok and using TikScraper directly in a project for work. It seems errors with requesting stuff with a non-zero cursor can be overcome by reloading the page multiple times, albeit rarely.

Sainttttttttttt commented 11 months ago

I cant use it

pablouser1 commented 2 months ago

Should be fixed with #224