drawrowfly / tiktok-scraper

TikTok Scraper. Download video posts, collect user/trend/hashtag/music feed metadata, sign URL and etc.
4.45k stars 805 forks source link

Access denied to get covers and video url #301

Closed lermann closed 4 years ago

lermann commented 4 years ago

Today I saw that the URL of the videos and for covers are returning access denied when access.

Anyone see the same? Screen Shot 2020-09-16 at 10 56 07

Jaydeep58 commented 4 years ago

yes i seen same error.

Access denied

Jaydeep58 commented 4 years ago

image

liamengland1 commented 4 years ago

They are checking referer.

drawrowfly commented 4 years ago

Set correct headers.

Issue not related to the scraper

Philippwolf commented 4 years ago

As of roughly 30 minutes ago all downloaded videos have only 1KB in size for me. I reproduced this problem on 2 other machines just by installing the project from scratch, while using different IP-Adresses. For the past 7 days before this I was able to download videos just fine. Is this problem related?

drawrowfly commented 4 years ago

Oh this is related

lilireinhart commented 4 years ago

On Wed, Sep 16, 2020 at 10:03 AM Alex notifications@github.com wrote:

yes i seen same error.

Access denied

Umm can you explain what’s going on?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/drawrowfly/tiktok-scraper/issues/301#issuecomment-693427557, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQE3QX47LKHD2OCNI23CVF3SGDAUDANCNFSM4RO37WCQ .

Philippwolf commented 4 years ago

Oh this is related

It's impressive how fast you react! I hope the problem is not all too annoying

drawrowfly commented 4 years ago

@Philippwolf lol )

The issue was fixed in the latest update.

Update version and it will work

Philippwolf commented 4 years ago

Thanks for the incredible work @drawrowfly!! I'll check it out right away 👍

/edit confirmed working like a charm again :)

Jaydeep58 commented 4 years ago

On Wed, Sep 16, 2020 at 10:03 AM Alex @.***> wrote: yes i seen same error. Access denied Umm can you explain what’s going on? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#301 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQE3QX47LKHD2OCNI23CVF3SGDAUDANCNFSM4RO37WCQ .

On Wed, Sep 16, 2020 at 10:03 AM Alex @.***> wrote: yes i seen same error. Access denied Umm can you explain what’s going on? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#301 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQE3QX47LKHD2OCNI23CVF3SGDAUDANCNFSM4RO37WCQ .

i can scrap record and copy video URL then i paste on browser at that time i received Access denied.

Jaydeep58 commented 4 years ago

Please check again "Access denied to get covers and video url " it's not working ,
last 1 month to continue using scrap but today suddenly all video with access denied error..

drawrowfly commented 4 years ago

You won't be able to access the url from the browser without setting the referer header to the tiktok.com

youngvo commented 4 years ago

You won't be able to access the url from the browser without setting the referer header to the tiktok.com

@drawrowfly and/or @All - could you please help to explain about this requirement? I use a html video tag to play the url of tiktok video that is returned from the scraper. It says: 403 Forbidden

mukkaramwaheed commented 4 years ago

@youngvo did you get the URL to play video in HTML video-tag

youngvo commented 4 years ago

@mukkaramwaheed can't play the video directly. I have to download the video before playing. Feel free to share if you find alternative approach.

sra-013 commented 2 years ago

Hey! I am facing a weird issue that I am unable to explain, any help would be appreciated.

I have 3 separate URLs of some tiktok videos; two of them (1 & 2 below) work fine as is but the third one (3 below) works only if there's a referer header present, otherwise it returns a 403. I am not sure why this is happening; the URLs look pretty similar to me. If anyone has any insights, it'd be great!

  1. https://v19-us.tiktokcdn.com/dae6c4fd5c6492bbd3de56d7a5ba2909/62e5705a/video/tos/useast2a/tos-useast2a-pve-0068/a6a1e94e8e4b41e485e3ca6a72fcaf8f/?a=1233&ch=0&cr=3&dr=0&lr=all&cd=0%7C0%7C0%7C3&cv=1&br=2652&bt=1326&btag=80000&cs=0&ds=6&ft=ARJXEBnZqqpmo0P2mZjfkVQSMRX5_KJ&mime_type=video_mp4&qs=0&rc=OmdnOzo6MzxkODw0Z2ZnNUBpMzt0cDM6Zmh2PDMzNzczM0AxYDRjMi4zNjUxYWEwNDQ0YSNnMm01cjRnNnFgLS1kMTZzcw%3D%3D&l=202207301153290101910632050F4EE690&cc=25

  2. https://v16m-webapp.tiktokcdn-us.com/a0815b2b488a33204d60bc64fdb3c2ec/62e580e2/video/tos/useast2a/tos-useast2a-pve-0068/cca7d9424d8e4605b4396a0b6e33fcd9/?a=1988&ch=0&cr=0&dr=0&lr=tiktok_m&cd=0%7C0%7C0%7C0&br=3458&bt=1729&cs=0&ds=3&ft=ebtHKH1pMyq8Z.611we2NsDGfl7Gb&mime_type=video_mp4&qs=0&rc=OTQ2ZmdnMzo4ZDczZDk3Z0BpM3ZxeDw6ZnRmZTMzNzgzM0AyNmAuLzQuNmMxLS4yMy8wYSMyL15ucjRfcGFgLS1kLzZzcw%3D%3D&l=202207301305032D1BEF3A147F988E2895

  3. https://v16-web-newkey.tiktokcdn.com/5b2ed314281ff5054764ca9bd95f0f85/62e582c7/video/tos/useast2a/tos-useast2a-pve-0068/cca7d9424d8e4605b4396a0b6e33fcd9/?a=1988&ch=0&cr=0&dr=0&lr=tiktok_m&cd=0%7C0%7C0%7C0&br=3458&bt=1729&btag=80000&cs=0&ds=3&ft=lcLrKH._Myq8Z~P11we2NCewyl7Gb&mime_type=video_mp4&qs=0&rc=OTQ2ZmdnMzo4ZDczZDk3Z0BpM3ZxeDw6ZnRmZTMzNzgzM0AyNmAuLzQuNmMxLS4yMy8wYSMyL15ucjRfcGFgLS1kLzZzcw%3D%3D&l=202207301313080101910410190B55BE71