WWBN / AVideo

Create Your Own Broadcast Network With AVideo Platform Open-Source. OAVP OVP
https://avideo.tube/AVideo_OpenSource
Other
1.88k stars 970 forks source link

Sign in to confirm you’re not a bot #9242

Open DanielnetoDotCom opened 1 month ago

DanielnetoDotCom commented 1 month ago

Issue: Unable to Upload/Encode YouTube Videos

Problem Description

Since last night and continuing today, users, including admin, are encountering an error when attempting to share, upload, or encode YouTube videos. The error message displayed is:

Sorry!
ERROR: [youtube] 6R17SNKEbpY: Sign in to confirm you’re not a bot. This helps protect our community. Learn more.

However, the "Learn more" link does not have a hyperlink, and searching online has not provided a solution.

Cause

This issue is a global problem with yt-dlp, which is being blocked by YouTube.

Current Status

I am actively following the issue for a solution. You can track the progress and updates on this issue at the following link: GitHub Issue #10128.

Temporary Solution

As of now, there is no confirmed solution to this problem. Please be patient while the community works on resolving this issue.

Thank you for your understanding and cooperation.

eitanwa commented 1 month ago

hey Daniel Regarding this issue Not sure we understood We have no problem uploading or importing files from YouTube Our systems are up to date Could you please help us understand what we missed

AViSource commented 1 month ago

hey Daniel Regarding this issue Not sure we understood We have no problem uploading or importing files from YouTube Our systems are up to date Could you please help us understand what we missed

That's weird. This is what's happening when I try to upload a video by importing it. (See screenshot.) Screenshot from 2024-07-21 11-06-29

DanielnetoDotCom commented 1 month ago

hey Daniel Regarding this issue Not sure we understood We have no problem uploading or importing files from YouTube Our systems are up to date Could you please help us understand what we missed

Good for you, in those days YouTube is flagging whoever is using yt-dlp as a bot. also banning users if you try to use cookies on it

para2022 commented 1 month ago

yes i have this issue too. All my encoders cannot use yt-dlp anymore.

JoshWho commented 1 month ago

I think it goes off IP they are starting to figure out what servers are being used to pull their vids and limiting the ip

gbrn commented 1 month ago

@DanielnetoDotCom This problem has now been resolved, I can use yt-dlp normally. I recommend updating the encoder servers. Thanks.

para2022 commented 1 month ago

same problem for me

ERROR: [youtube+oauth2] MttpnjmgOXI: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

para2022 commented 1 month ago

@DanielnetoDotCom This problem has now been resolved, I can use yt-dlp normally. I recommend updating the encoder servers. Thanks.

still does not work after updating avideo and the encoder servers. The problem is exactly the same.

gbrn commented 1 month ago

@para2022 The encoder does not only work with files available on Github AVideo Encoder. yt-dlp is responsible for accessing external downloads. So you have to update it on your server.

Latest version: stable@2024.08.06 from yt-dlp/yt-dlp
yt-dlp is up to date (stable@2024.08.06 from yt-dlp/yt-dlp)

sudo pip install -U yt-dlp or sudo yt-dlp -U or sudo curl -L https://github.com/yt-dlp/yt-dlp/releases/latest/download/yt-dlp -o /usr/local/bin/yt-dlp && sudo chmod a+rx /usr/local/bin/yt-dlp

para2022 commented 1 month ago

@para2022 The encoder does not only work with files available on Github AVideo Encoder. yt-dlp is responsible for accessing external downloads. So you have to update it on your server.

Latest version: stable@2024.08.06 from yt-dlp/yt-dlp
yt-dlp is up to date (stable@2024.08.06 from yt-dlp/yt-dlp)

sudo pip install -U yt-dlp or sudo yt-dlp -U or sudo curl -L https://github.com/yt-dlp/yt-dlp/releases/latest/download/yt-dlp -o /usr/local/bin/yt-dlp && sudo chmod a+rx /usr/local/bin/yt-dlp

I have updated yt-dlp already to latest and it still doesnt work. Same error message

gbrn commented 1 month ago

@para2022 Do a test on your yt-dlp. Here for me it worked normally. Try checking if your version is stable@2024.08.06, if not, remove and reinstall: sudo yt-dlp -v

sudo yt-dlp -v
[debug] Command-line config: ['-v']
[debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8
[debug] yt-dlp version stable@2024.08.06 from yt-dlp/yt-dlp [4d9231208] (zip)
[debug] Python 3.10.12 (CPython aarch64 64bit) - Linux-6.5.0-1027-oracle-aarch64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35)
[debug] exe versions: ffmpeg 4.4.2 (setts), ffprobe 4.4.2, rtmpdump 2.4
[debug] Optional libraries: Cryptodome-3.11.0, brotli-1.0.9, certifi-2020.06.20, mutagen-1.45.1, pyxattr-0.7.2, requests-2.32.3, secretstorage-3.3.1, sqlite3-3.37.2, urllib3-2.2.2, websockets-12.0
[debug] Proxy map: {}
[debug] Request Handlers: urllib, requests, websockets
[debug] Loaded 1830 extractors

Test this:

sudo yt-dlp -f 'bestvideo[height=1080]+bestaudio/best[height=1080]' https://www.youtube.com/watch?v=ucZl6vQ_8Uo

image

para2022 commented 1 month ago

Thanks. I get this:

[youtube+oauth2] Extracting URL: https://www.youtube.com/watch?v=ucZl6vQ_8Uo [youtube+oauth2] ucZl6vQ_8Uo: Downloading webpage [youtube+oauth2] ucZl6vQ_8Uo: Downloading ios player API JSON [youtube+oauth2] ucZl6vQ_8Uo: Downloading tv player API JSON ERROR: [youtube+oauth2] ucZl6vQ_8Uo: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

para2022 commented 1 month ago

sudo yt-dlp -v [debug] Command-line config: ['-v'] [debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8 [debug] yt-dlp version stable@2024.08.01 from yt-dlp/yt-dlp [ffd7781d6] (pip) [debug] Python 3.10.12 (CPython x86_64 64bit) - Linux-5.15.0-117-generic-x86_64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35) [debug] exe versions: ffmpeg 4.4.2 (setts), ffprobe 4.4.2 [debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, mutagen-1.47.0, requests-2.32.3, secretstorage-3.3.1, sqlite3-3.37.2, urllib3-2.2.2, websockets-12.0 [debug] Proxy map: {} [debug] Request Handlers: urllib, requests, websockets [debug] Extractor Plugins: oauth2 (YoutubeBaseInfoExtractor), oauth2 (YoutubeClipIE), oauth2 (YoutubeConsentRedirectIE), oauth2 (YoutubeFavouritesIE), oauth2 (YoutubeIE), oauth2 (YoutubeMusicSearchURLIE), oauth2 (YoutubeNotificationsIE), oauth2 (YoutubeSearchDateIE), oauth2 (YoutubeSearchIE), oauth2 (YoutubeSearchURLIE), oauth2 (YoutubeTabBaseInfoExtractor), oauth2 (YoutubeTabIE) [debug] Plugin directories: ['/usr/local/lib/python3.10/dist-packages/yt_dlp_plugins'] [debug] Loaded 1830 extractors

Usage: yt-dlp [OPTIONS] URL [URL...]

yt-dlp: error: You must provide at least one URL. Type yt-dlp --help to see a list of all options.

AViSource commented 1 month ago

sudo yt-dlp -v [debug] Command-line config: ['-v'] [debug] Encodings: locale UTF-8, fs utf-8, pref UTF-8, out utf-8, error utf-8, screen utf-8 [debug] yt-dlp version stable@2024.08.01 from yt-dlp/yt-dlp [ffd7781d6] (pip) [debug] Python 3.10.12 (CPython x86_64 64bit) - Linux-5.15.0-117-generic-x86_64-with-glibc2.35 (OpenSSL 3.0.2 15 Mar 2022, glibc 2.35) [debug] exe versions: ffmpeg 4.4.2 (setts), ffprobe 4.4.2 [debug] Optional libraries: Cryptodome-3.20.0, brotli-1.1.0, certifi-2024.07.04, mutagen-1.47.0, requests-2.32.3, secretstorage-3.3.1, sqlite3-3.37.2, urllib3-2.2.2, websockets-12.0 [debug] Proxy map: {} [debug] Request Handlers: urllib, requests, websockets [debug] Extractor Plugins: oauth2 (YoutubeBaseInfoExtractor), oauth2 (YoutubeClipIE), oauth2 (YoutubeConsentRedirectIE), oauth2 (YoutubeFavouritesIE), oauth2 (YoutubeIE), oauth2 (YoutubeMusicSearchURLIE), oauth2 (YoutubeNotificationsIE), oauth2 (YoutubeSearchDateIE), oauth2 (YoutubeSearchIE), oauth2 (YoutubeSearchURLIE), oauth2 (YoutubeTabBaseInfoExtractor), oauth2 (YoutubeTabIE) [debug] Plugin directories: ['/usr/local/lib/python3.10/dist-packages/yt_dlp_plugins'] [debug] Loaded 1830 extractors

Usage: yt-dlp [OPTIONS] URL [URL...]

yt-dlp: error: You must provide at least one URL. Type yt-dlp --help to see a list of all options.

We have also applied all of the above mentioned steps and gotten the same results as you are getting.

gbrn commented 4 weeks ago

For me it stopped working again, the last update is not working is: Latest version: stable@2024.08.06 from yt-dlp/yt-dlp yt-dlp is up to date (stable@2024.08.06 from yt-dlp/yt-dlp)

[youtube] FFaRzIHpJno: Downloading webpage
[youtube] FFaRzIHpJno: Downloading ios player API JSON
[youtube] FFaRzIHpJno: Downloading web creator player API JSON
ERROR: [youtube] FFaRzIHpJno: Sign in to confirm you’re not a bot. This helps protect our community. Learn more
DanielnetoDotCom commented 3 weeks ago

Hi

I just sent some update to youtube can you guys update your Encoder and signing on youtube before download?

image

para2022 commented 3 weeks ago

It doesnt work for me

Hi

I just sent some update to youtube can you guys update your Encoder and signing on youtube before download?

image

This doesnt work me. Even with the fix i still get the same error:

ERROR: [youtube+oauth2] tMkUIHnv6Yw: Sign in to confirm you’re not a bot. This helps protect our community. Learn more

para2022 commented 3 weeks ago

[14-Aug-2024 04:39:50 Europe/London] [2024-08-14 04:39:50] getTitleFromLink: Get Title Error: LC_ALL=en_US.UTF-8 yt-dlp --no-check-certificate --no-playlist --force-ipv4 --skip-download -e 'https://www.youtube.com/watch?v=tMkUIHnv6Yw' Array ( [0] => ERROR: [youtube+oauth2] tMkUIHnv6Yw: Sign in to confirm you’re not a bot. This helps protect our community. Learn more )

[14-Aug-2024 04:39:50 Europe/London] youtubeDl::addVideo We could not get the title () of your video (https://www.youtube.com/watch?v=tMkUIHnv6Yw) [14-Aug-2024 04:39:50 Europe/London] PHP Warning: Undefined variable $encoders_ids in /home/encoder1/public_html/encoder1/objects/functions.php on line 1508 [14-Aug-2024 04:39:50 Europe/London] PHP Stack trace: [14-Aug-2024 04:39:50 Europe/London] PHP 1. {main}() /home/encoder1/public_html/encoder1/view/youtubeDl.json.php:0 [14-Aug-2024 04:39:50 Europe/London] PHP 2. addVideo($link = 'https://www.youtube.com/watch?v=tMkUIHnv6Yw', $streamers_id = 1, $title = NULL) /home/encoder1/public_html/encoder1/view/youtubeDl.json.php:53 [14-Aug-2024 04:39:50 Europe/London] PHP Warning: Trying to access array offset on null in /home/encoder1/public_html/encoder1/objects/functions.php on line 1508 [14-Aug-2024 04:39:50 Europe/London] PHP Stack trace: [14-Aug-2024 04:39:50 Europe/London] PHP 1. {main}() /home/encoder1/public_html/encoder1/view/youtubeDl.json.php:0 [14-Aug-2024 04:39:50 Europe/London] PHP 2. addVideo($link = 'https://www.youtube.com/watch?v=tMkUIHnv6Yw', $streamers_id = 1, $title = NULL) /home/encoder1/public_html/encoder1/view/youtubeDl.json.php:53

DanielnetoDotCom commented 3 weeks ago

make sure you sign in properly, I am not seeing the accessToken in your log.

try also to share more from your logs

para2022 commented 3 weeks ago

It shows me as properly logged in on my Google account and shows as signed in on the encoder

DanielnetoDotCom commented 3 weeks ago

Ok, so share more from your logs,

if you have signed in in your yt-dlp should have something like --add-header "Authorization: Bearer...

gbrn commented 3 weeks ago

I would like to report my tests... doing Google authentication, it worked perfectly. I hope that soon this will no longer be necessary.

DanielnetoDotCom commented 3 weeks ago

It shows me as properly logged in on my Google account and shows as signed in on the encoder

@para2022 please make a git pull again on the encoder

para2022 commented 3 weeks ago

That last update fixed it. Thanks a lot dan :)

AViSource commented 1 week ago

It shows me as properly logged in on my Google account and shows as signed in on the encoder

@para2022 please make a git pull again on the encoder

I am still experiencing the same problem.

Encoder has been updated, I am logged in to my Google account and shows me as signed in on the encoder as well. yet I get the following error when I attempt to share:

Sorry! WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (1/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (2/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (3/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] Unable to download API page: HTTP Error 401: Unauthorized (caused by ), WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (1/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (2/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] HTTP Error 401: Unauthorized. Retrying (3/3)..., WARNING: [youtube] YouTube said: ERROR - Request had invalid authentication credentials. Expected OAuth 2 access token, login cookie or other valid authentication credential. See https://developers.google.com/identity/sign-in/web/devconsole-project., WARNING: [youtube] Unable to download API page: HTTP Error 401: Unauthorized (caused by ), WARNING: Only images are available for download. use --list-formats to see them, ERROR: [youtube] UFDQGBfCd1M: Requested format is not available. Use --list-formats for a list of available formats

What step did I miss?

DanielnetoDotCom commented 1 week ago

@AViSource What domain is yours?

what youtube URL are you trying to download?

I guess you are from ubaantu, if yes I will look it direcly

AViSource commented 1 week ago

@AViSource What domain is yours?

what youtube URL are you trying to download?

I guess you are from ubaantu, if yes I will look it direcly

Yes, I am from ubaantu

DanielnetoDotCom commented 1 week ago

What exactly link are you trying to download?

AViSource commented 1 week ago

What exactly link are you trying to download? Oh, sorry. This is it. https://www.youtube.com/watch?v=tKELDE5Hazg

DanielnetoDotCom commented 1 week ago

I went to your encoder and signin with my Google user

image

and it works for me

image

soon you will see it in your library

image

AViSource commented 1 week ago

I went to your encoder and signin with my Google user

image

and it works for me

image

soon you will see it in your library

image

I'm happy that it worked. I will try to download / share another video. In my attempts, I selected "Import Video", pasted the url link, selected a "Category" and clicked "Share" before getting the error. I give an update.

AViSource commented 1 week ago

This is weird. I am still getting the same error. There is something off somewhere.

DanielnetoDotCom commented 1 week ago

where you sign in on google, try to delete and add it again.

from your logs, looks like you did not authorize it properly

AViSource commented 1 week ago

where you sign in on google, try to delete and add it again.

from your logs, looks like you did not authorize it properly

Ok so I deleted it and added it again. But, it did not work. So, used another one of our accounts and it worked. I am happy that it worked; However, I am concerned about why it worked with one account but not the other.

DanielnetoDotCom commented 1 week ago

it is probabaly a google thing.