vinitkumar / googlecl

GoogleCL rewrite in __progress__
Other
324 stars 48 forks source link

Youtube Error: "Unknown authorization header" after a long upload time 4h #177

Closed vinitkumar closed 6 years ago

vinitkumar commented 10 years ago

From admin.fu...@googlemail.com on June 24, 2010 22:05:46

What steps will reproduce the problem? 1. upload a big file (320mb) in my case a *.flv file

  1. damn slow upload ratio (20kb/s not kbit/s)
  2. start jon with "at" command (don't think that this is a problem) What is the expected output? What do you see instead? i started th job at 10 in the morning and recived system mail at 13:56 with rhe following content:

Return-Path: xxxx@eva.site X-Original-To: xxxx Delivered-To: xxxx@eva.site Received: by eva.site (Postfix, from userid 1000) id 5B62A37CE7; Thu, 24 Jun 2010 13:56:17 +0200 (CEST) Subject: Output from your job 13 To: xxxx@eva.site Message-Id: 20100624115617.5B62A37CE7@eva.site Date: Thu, 24 Jun 2010 13:56:17 +0200 (CEST) From: xxxx@eva.site (xxxx Fuchs)

/usr/lib/python2.6/site-packages/gdata/tlslite/utils/cryptomath.py:9: DeprecationWarning: the sha module is deprecated; use the hashlib module instead import sha Loading /srv/safe/Videos/Youtube/02_1.flv Traceback (most recent call last): File "/usr/local/bin/google", line 463, in main() File "/usr/local/bin/google", line 457, in main run_once(options, args) File "/usr/local/bin/google", line 356, in run_once task.run(client, options, args) File "/usr/local/lib/python2.6/site-packages/googlecl/youtube/service.py", line 217, in _run_post tags=options.tags, category=options.category) File "/usr/local/lib/python2.6/site-packages/googlecl/youtube/service.py", line 129, in post_videos self.InsertVideoEntry(video_entry, path) File "/usr/lib/python2.6/site-packages/gdata/youtube/service.py", line 656, in InsertVideoEntry raise YouTubeError(e.args[0]) gdata.youtube.service.YouTubeError: {'status': 401, 'body': 'Unknown authorization header', 'reason': 'Unauthorized'} What version of the product are you using? On what operating system? What version of gdata-python-client (aka python-gdata)? current version: googlecl-0.9.7.tar.gz os: openSuse 11.2 Please provide any additional information below. i tested a *.mov file with about 2mb and it works nice even with a created job.

Original issue: http://code.google.com/p/googlecl/issues/detail?id=169

vinitkumar commented 10 years ago

From tom.h.mi...@gmail.com on June 28, 2010 07:39:42

Issue 179 has been merged into this issue.

vinitkumar commented 10 years ago

From illinois...@gmail.com on June 28, 2010 16:58:32

I have this same issue while trying to upload a 203MB AVI (all my AVI are between 200 and 400MB). I was able to successfully upload a 1.8MB AVI without any trouble. Running from the command line, took about 15 minutes before that error was returned.

What version of the product are you using? googlecl 0.9.7

On what operating system? Ubuntu 6.06.2 LTS

What version of gdata-python-client (aka python-gdata)? Python 2.6.5 gdata 2.0.10

vinitkumar commented 10 years ago

From tom.h.mi...@gmail.com on June 30, 2010 13:46:47

Sorry that youtube support hasn't been getting much love lately.

Could everyone apply the attached patch? (Should be good for 0.9.7 and 0.9.8) It will make youtube spit out all the details on its requests. Please attach a file that contains the output from a failed upload/post command.

(Note: This will make your shell fill up with text pretty quickly, so you may want to redirect output to a file from the start. For anyone that doesn't know, you can do that by adding > output_file.txt to the end of the command you use)

Attachment: yt_debug.patch

vinitkumar commented 10 years ago

From mrtn...@gmail.com on July 09, 2010 01:00:38

I'm also having this problem when uploading a 412MB movie to youtube. I've applied the patch. The output file is 1.2GB, so it's impossible to attach.

Here are the first lines of output:

connect: (gdata.youtube.com, 80) send: 'GET http://gdata.youtube.com/feeds/api/users/default/uploads?max-results=1 HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: gdata.youtube.com\r\nContent-Type: application/atom+xml\r\nX-Gdata-Client: GoogleCL\r\nAuthorization: OAuth realm="", oauth_nonce="17671922", oauth_timestamp="1278601756", oauth_consumer_key="anonymous", oauth_signature_method="HMAC-SHA1", oauth_version="1.0", oauth_token="1%2FGc6SYoRzLPU7qR16QKcOQo6sDFflmnkDODJtrd5fwhE", oauth_signature="UwwRfzrERFrbW4JBXyZMhxln%2B2Q%3D"\r\nUser-Agent: GoogleCL GData-Python/2.0.10\r\n\r\n' reply: 'HTTP/1.1 200 OK\r\n' header: X-GData-User-Country: BE header: Content-Type: application/atom+xml; charset=UTF-8 header: Expires: Thu, 08 Jul 2010 15:09:17 GMT header: Date: Thu, 08 Jul 2010 15:09:17 GMT header: Cache-Control: private, max-age=0, must-revalidate, no-transform header: Vary: * header: GData-Version: 1.0 header: Last-Modified: Thu, 08 Jul 2010 15:09:17 GMT header: Transfer-Encoding: chunked header: X-Content-Type-Options: nosniff header: X-Frame-Options: SAMEORIGIN header: X-XSS-Protection: 1; mode=block header: Server: GSE Loading /share/Movies/2010/07 juli/20100706205929.m2ts connect: (uploads.gdata.youtube.com, 80) send: 'POST http://uploads.gdata.youtube.com/feeds/api/users/default/uploads HTTP/1.1\r\nAccept-Encoding: identity\r\nHost: uploads.gdata.youtube.com\r\nContent-Length: 432144911\r\nX-Gdata-Client: GoogleCL\r\nUser-Agent: GoogleCL GData-Python/2.0.10\r\nX-GData-Key: key=AI39si4d9dBo0dX7TnGyfQ68bNiKfEeO7wORCfY3HAgSStFboTgTgAi9nQwJMfMSizdGIs35W9wVGkygEw8ei3_fWGIiGSiqnQ\r\nContent-Type: multipart/related; boundary=END_OF_PART\r\nSlug: 20100706205929.m2ts\r\nAuthorization: OAuth realm="", oauth_nonce="39943710", oauth_timestamp="1278601757", oauth_consumer_key="anonymous", oauth_signature_method="HMAC-SHA1", oauth_version="1.0", oauth_token="1%2FGc6SYoRzLPU7qR16QKcOQo6sDFflmnkDODJtrd5fwhE", oauth_signature="JoQDfDXDKFqE1amSqoah46rw%2Blk%3D"\r\nMIME-version: 1.0\r\n\r\n' send: 'Media multipart posting\r\n--END_OF_PART\r\nContent-Type: application/atom+xml\r\n\r\n' send: '<?xml version=\'1.0\' encoding=\'UTF-8\'?>\nns1:descriptionA video/ns1:descriptionns1:title20100706205929/ns1:titleNonprofit/ns1:category/ns1:group/ns0:entry' send: '\r\n--END_OF_PART\r\nContent-Type: video/quicktime\r\n\r\n' send: '\x00\x00\x00\x00G@\x00\x10\x00\x00\xb0\x11\x00\x00\xc1\x00\x00\x00\x00\xe0\x1f\x00\x01\xe1\x00#Z\xab\x82\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\x00\x00\x08\xd0GA\x00\x10\x00\x02\xb0>\x00\x01\xc1\x00\x00\xf0\x01\xf0\x0c\x05\x04HDMV\x88\x04\x0f\xff\xfc\xfc\x1b\xf0\x11\xf0\n\x05\x08HDMV\xff\x1bC?\x81\xf1\x00\xf0\x0c\x05\x04AC-3\x81\x04\x040\x04\x00\x90\xf2\x00\xf0\x00\x0c\xd3\xf4\xdc\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff\xff...

Here are the last lines of output:

... send: '\r\n--END_OF_PART--\r\n' reply: 'HTTP/1.1 401 Unauthorized\r\n' header: Server: Upload Server Built on Jul 1 2010 15:26:59 (1278023219) header: X-GData-User-Country: BE header: WWW-Authenticate: GoogleLogin service="youtube",realm=" https://www.google.com/youtube/accounts/ClientLogin " header: Content-Type: text/html; charset=UTF-8 header: Content-Length: 28 header: Date: Thu, 08 Jul 2010 17:27:30 GMT header: Pragma: no-cache header: Expires: Fri, 01 Jan 1990 00:00:00 GMT header: Cache-Control: no-cache, no-store, must-revalidate

Hope this can be fixed soon. I guess it's a timeout problem because the upload takes more then 2 hours.

vinitkumar commented 10 years ago

From tom.h.mi...@gmail.com on July 09, 2010 07:40:03

Great! That's really useful. Thanks for dedicating 1.2 GB of your hard drive to solving this problem. :)

Can you attach a file that contains the first 100 and last 100 lines of the output? I'd like to look at a couple more transmissions.

vinitkumar commented 10 years ago

From mrtn...@gmail.com on July 09, 2010 07:56:09

The other transmissions are all binary data. I've attached the first and last 5MB of the log.

Attachment: head tail

vinitkumar commented 10 years ago

From tom.h.mi...@gmail.com on July 10, 2010 07:32:36

Thanks!

This seems like an issue with the library, so I created an issue at http://code.google.com/p/gdata-python-client/issues/detail?id=408 using the data that mrtncls provided.

Please go star the issue and list your OS, gdata version, and anything else that seems relevant. Hopefully someone will take notice quickly.

vinitkumar commented 10 years ago

From tom.h.mi...@gmail.com on July 23, 2010 16:38:37

Status: Feedback

vinitkumar commented 10 years ago

From thmil...@google.com on November 01, 2010 12:14:36

I've filed a new issue here: http://code.google.com/a/google.com/p/apps-api-issues/issues/detail?id=2304 This problem seems to extend past the python client library, so that's the appropriate place for this issue.

Please post on the new issue with any relevant details you can think of -- video size, type of video, OS, whatever. Headers from the initial POST message and final server response might help. I've already included the details from mrtncls in the issue creation.

Status: BlockedOnAPI