Closed Wauplin closed 1 year ago
First reported on slack (private link).
git push hangs forever when pushing a LFS file (6.7GB). To be investigated. Not really a huggingface_hub issue at that point but might be worth knowing what's the issue.
git push
GIT_TRACE=1 GIT_TRANSFER_TRACE=1 GIT_CURL_VERBOSE=1 git push origin main # Upload file model.bin: 0%| | 1.00/6.74G [00:00<?, ?B/s]
03:58:21.201244 exec-cmd.c:139 trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/bin/git 03:58:21.201802 exec-cmd.c:238 trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/bin 03:58:21.202357 git.c:460 trace: built-in: git push origin main 03:58:21.203780 run-command.c:654 trace: run_command: GIT_DIR=.git git remote-https origin https://user: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@huggingface.co/facebook/fasttext-en-vectors 03:58:21.207522 exec-cmd.c:139 trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git 03:58:21.207890 exec-cmd.c:238 trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core 03:58:21.208159 git.c:749 trace: exec: git-remote-https origin https://user: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@huggingface.co/facebook/fasttext-en-vectors 03:58:21.208171 run-command.c:654 trace: run_command: git-remote-https origin https://user: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@huggingface.co/facebook/fasttext-en-vectors 03:58:21.212048 exec-cmd.c:139 trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git-remote-https 03:58:21.212553 exec-cmd.c:238 trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core 03:58:21.218964 http.c:678 == Info: Trying 3.222.20.188:443... 03:58:21.315398 http.c:678 == Info: Connected to huggingface.co (3.222.20.188) port 443 (#0) 03:58:21.315611 http.c:678 == Info: ALPN: offers h2 03:58:21.315624 http.c:678 == Info: ALPN: offers http/1.1 03:58:21.324180 http.c:678 == Info: CAfile: /etc/ssl/cert.pem 03:58:21.324207 http.c:678 == Info: CApath: none 03:58:21.324568 http.c:678 == Info: (304) (OUT), TLS handshake, Client hello (1): 03:58:21.406235 http.c:678 == Info: (304) (IN), TLS handshake, Server hello (2): 03:58:21.409061 http.c:678 == Info: TLSv1.2 (IN), TLS handshake, Certificate (11): 03:58:21.411124 http.c:678 == Info: TLSv1.2 (IN), TLS handshake, Server key exchange (12): 03:58:21.425311 http.c:678 == Info: TLSv1.2 (IN), TLS handshake, Server finished (14): 03:58:21.431180 http.c:678 == Info: TLSv1.2 (OUT), TLS handshake, Client key exchange (16): 03:58:21.431215 http.c:678 == Info: TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1): 03:58:21.431264 http.c:678 == Info: TLSv1.2 (OUT), TLS handshake, Finished (20): 03:58:21.513153 http.c:678 == Info: TLSv1.2 (IN), TLS change cipher, Change cipher spec (1): 03:58:21.513293 http.c:678 == Info: TLSv1.2 (IN), TLS handshake, Finished (20): 03:58:21.513327 http.c:678 == Info: SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256 03:58:21.513337 http.c:678 == Info: ALPN: server accepted h2 03:58:21.513348 http.c:678 == Info: Server certificate: 03:58:21.513367 http.c:678 == Info: subject: CN=huggingface.co 03:58:21.513377 http.c:678 == Info: start date: Feb 22 00:00:00 2023 GMT 03:58:21.513387 http.c:678 == Info: expire date: Jun 10 23:59:59 2023 GMT 03:58:21.513416 http.c:678 == Info: subjectAltName: host "huggingface.co" matched cert's "huggingface.co" 03:58:21.513435 http.c:678 == Info: issuer: C=US; O=Amazon; CN=Amazon RSA 2048 M02 03:58:21.513442 http.c:678 == Info: SSL certificate verify ok. 03:58:21.513484 http.c:678 == Info: Using HTTP2, server supports multiplexing 03:58:21.513496 http.c:678 == Info: Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0 03:58:21.513919 http.c:678 == Info: h2h3 [:method: GET] 03:58:21.513931 http.c:678 == Info: h2h3 [:path: /facebook/fasttext-en-vectors/info/refs?service=git-receive-pack] 03:58:21.513939 http.c:678 == Info: h2h3 [:scheme: https] 03:58:21.513946 http.c:678 == Info: h2h3 [:authority: huggingface.co] 03:58:21.513953 http.c:678 == Info: h2h3 [user-agent: git/2.37.1 (Apple Git-137.1)] 03:58:21.513959 http.c:678 == Info: h2h3 [accept: */*] 03:58:21.513966 http.c:678 == Info: h2h3 [accept-encoding: deflate, gzip] 03:58:21.513972 http.c:678 == Info: h2h3 [pragma: no-cache] 03:58:21.513984 http.c:678 == Info: Using Stream ID: 1 (easy handle 0x14c808200) 03:58:21.514054 http.c:625 => Send header, 0000000206 bytes (0x000000ce) 03:58:21.514068 http.c:637 => Send header: GET /facebook/fasttext-en-vectors/info/refs?service=git-receive-pack HTTP/2 03:58:21.514267 http.c:637 => Send header: Host: huggingface.co 03:58:21.514277 http.c:637 => Send header: user-agent: git/2.37.1 (Apple Git-137.1) 03:58:21.514283 http.c:637 => Send header: accept: */* 03:58:21.514288 http.c:637 => Send header: accept-encoding: deflate, gzip 03:58:21.514294 http.c:637 => Send header: pragma: no-cache 03:58:21.514299 http.c:637 => Send header: 03:58:21.514341 http.c:678 == Info: Connection state changed (MAX_CONCURRENT_STREAMS == 128)! 03:58:21.602906 http.c:625 <= Recv header, 0000000013 bytes (0x0000000d) 03:58:21.602934 http.c:637 <= Recv header: HTTP/2 401 03:58:21.602940 http.c:625 <= Recv header, 0000000037 bytes (0x00000025) 03:58:21.602943 http.c:637 <= Recv header: date: Thu, 16 Mar 2023 10:58:21 GMT 03:58:21.602947 http.c:625 <= Recv header, 0000000041 bytes (0x00000029) 03:58:21.602950 http.c:637 <= Recv header: content-type: text/plain; charset=utf-8 03:58:21.602955 http.c:625 <= Recv header, 0000000020 bytes (0x00000014) 03:58:21.602959 http.c:637 <= Recv header: content-length: 29 03:58:21.602963 http.c:625 <= Recv header, 0000000015 bytes (0x0000000f) 03:58:21.602966 http.c:637 <= Recv header: server: nginx 03:58:21.602969 http.c:625 <= Recv header, 0000000032 bytes (0x00000020) 03:58:21.602972 http.c:637 <= Recv header: x-powered-by: huggingface-moon 03:58:21.602976 http.c:625 <= Recv header, 0000000056 bytes (0x00000038) 03:58:21.603005 http.c:637 <= Recv header: x-request-id: Root=1-6412f64d-46a034937f25ffb52ff4c26d 03:58:21.603011 http.c:625 <= Recv header, 0000000053 bytes (0x00000035) 03:58:21.603014 http.c:637 <= Recv header: access-control-allow-origin: https://huggingface.co 03:58:21.603018 http.c:625 <= Recv header, 0000000014 bytes (0x0000000e) 03:58:21.603021 http.c:637 <= Recv header: vary: Origin 03:58:21.603025 http.c:625 <= Recv header, 0000000098 bytes (0x00000062) 03:58:21.603028 http.c:637 <= Recv header: access-control-expose-headers: X-Repo-Commit,X-Request-Id,X-Error-Code,X-Error-Message,ETag,Link 03:58:21.603032 http.c:625 <= Recv header, 0000000048 bytes (0x00000030) 03:58:21.603035 http.c:637 <= Recv header: x-error-message: Invalid username or password. 03:58:21.603040 http.c:625 <= Recv header, 0000000074 bytes (0x0000004a) 03:58:21.603076 http.c:637 <= Recv header: www-authenticate: Basic realm="Authentication required", charset="UTF-8" 03:58:21.603082 http.c:625 <= Recv header, 0000000042 bytes (0x0000002a) 03:58:21.603085 http.c:637 <= Recv header: etag: W/"1d-DMkJvg8tpLoaQbsiq9Mz7l2CJyI" 03:58:21.603089 http.c:625 <= Recv header, 0000000064 bytes (0x00000040) 03:58:21.603093 http.c:637 <= Recv header: strict-transport-security: max-age=31536000; includeSubDomains 03:58:21.603100 http.c:625 <= Recv header, 0000000002 bytes (0x00000002) 03:58:21.603104 http.c:637 <= Recv header: 03:58:21.603107 http.c:678 == Info: Ignoring the response-body 03:58:21.603131 http.c:678 == Info: Connection #0 to host huggingface.co left intact 03:58:21.603152 http.c:678 == Info: Issue another request to this URL: 'https://user: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@huggingface.co/facebook/fasttext-en-vectors/info/refs?service=git-receive-pack' 03:58:21.603181 http.c:678 == Info: Found bundle for host: 0x6000032340c0 [can multiplex] 03:58:21.603199 http.c:678 == Info: Re-using existing connection #0 with host huggingface.co 03:58:21.603205 http.c:678 == Info: Connected to huggingface.co (3.222.20.188) port 443 (#0) 03:58:21.603219 http.c:678 == Info: Server auth using Basic with user 'user' 03:58:21.603233 http.c:678 == Info: h2h3 [:method: GET] 03:58:21.603237 http.c:678 == Info: h2h3 [:path: /facebook/fasttext-en-vectors/info/refs?service=git-receive-pack] 03:58:21.603241 http.c:678 == Info: h2h3 [:scheme: https] 03:58:21.603244 http.c:678 == Info: h2h3 [:authority: huggingface.co] 03:58:21.603247 http.c:678 == Info: h2h3 [authorization: Basic dXNlcjpoZl9vbHJlcnZVVHVjZGlKdG5scW5BYk9Gc2FHRVBJS0ZhcWJS] 03:58:21.612663 http.c:678 == Info: h2h3 [user-agent: git/2.37.1 (Apple Git-137.1)] 03:58:21.612685 http.c:678 == Info: h2h3 [accept: */*] 03:58:21.612693 http.c:678 == Info: h2h3 [accept-encoding: deflate, gzip] 03:58:21.612700 http.c:678 == Info: h2h3 [pragma: no-cache] 03:58:21.612717 http.c:678 == Info: Using Stream ID: 3 (easy handle 0x14c808200) 03:58:21.612933 http.c:625 => Send header, 0000000285 bytes (0x0000011d) 03:58:21.612948 http.c:637 => Send header: GET /facebook/fasttext-en-vectors/info/refs?service=git-receive-pack HTTP/2 03:58:21.612956 http.c:637 => Send header: Host: huggingface.co 03:58:21.612962 http.c:637 => Send header: authorization: Basic <redacted> 03:58:21.612968 http.c:637 => Send header: user-agent: git/2.37.1 (Apple Git-137.1) 03:58:21.612973 http.c:637 => Send header: accept: */* 03:58:21.621806 http.c:637 => Send header: accept-encoding: deflate, gzip 03:58:21.621832 http.c:637 => Send header: pragma: no-cache 03:58:21.621839 http.c:637 => Send header: 03:58:21.703566 http.c:625 <= Recv header, 0000000013 bytes (0x0000000d) 03:58:21.703603 http.c:637 <= Recv header: HTTP/2 200 03:58:21.703613 http.c:625 <= Recv header, 0000000037 bytes (0x00000025) 03:58:21.703621 http.c:637 <= Recv header: date: Thu, 16 Mar 2023 10:58:21 GMT 03:58:21.703631 http.c:625 <= Recv header, 0000000060 bytes (0x0000003c) 03:58:21.703639 http.c:637 <= Recv header: content-type: application/x-git-receive-pack-advertisement 03:58:21.703648 http.c:625 <= Recv header, 0000000015 bytes (0x0000000f) 03:58:21.703654 http.c:637 <= Recv header: server: nginx 03:58:21.703662 http.c:625 <= Recv header, 0000000032 bytes (0x00000020) 03:58:21.703671 http.c:637 <= Recv header: x-powered-by: huggingface-moon 03:58:21.703679 http.c:625 <= Recv header, 0000000056 bytes (0x00000038) 03:58:21.703685 http.c:637 <= Recv header: x-request-id: Root=1-6412f64d-676dd9023cc185aa656a6c8f 03:58:21.703693 http.c:625 <= Recv header, 0000000053 bytes (0x00000035) 03:58:21.703700 http.c:637 <= Recv header: access-control-allow-origin: https://huggingface.co 03:58:21.703708 http.c:625 <= Recv header, 0000000014 bytes (0x0000000e) 03:58:21.703717 http.c:637 <= Recv header: vary: Origin 03:58:21.703725 http.c:625 <= Recv header, 0000000098 bytes (0x00000062) 03:58:21.703732 http.c:637 <= Recv header: access-control-expose-headers: X-Repo-Commit,X-Request-Id,X-Error-Code,X-Error-Message,ETag,Link 03:58:21.703747 http.c:625 <= Recv header, 0000000064 bytes (0x00000040) 03:58:21.703756 http.c:637 <= Recv header: strict-transport-security: max-age=31536000; includeSubDomains 03:58:21.703765 http.c:625 <= Recv header, 0000000002 bytes (0x00000002) 03:58:21.703773 http.c:637 <= Recv header: 03:58:21.703851 http.c:678 == Info: Connection #0 to host huggingface.co left intact 03:58:21.703925 run-command.c:654 trace: run_command: 'git credential-osxkeychain store' 03:58:21.725459 exec-cmd.c:139 trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git 03:58:21.726333 exec-cmd.c:238 trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core 03:58:21.726905 git.c:749 trace: exec: git-credential-osxkeychain store 03:58:21.726924 run-command.c:654 trace: run_command: git-credential-osxkeychain store 03:58:21.773929 run-command.c:654 trace: run_command: 'git credential-store store' 03:58:21.780256 exec-cmd.c:139 trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git 03:58:21.780835 exec-cmd.c:238 trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core 03:58:21.781008 git.c:460 trace: built-in: git credential-store store 03:58:21.781838 run-command.c:654 trace: run_command: 'git credential-store store' 03:58:21.787157 exec-cmd.c:139 trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git 03:58:21.787496 exec-cmd.c:238 trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core 03:58:21.787664 git.c:460 trace: built-in: git credential-store store 03:58:21.788651 run-command.c:654 trace: run_command: .git/hooks/pre-push origin https://user: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@huggingface.co/facebook/fasttext-en-vectors 03:58:21.794566 exec-cmd.c:139 trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git 03:58:21.794940 exec-cmd.c:238 trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core 03:58:21.795206 git.c:749 trace: exec: git-lfs pre-push origin https://user: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@huggingface.co/facebook/fasttext-en-vectors 03:58:21.795216 run-command.c:654 trace: run_command: git-lfs pre-push origin https://user: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@huggingface.co/facebook/fasttext-en-vectors 03:58:21.823765 trace git-lfs: exec: git 'version' 03:58:21.827936 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'remote' '-v' 03:58:21.831685 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'remote' 03:58:21.834987 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'rev-parse' 'HEAD' '--symbolic-full-name' 'HEAD' 03:58:21.838341 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'rev-parse' '--git-dir' '--show-toplevel' 03:58:21.841819 trace git-lfs: exec: git 'config' '--includes' '-l' 03:58:21.845262 trace git-lfs: exec: git 'rev-parse' '--is-bare-repository' 03:58:21.848186 trace git-lfs: exec: git 'config' '--includes' '-l' '--blob' ':.lfsconfig' 03:58:21.851543 trace git-lfs: exec: git 'config' '--includes' '-l' '--blob' 'HEAD:.lfsconfig' 03:58:21.854992 trace git-lfs: pre-push: refs/heads/main c25409c4988154a665b322b78291e9dec24d5a73 refs/heads/main 83fad05641881e55ad6fc17bf960094805e6cb7c 03:58:21.855078 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'show-ref' 03:58:21.858233 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'ls-remote' '--heads' '--tags' '-q' 'origin' 03:58:22.372189 trace git-lfs: tq: running as batched queue, batch size of 100 03:58:22.372550 trace git-lfs: run_command: git rev-list --objects --ignore-missing --stdin -- 03:58:22.372572 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'rev-list' '--objects' '--ignore-missing' '--stdin' '--' 03:58:22.374445 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'cat-file' '--batch-check' 03:58:22.376167 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'rev-parse' '--git-common-dir' 03:58:22.381775 trace git-lfs: tq: sending batch of size 1 03:58:22.382380 trace git-lfs: api: batch 1 files 03:58:22.382848 trace git-lfs: exec: /usr/bin/security 'list-keychains' 03:58:22.396230 trace git-lfs: exec: /usr/bin/security 'find-certificate' '-a' '-p' '-c' 'huggingface.co' '/Library/Keychains/System.keychain' 03:58:22.407310 trace git-lfs: HTTP: POST https://user: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@huggingface.co/facebook/fasttext-en-vectors.git/info/lfs/objects/batch > POST /facebook/fasttext-en-vectors.git/info/lfs/objects/batch HTTP/1.1 > Host: huggingface.co > Accept: application/vnd.git-lfs+json > Content-Length: 243 > Content-Type: application/vnd.git-lfs+json; charset=utf-8 > User-Agent: git-lfs/3.3.0 (GitHub; darwin arm64; go 1.19.3) > {"operation":"upload","objects":[{"oid":"14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","size":7237176312}],"transfers":["basic","ssh","lfs-standalone-file","multipart"],"ref":{"name":"refs/heads/main"},"hash_algo":"sha256"}03:58:23.040577 trace git-lfs: HTTP: 200 < HTTP/2.0 200 OK < Content-Length: 2018 < Access-Control-Allow-Origin: https://huggingface.co < Access-Control-Expose-Headers: X-Repo-Commit,X-Request-Id,X-Error-Code,X-Error-Message,ETag,Link < Content-Type: application/vnd.git-lfs+json; charset=utf-8 < Date: Thu, 16 Mar 2023 10:58:23 GMT < Etag: W/"7e2-yBwoo9IrnugjPNPCJc6JB8TjkFs" < Server: nginx < Strict-Transport-Security: max-age=31536000; includeSubDomains < Vary: Origin < X-Powered-By: huggingface-moon < X-Request-Id: Root=1-6412f64e-69091994191f9f796a7c94a5 < 03:58:23.040715 trace git-lfs: HTTP: {"transfer":"multipart","objects":[{"oid":"14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","size":7237176312,"authenticated":true,"actions":{"upload":{"href":"https://huggingface.co/api/complete_multipart?uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&bucket=lfs.huggingface.co&prefix=repos%2Fd5%2F17%2Fd51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469&expiration=Fri%2C+17+Mar+2023+10%3A {"transfer":"multipart","objects":[{"oid":"14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","size":7237176312,"authenticated":true,"actions":{"upload":{"href":"https://huggingface.co/api/complete_multipart?uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&bucket=lfs.huggingface.co&prefix=repos%2Fd5%2F17%2Fd51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469&expiration=Fri%2C+17+Mar+2023+10%3A03:58:23.044783 trace git-lfs: HTTP: 58%3A23+GMT&signature=bf152add14de54e75fad3fea79213f8b3f4e647d2529d8017d7fefa855962689","expires_in":86400,"header":{"chunk_size":"5000000000","00001":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230316T105823Z&X-Amz-Expires=86400&X-Amz-Signature=6649c24e822ac2f578138dd7d0aba5b4c13e4b8f7363b29bdd3ec303af61a17b&X-Amz-SignedHeaders=host&partNumber=1&uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&x-id=UploadPart","00002":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763 58%3A23+GMT&signature=bf152add14de54e75fad3fea79213f8b3f4e647d2529d8017d7fefa855962689","expires_in":86400,"header":{"chunk_size":"5000000000","00001":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230316T105823Z&X-Amz-Expires=86400&X-Amz-Signature=6649c24e822ac2f578138dd7d0aba5b4c13e4b8f7363b29bdd3ec303af61a17b&X-Amz-SignedHeaders=host&partNumber=1&uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&x-id=UploadPart","00002":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f676303:58:23.045627 trace git-lfs: HTTP: ca?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230316T105823Z&X-Amz-Expires=86400&X-Amz-Signature=4b50819766c9ae6984b56fe8521389f2aaf391b7a323a5058aba99f04c686140&X-Amz-SignedHeaders=host&partNumber=2&uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&x-id=UploadPart"}}}}]} ca?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230316T105823Z&X-Amz-Expires=86400&X-Amz-Signature=4b50819766c9ae6984b56fe8521389f2aaf391b7a323a5058aba99f04c686140&X-Amz-SignedHeaders=host&partNumber=2&uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&x-id=UploadPart"}}}}]}03:58:23.045986 trace git-lfs: tq: starting transfer adapter "multipart" 03:58:23.046003 trace git-lfs: xfer: adapter "multipart" Begin() with 8 workers 03:58:23.046007 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 0 03:58:23.046378 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload' 03:58:23.050527 trace git-lfs: xfer: Custom adapter worker 0 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8} 03:58:23.472917 trace git-lfs: xfer: Custom adapter worker 0 received response: {} 03:58:23.472981 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 0 OK 03:58:23.472989 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 1 03:58:23.473038 trace git-lfs: xfer: adapter "multipart" worker 0 starting 03:58:23.473124 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload' 03:58:23.474231 trace git-lfs: xfer: Custom adapter worker 1 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8} 03:58:23.626588 trace git-lfs: xfer: Custom adapter worker 1 received response: {} 03:58:23.626616 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 1 OK 03:58:23.626629 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 2 03:58:23.626660 trace git-lfs: xfer: adapter "multipart" worker 1 starting 03:58:23.626677 trace git-lfs: xfer: adapter "multipart" worker 1 waiting for Auth 03:58:23.626751 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload' 03:58:23.627725 trace git-lfs: xfer: Custom adapter worker 2 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8} 03:58:23.794249 trace git-lfs: xfer: Custom adapter worker 2 received response: {} 03:58:23.794287 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 2 OK 03:58:23.794302 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 3 03:58:23.794316 trace git-lfs: xfer: adapter "multipart" worker 2 starting 03:58:23.794339 trace git-lfs: xfer: adapter "multipart" worker 2 waiting for Auth 03:58:23.794430 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload' 03:58:23.795423 trace git-lfs: xfer: Custom adapter worker 3 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8} 03:58:23.948498 trace git-lfs: xfer: Custom adapter worker 3 received response: {} 03:58:23.948527 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 3 OK 03:58:23.948543 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 4 03:58:23.948570 trace git-lfs: xfer: adapter "multipart" worker 3 starting 03:58:23.948592 trace git-lfs: xfer: adapter "multipart" worker 3 waiting for Auth 03:58:23.948680 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload' 03:58:23.949734 trace git-lfs: xfer: Custom adapter worker 4 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8} 03:58:24.121468 trace git-lfs: xfer: Custom adapter worker 4 received response: {} 03:58:24.121498 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 4 OK 03:58:24.121511 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 5 03:58:24.121539 trace git-lfs: xfer: adapter "multipart" worker 4 starting 03:58:24.121558 trace git-lfs: xfer: adapter "multipart" worker 4 waiting for Auth 03:58:24.121644 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload' 03:58:24.122593 trace git-lfs: xfer: Custom adapter worker 5 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8} 03:58:24.280177 trace git-lfs: xfer: Custom adapter worker 5 received response: {} 03:58:24.280206 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 5 OK 03:58:24.280226 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 6 03:58:24.280236 trace git-lfs: xfer: adapter "multipart" worker 5 starting 03:58:24.280255 trace git-lfs: xfer: adapter "multipart" worker 5 waiting for Auth 03:58:24.280380 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload' 03:58:24.281348 trace git-lfs: xfer: Custom adapter worker 6 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8} 03:58:24.448202 trace git-lfs: xfer: Custom adapter worker 6 received response: {} 03:58:24.448229 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 6 OK 03:58:24.448238 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 7 03:58:24.448264 trace git-lfs: xfer: adapter "multipart" worker 6 starting 03:58:24.448287 trace git-lfs: xfer: adapter "multipart" worker 6 waiting for Auth 03:58:24.448370 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload' 03:58:24.449395 trace git-lfs: xfer: Custom adapter worker 7 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8} 03:58:24.621761 trace git-lfs: xfer: Custom adapter worker 7 received response: {} 03:58:24.621789 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 7 OK 03:58:24.621799 trace git-lfs: xfer: adapter "multipart" started 03:58:24.621849 trace git-lfs: xfer: adapter "multipart" worker 0 processing job for "14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca" 03:58:24.621834 trace git-lfs: xfer: adapter "multipart" worker 7 starting 03:58:24.621864 trace git-lfs: xfer: adapter "multipart" worker 7 waiting for Auth 03:58:24.621943 trace git-lfs: xfer: Custom adapter worker 0 sending message: {"event":"upload","oid":"14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","size":7237176312,"path":"/Users/sheonhan/fun/hugging-face/facebook/fasttext-en-vectors/.git/lfs/objects/14/c7/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","action":{"href":"https://huggingface.co/api/complete_multipart?uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr\u0026bucket=lfs.huggingface.co\u0026prefix=repos%2Fd5%2F17%2Fd51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469\u0026expiration=Fri%2C+17+Mar+2023+10%3A58%3A23+GMT\u0026signature=bf152add14de54e75fad3fea79213f8b3f4e647d2529d8017d7fefa855962689","header":{"00001":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca?X-Amz-Algorithm=AWS4-HMAC-SHA256\u0026X-Amz-Content-Sha256=UNSIGNED-PAYLOAD\u0026X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request\u0026X-Amz-Date=20230316T105823Z\u0026X-Amz-Expires=86400\u0026X-Amz-Signature=6649c24e822ac2f578138dd7d0aba5b4c13e4b8f7363b29bdd3ec303af61a17b\u0026X-Amz-SignedHeaders=host\u0026partNumber=1\u0026uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr\u0026x-id=UploadPart","00002":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca?X-Amz-Algorithm=AWS4-HMAC-SHA256\u0026X-Amz-Content-Sha256=UNSIGNED-PAYLOAD\u0026X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request\u0026X-Amz-Date=20230316T105823Z\u0026X-Amz-Expires=86400\u0026X-Amz-Signature=4b50819766c9ae6984b56fe8521389f2aaf391b7a323a5058aba99f04c686140\u0026X-Amz-SignedHeaders=host\u0026partNumber=2\u0026uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr\u0026x-id=UploadPart","chunk_size":"5000000000"},"expires_at":"0001-01-01T00:00:00Z","expires_in":86400}} 03:58:24.622151 trace git-lfs: xfer: Custom adapter worker 0 received response: {"event": "progress", "oid": "14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca", "bytesSoFar": 1, "bytesSinceLast": 0} 03:58:24.622192 trace git-lfs: xfer: adapter "multipart" worker 7 auth signal received 03:58:24.622199 trace git-lfs: xfer: adapter "multipart" worker 1 auth signal received 03:58:24.622201 trace git-lfs: xfer: adapter "multipart" worker 2 auth signal received 03:58:24.622203 trace git-lfs: xfer: adapter "multipart" worker 3 auth signal received 03:58:24.622204 trace git-lfs: xfer: adapter "multipart" worker 4 auth signal received 03:58:24.622209 trace git-lfs: xfer: adapter "multipart" worker 5 auth signal received 03:58:24.622233 trace git-lfs: xfer: adapter "multipart" worker 6 auth signal received
Most likely related to instabilities on the server at that moment. No way to reproduce anyway so let's close.
First reported on slack (private link).
git push
hangs forever when pushing a LFS file (6.7GB). To be investigated. Not really a huggingface_hub issue at that point but might be worth knowing what's the issue.