search

huggingface / huggingface_hub

The official Python client for the Huggingface Hub.
https://huggingface.co/docs/huggingface_hub
Apache License 2.0
2.06k stars 541 forks source link

git+lfs push_to_hub get's stuck forever #1393

Closed Wauplin closed 1 year ago

Wauplin commented 1 year ago

First reported on slack (private link).

git push hangs forever when pushing a LFS file (6.7GB). To be investigated. Not really a huggingface_hub issue at that point but might be worth knowing what's the issue.

GIT_TRACE=1 GIT_TRANSFER_TRACE=1 GIT_CURL_VERBOSE=1 git push origin main

# Upload file model.bin:   0%|         | 1.00/6.74G [00:00<?, ?B/s]
03:58:21.201244 exec-cmd.c:139          trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/bin/git
03:58:21.201802 exec-cmd.c:238          trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/bin
03:58:21.202357 git.c:460               trace: built-in: git push origin main
03:58:21.203780 run-command.c:654       trace: run_command: GIT_DIR=.git git remote-https origin https://user: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@huggingface.co/facebook/fasttext-en-vectors
03:58:21.207522 exec-cmd.c:139          trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git
03:58:21.207890 exec-cmd.c:238          trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core
03:58:21.208159 git.c:749               trace: exec: git-remote-https origin https://user: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@huggingface.co/facebook/fasttext-en-vectors
03:58:21.208171 run-command.c:654       trace: run_command: git-remote-https origin https://user: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@huggingface.co/facebook/fasttext-en-vectors
03:58:21.212048 exec-cmd.c:139          trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git-remote-https
03:58:21.212553 exec-cmd.c:238          trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core
03:58:21.218964 http.c:678              == Info:   Trying 3.222.20.188:443...
03:58:21.315398 http.c:678              == Info: Connected to huggingface.co (3.222.20.188) port 443 (#0)
03:58:21.315611 http.c:678              == Info: ALPN: offers h2
03:58:21.315624 http.c:678              == Info: ALPN: offers http/1.1
03:58:21.324180 http.c:678              == Info:  CAfile: /etc/ssl/cert.pem
03:58:21.324207 http.c:678              == Info:  CApath: none
03:58:21.324568 http.c:678              == Info: (304) (OUT), TLS handshake, Client hello (1):
03:58:21.406235 http.c:678              == Info: (304) (IN), TLS handshake, Server hello (2):
03:58:21.409061 http.c:678              == Info: TLSv1.2 (IN), TLS handshake, Certificate (11):
03:58:21.411124 http.c:678              == Info: TLSv1.2 (IN), TLS handshake, Server key exchange (12):
03:58:21.425311 http.c:678              == Info: TLSv1.2 (IN), TLS handshake, Server finished (14):
03:58:21.431180 http.c:678              == Info: TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
03:58:21.431215 http.c:678              == Info: TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
03:58:21.431264 http.c:678              == Info: TLSv1.2 (OUT), TLS handshake, Finished (20):
03:58:21.513153 http.c:678              == Info: TLSv1.2 (IN), TLS change cipher, Change cipher spec (1):
03:58:21.513293 http.c:678              == Info: TLSv1.2 (IN), TLS handshake, Finished (20):
03:58:21.513327 http.c:678              == Info: SSL connection using TLSv1.2 / ECDHE-RSA-AES128-GCM-SHA256
03:58:21.513337 http.c:678              == Info: ALPN: server accepted h2
03:58:21.513348 http.c:678              == Info: Server certificate:
03:58:21.513367 http.c:678              == Info:  subject: CN=huggingface.co
03:58:21.513377 http.c:678              == Info:  start date: Feb 22 00:00:00 2023 GMT
03:58:21.513387 http.c:678              == Info:  expire date: Jun 10 23:59:59 2023 GMT
03:58:21.513416 http.c:678              == Info:  subjectAltName: host "huggingface.co" matched cert's "huggingface.co"
03:58:21.513435 http.c:678              == Info:  issuer: C=US; O=Amazon; CN=Amazon RSA 2048 M02
03:58:21.513442 http.c:678              == Info:  SSL certificate verify ok.
03:58:21.513484 http.c:678              == Info: Using HTTP2, server supports multiplexing
03:58:21.513496 http.c:678              == Info: Copying HTTP/2 data in stream buffer to connection buffer after upgrade: len=0
03:58:21.513919 http.c:678              == Info: h2h3 [:method: GET]
03:58:21.513931 http.c:678              == Info: h2h3 [:path: /facebook/fasttext-en-vectors/info/refs?service=git-receive-pack]
03:58:21.513939 http.c:678              == Info: h2h3 [:scheme: https]
03:58:21.513946 http.c:678              == Info: h2h3 [:authority: huggingface.co]
03:58:21.513953 http.c:678              == Info: h2h3 [user-agent: git/2.37.1 (Apple Git-137.1)]
03:58:21.513959 http.c:678              == Info: h2h3 [accept: */*]
03:58:21.513966 http.c:678              == Info: h2h3 [accept-encoding: deflate, gzip]
03:58:21.513972 http.c:678              == Info: h2h3 [pragma: no-cache]
03:58:21.513984 http.c:678              == Info: Using Stream ID: 1 (easy handle 0x14c808200)
03:58:21.514054 http.c:625              => Send header, 0000000206 bytes (0x000000ce)
03:58:21.514068 http.c:637              => Send header: GET /facebook/fasttext-en-vectors/info/refs?service=git-receive-pack HTTP/2
03:58:21.514267 http.c:637              => Send header: Host: huggingface.co
03:58:21.514277 http.c:637              => Send header: user-agent: git/2.37.1 (Apple Git-137.1)
03:58:21.514283 http.c:637              => Send header: accept: */*
03:58:21.514288 http.c:637              => Send header: accept-encoding: deflate, gzip
03:58:21.514294 http.c:637              => Send header: pragma: no-cache
03:58:21.514299 http.c:637              => Send header:
03:58:21.514341 http.c:678              == Info: Connection state changed (MAX_CONCURRENT_STREAMS == 128)!
03:58:21.602906 http.c:625              <= Recv header, 0000000013 bytes (0x0000000d)
03:58:21.602934 http.c:637              <= Recv header: HTTP/2 401
03:58:21.602940 http.c:625              <= Recv header, 0000000037 bytes (0x00000025)
03:58:21.602943 http.c:637              <= Recv header: date: Thu, 16 Mar 2023 10:58:21 GMT
03:58:21.602947 http.c:625              <= Recv header, 0000000041 bytes (0x00000029)
03:58:21.602950 http.c:637              <= Recv header: content-type: text/plain; charset=utf-8
03:58:21.602955 http.c:625              <= Recv header, 0000000020 bytes (0x00000014)
03:58:21.602959 http.c:637              <= Recv header: content-length: 29
03:58:21.602963 http.c:625              <= Recv header, 0000000015 bytes (0x0000000f)
03:58:21.602966 http.c:637              <= Recv header: server: nginx
03:58:21.602969 http.c:625              <= Recv header, 0000000032 bytes (0x00000020)
03:58:21.602972 http.c:637              <= Recv header: x-powered-by: huggingface-moon
03:58:21.602976 http.c:625              <= Recv header, 0000000056 bytes (0x00000038)
03:58:21.603005 http.c:637              <= Recv header: x-request-id: Root=1-6412f64d-46a034937f25ffb52ff4c26d
03:58:21.603011 http.c:625              <= Recv header, 0000000053 bytes (0x00000035)
03:58:21.603014 http.c:637              <= Recv header: access-control-allow-origin: https://huggingface.co
03:58:21.603018 http.c:625              <= Recv header, 0000000014 bytes (0x0000000e)
03:58:21.603021 http.c:637              <= Recv header: vary: Origin
03:58:21.603025 http.c:625              <= Recv header, 0000000098 bytes (0x00000062)
03:58:21.603028 http.c:637              <= Recv header: access-control-expose-headers: X-Repo-Commit,X-Request-Id,X-Error-Code,X-Error-Message,ETag,Link
03:58:21.603032 http.c:625              <= Recv header, 0000000048 bytes (0x00000030)
03:58:21.603035 http.c:637              <= Recv header: x-error-message: Invalid username or password.
03:58:21.603040 http.c:625              <= Recv header, 0000000074 bytes (0x0000004a)
03:58:21.603076 http.c:637              <= Recv header: www-authenticate: Basic realm="Authentication required", charset="UTF-8"
03:58:21.603082 http.c:625              <= Recv header, 0000000042 bytes (0x0000002a)
03:58:21.603085 http.c:637              <= Recv header: etag: W/"1d-DMkJvg8tpLoaQbsiq9Mz7l2CJyI"
03:58:21.603089 http.c:625              <= Recv header, 0000000064 bytes (0x00000040)
03:58:21.603093 http.c:637              <= Recv header: strict-transport-security: max-age=31536000; includeSubDomains
03:58:21.603100 http.c:625              <= Recv header, 0000000002 bytes (0x00000002)
03:58:21.603104 http.c:637              <= Recv header:
03:58:21.603107 http.c:678              == Info: Ignoring the response-body
03:58:21.603131 http.c:678              == Info: Connection #0 to host huggingface.co left intact
03:58:21.603152 http.c:678              == Info: Issue another request to this URL: 'https://user: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@huggingface.co/facebook/fasttext-en-vectors/info/refs?service=git-receive-pack'
03:58:21.603181 http.c:678              == Info: Found bundle for host: 0x6000032340c0 [can multiplex]
03:58:21.603199 http.c:678              == Info: Re-using existing connection #0 with host huggingface.co
03:58:21.603205 http.c:678              == Info: Connected to huggingface.co (3.222.20.188) port 443 (#0)
03:58:21.603219 http.c:678              == Info: Server auth using Basic with user 'user'
03:58:21.603233 http.c:678              == Info: h2h3 [:method: GET]
03:58:21.603237 http.c:678              == Info: h2h3 [:path: /facebook/fasttext-en-vectors/info/refs?service=git-receive-pack]
03:58:21.603241 http.c:678              == Info: h2h3 [:scheme: https]
03:58:21.603244 http.c:678              == Info: h2h3 [:authority: huggingface.co]
03:58:21.603247 http.c:678              == Info: h2h3 [authorization: Basic dXNlcjpoZl9vbHJlcnZVVHVjZGlKdG5scW5BYk9Gc2FHRVBJS0ZhcWJS]
03:58:21.612663 http.c:678              == Info: h2h3 [user-agent: git/2.37.1 (Apple Git-137.1)]
03:58:21.612685 http.c:678              == Info: h2h3 [accept: */*]
03:58:21.612693 http.c:678              == Info: h2h3 [accept-encoding: deflate, gzip]
03:58:21.612700 http.c:678              == Info: h2h3 [pragma: no-cache]
03:58:21.612717 http.c:678              == Info: Using Stream ID: 3 (easy handle 0x14c808200)
03:58:21.612933 http.c:625              => Send header, 0000000285 bytes (0x0000011d)
03:58:21.612948 http.c:637              => Send header: GET /facebook/fasttext-en-vectors/info/refs?service=git-receive-pack HTTP/2
03:58:21.612956 http.c:637              => Send header: Host: huggingface.co
03:58:21.612962 http.c:637              => Send header: authorization: Basic <redacted>
03:58:21.612968 http.c:637              => Send header: user-agent: git/2.37.1 (Apple Git-137.1)
03:58:21.612973 http.c:637              => Send header: accept: */*
03:58:21.621806 http.c:637              => Send header: accept-encoding: deflate, gzip
03:58:21.621832 http.c:637              => Send header: pragma: no-cache
03:58:21.621839 http.c:637              => Send header:
03:58:21.703566 http.c:625              <= Recv header, 0000000013 bytes (0x0000000d)
03:58:21.703603 http.c:637              <= Recv header: HTTP/2 200
03:58:21.703613 http.c:625              <= Recv header, 0000000037 bytes (0x00000025)
03:58:21.703621 http.c:637              <= Recv header: date: Thu, 16 Mar 2023 10:58:21 GMT
03:58:21.703631 http.c:625              <= Recv header, 0000000060 bytes (0x0000003c)
03:58:21.703639 http.c:637              <= Recv header: content-type: application/x-git-receive-pack-advertisement
03:58:21.703648 http.c:625              <= Recv header, 0000000015 bytes (0x0000000f)
03:58:21.703654 http.c:637              <= Recv header: server: nginx
03:58:21.703662 http.c:625              <= Recv header, 0000000032 bytes (0x00000020)
03:58:21.703671 http.c:637              <= Recv header: x-powered-by: huggingface-moon
03:58:21.703679 http.c:625              <= Recv header, 0000000056 bytes (0x00000038)
03:58:21.703685 http.c:637              <= Recv header: x-request-id: Root=1-6412f64d-676dd9023cc185aa656a6c8f
03:58:21.703693 http.c:625              <= Recv header, 0000000053 bytes (0x00000035)
03:58:21.703700 http.c:637              <= Recv header: access-control-allow-origin: https://huggingface.co
03:58:21.703708 http.c:625              <= Recv header, 0000000014 bytes (0x0000000e)
03:58:21.703717 http.c:637              <= Recv header: vary: Origin
03:58:21.703725 http.c:625              <= Recv header, 0000000098 bytes (0x00000062)
03:58:21.703732 http.c:637              <= Recv header: access-control-expose-headers: X-Repo-Commit,X-Request-Id,X-Error-Code,X-Error-Message,ETag,Link
03:58:21.703747 http.c:625              <= Recv header, 0000000064 bytes (0x00000040)
03:58:21.703756 http.c:637              <= Recv header: strict-transport-security: max-age=31536000; includeSubDomains
03:58:21.703765 http.c:625              <= Recv header, 0000000002 bytes (0x00000002)
03:58:21.703773 http.c:637              <= Recv header:
03:58:21.703851 http.c:678              == Info: Connection #0 to host huggingface.co left intact
03:58:21.703925 run-command.c:654       trace: run_command: 'git credential-osxkeychain store'
03:58:21.725459 exec-cmd.c:139          trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git
03:58:21.726333 exec-cmd.c:238          trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core
03:58:21.726905 git.c:749               trace: exec: git-credential-osxkeychain store
03:58:21.726924 run-command.c:654       trace: run_command: git-credential-osxkeychain store
03:58:21.773929 run-command.c:654       trace: run_command: 'git credential-store store'
03:58:21.780256 exec-cmd.c:139          trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git
03:58:21.780835 exec-cmd.c:238          trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core
03:58:21.781008 git.c:460               trace: built-in: git credential-store store
03:58:21.781838 run-command.c:654       trace: run_command: 'git credential-store store'
03:58:21.787157 exec-cmd.c:139          trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git
03:58:21.787496 exec-cmd.c:238          trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core
03:58:21.787664 git.c:460               trace: built-in: git credential-store store
03:58:21.788651 run-command.c:654       trace: run_command: .git/hooks/pre-push origin https://user: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@huggingface.co/facebook/fasttext-en-vectors
03:58:21.794566 exec-cmd.c:139          trace: resolved executable path from Darwin stack: /Library/Developer/CommandLineTools/usr/libexec/git-core/git
03:58:21.794940 exec-cmd.c:238          trace: resolved executable dir: /Library/Developer/CommandLineTools/usr/libexec/git-core
03:58:21.795206 git.c:749               trace: exec: git-lfs pre-push origin https://user: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@huggingface.co/facebook/fasttext-en-vectors
03:58:21.795216 run-command.c:654       trace: run_command: git-lfs pre-push origin https://user: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@huggingface.co/facebook/fasttext-en-vectors
03:58:21.823765 trace git-lfs: exec: git 'version'
03:58:21.827936 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'remote' '-v'
03:58:21.831685 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'remote'
03:58:21.834987 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'rev-parse' 'HEAD' '--symbolic-full-name' 'HEAD'
03:58:21.838341 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'rev-parse' '--git-dir' '--show-toplevel'
03:58:21.841819 trace git-lfs: exec: git 'config' '--includes' '-l'
03:58:21.845262 trace git-lfs: exec: git 'rev-parse' '--is-bare-repository'
03:58:21.848186 trace git-lfs: exec: git 'config' '--includes' '-l' '--blob' ':.lfsconfig'
03:58:21.851543 trace git-lfs: exec: git 'config' '--includes' '-l' '--blob' 'HEAD:.lfsconfig'
03:58:21.854992 trace git-lfs: pre-push: refs/heads/main c25409c4988154a665b322b78291e9dec24d5a73 refs/heads/main 83fad05641881e55ad6fc17bf960094805e6cb7c
03:58:21.855078 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'show-ref'
03:58:21.858233 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'ls-remote' '--heads' '--tags' '-q' 'origin'
03:58:22.372189 trace git-lfs: tq: running as batched queue, batch size of 100
03:58:22.372550 trace git-lfs: run_command: git rev-list --objects --ignore-missing --stdin --
03:58:22.372572 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'rev-list' '--objects' '--ignore-missing' '--stdin' '--'
03:58:22.374445 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'cat-file' '--batch-check'
03:58:22.376167 trace git-lfs: exec: git '-c' 'filter.lfs.smudge=' '-c' 'filter.lfs.clean=' '-c' 'filter.lfs.process=' '-c' 'filter.lfs.required=false' 'rev-parse' '--git-common-dir'
03:58:22.381775 trace git-lfs: tq: sending batch of size 1
03:58:22.382380 trace git-lfs: api: batch 1 files
03:58:22.382848 trace git-lfs: exec: /usr/bin/security 'list-keychains'
03:58:22.396230 trace git-lfs: exec: /usr/bin/security 'find-certificate' '-a' '-p' '-c' 'huggingface.co' '/Library/Keychains/System.keychain'
03:58:22.407310 trace git-lfs: HTTP: POST https://user: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@huggingface.co/facebook/fasttext-en-vectors.git/info/lfs/objects/batch
> POST /facebook/fasttext-en-vectors.git/info/lfs/objects/batch HTTP/1.1
> Host: huggingface.co
> Accept: application/vnd.git-lfs+json
> Content-Length: 243
> Content-Type: application/vnd.git-lfs+json; charset=utf-8
> User-Agent: git-lfs/3.3.0 (GitHub; darwin arm64; go 1.19.3)
>
{"operation":"upload","objects":[{"oid":"14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","size":7237176312}],"transfers":["basic","ssh","lfs-standalone-file","multipart"],"ref":{"name":"refs/heads/main"},"hash_algo":"sha256"}03:58:23.040577 trace git-lfs: HTTP: 200

< HTTP/2.0 200 OK
< Content-Length: 2018
< Access-Control-Allow-Origin: https://huggingface.co
< Access-Control-Expose-Headers: X-Repo-Commit,X-Request-Id,X-Error-Code,X-Error-Message,ETag,Link
< Content-Type: application/vnd.git-lfs+json; charset=utf-8
< Date: Thu, 16 Mar 2023 10:58:23 GMT
< Etag: W/"7e2-yBwoo9IrnugjPNPCJc6JB8TjkFs"
< Server: nginx
< Strict-Transport-Security: max-age=31536000; includeSubDomains
< Vary: Origin
< X-Powered-By: huggingface-moon
< X-Request-Id: Root=1-6412f64e-69091994191f9f796a7c94a5
<
03:58:23.040715 trace git-lfs: HTTP: {"transfer":"multipart","objects":[{"oid":"14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","size":7237176312,"authenticated":true,"actions":{"upload":{"href":"https://huggingface.co/api/complete_multipart?uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&bucket=lfs.huggingface.co&prefix=repos%2Fd5%2F17%2Fd51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469&expiration=Fri%2C+17+Mar+2023+10%3A
{"transfer":"multipart","objects":[{"oid":"14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","size":7237176312,"authenticated":true,"actions":{"upload":{"href":"https://huggingface.co/api/complete_multipart?uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&bucket=lfs.huggingface.co&prefix=repos%2Fd5%2F17%2Fd51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469&expiration=Fri%2C+17+Mar+2023+10%3A03:58:23.044783 trace git-lfs: HTTP: 58%3A23+GMT&signature=bf152add14de54e75fad3fea79213f8b3f4e647d2529d8017d7fefa855962689","expires_in":86400,"header":{"chunk_size":"5000000000","00001":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230316T105823Z&X-Amz-Expires=86400&X-Amz-Signature=6649c24e822ac2f578138dd7d0aba5b4c13e4b8f7363b29bdd3ec303af61a17b&X-Amz-SignedHeaders=host&partNumber=1&uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&x-id=UploadPart","00002":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763
58%3A23+GMT&signature=bf152add14de54e75fad3fea79213f8b3f4e647d2529d8017d7fefa855962689","expires_in":86400,"header":{"chunk_size":"5000000000","00001":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230316T105823Z&X-Amz-Expires=86400&X-Amz-Signature=6649c24e822ac2f578138dd7d0aba5b4c13e4b8f7363b29bdd3ec303af61a17b&X-Amz-SignedHeaders=host&partNumber=1&uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&x-id=UploadPart","00002":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f676303:58:23.045627 trace git-lfs: HTTP: ca?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230316T105823Z&X-Amz-Expires=86400&X-Amz-Signature=4b50819766c9ae6984b56fe8521389f2aaf391b7a323a5058aba99f04c686140&X-Amz-SignedHeaders=host&partNumber=2&uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&x-id=UploadPart"}}}}]}
ca?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20230316T105823Z&X-Amz-Expires=86400&X-Amz-Signature=4b50819766c9ae6984b56fe8521389f2aaf391b7a323a5058aba99f04c686140&X-Amz-SignedHeaders=host&partNumber=2&uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr&x-id=UploadPart"}}}}]}03:58:23.045986 trace git-lfs: tq: starting transfer adapter "multipart"
03:58:23.046003 trace git-lfs: xfer: adapter "multipart" Begin() with 8 workers
03:58:23.046007 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 0
03:58:23.046378 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload'
03:58:23.050527 trace git-lfs: xfer: Custom adapter worker 0 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8}
03:58:23.472917 trace git-lfs: xfer: Custom adapter worker 0 received response: {}
03:58:23.472981 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 0 OK
03:58:23.472989 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 1
03:58:23.473038 trace git-lfs: xfer: adapter "multipart" worker 0 starting
03:58:23.473124 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload'
03:58:23.474231 trace git-lfs: xfer: Custom adapter worker 1 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8}
03:58:23.626588 trace git-lfs: xfer: Custom adapter worker 1 received response: {}
03:58:23.626616 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 1 OK
03:58:23.626629 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 2
03:58:23.626660 trace git-lfs: xfer: adapter "multipart" worker 1 starting
03:58:23.626677 trace git-lfs: xfer: adapter "multipart" worker 1 waiting for Auth
03:58:23.626751 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload'
03:58:23.627725 trace git-lfs: xfer: Custom adapter worker 2 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8}
03:58:23.794249 trace git-lfs: xfer: Custom adapter worker 2 received response: {}
03:58:23.794287 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 2 OK
03:58:23.794302 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 3
03:58:23.794316 trace git-lfs: xfer: adapter "multipart" worker 2 starting
03:58:23.794339 trace git-lfs: xfer: adapter "multipart" worker 2 waiting for Auth
03:58:23.794430 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload'
03:58:23.795423 trace git-lfs: xfer: Custom adapter worker 3 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8}
03:58:23.948498 trace git-lfs: xfer: Custom adapter worker 3 received response: {}
03:58:23.948527 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 3 OK
03:58:23.948543 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 4
03:58:23.948570 trace git-lfs: xfer: adapter "multipart" worker 3 starting
03:58:23.948592 trace git-lfs: xfer: adapter "multipart" worker 3 waiting for Auth
03:58:23.948680 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload'
03:58:23.949734 trace git-lfs: xfer: Custom adapter worker 4 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8}
03:58:24.121468 trace git-lfs: xfer: Custom adapter worker 4 received response: {}
03:58:24.121498 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 4 OK
03:58:24.121511 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 5
03:58:24.121539 trace git-lfs: xfer: adapter "multipart" worker 4 starting
03:58:24.121558 trace git-lfs: xfer: adapter "multipart" worker 4 waiting for Auth
03:58:24.121644 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload'
03:58:24.122593 trace git-lfs: xfer: Custom adapter worker 5 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8}
03:58:24.280177 trace git-lfs: xfer: Custom adapter worker 5 received response: {}
03:58:24.280206 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 5 OK
03:58:24.280226 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 6
03:58:24.280236 trace git-lfs: xfer: adapter "multipart" worker 5 starting
03:58:24.280255 trace git-lfs: xfer: adapter "multipart" worker 5 waiting for Auth
03:58:24.280380 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload'
03:58:24.281348 trace git-lfs: xfer: Custom adapter worker 6 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8}
03:58:24.448202 trace git-lfs: xfer: Custom adapter worker 6 received response: {}
03:58:24.448229 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 6 OK
03:58:24.448238 trace git-lfs: xfer: starting up custom transfer process "multipart" for worker 7
03:58:24.448264 trace git-lfs: xfer: adapter "multipart" worker 6 starting
03:58:24.448287 trace git-lfs: xfer: adapter "multipart" worker 6 waiting for Auth
03:58:24.448370 trace git-lfs: exec: sh '-c' 'huggingface-cli lfs-multipart-upload'
03:58:24.449395 trace git-lfs: xfer: Custom adapter worker 7 sending message: {"event":"init","operation":"upload","remote":"origin","concurrent":true,"concurrenttransfers":8}
03:58:24.621761 trace git-lfs: xfer: Custom adapter worker 7 received response: {}
03:58:24.621789 trace git-lfs: xfer: started custom adapter process "huggingface-cli" for worker 7 OK
03:58:24.621799 trace git-lfs: xfer: adapter "multipart" started
03:58:24.621849 trace git-lfs: xfer: adapter "multipart" worker 0 processing job for "14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca"
03:58:24.621834 trace git-lfs: xfer: adapter "multipart" worker 7 starting
03:58:24.621864 trace git-lfs: xfer: adapter "multipart" worker 7 waiting for Auth
03:58:24.621943 trace git-lfs: xfer: Custom adapter worker 0 sending message: {"event":"upload","oid":"14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","size":7237176312,"path":"/Users/sheonhan/fun/hugging-face/facebook/fasttext-en-vectors/.git/lfs/objects/14/c7/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca","action":{"href":"https://huggingface.co/api/complete_multipart?uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr\u0026bucket=lfs.huggingface.co\u0026prefix=repos%2Fd5%2F17%2Fd51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469\u0026expiration=Fri%2C+17+Mar+2023+10%3A58%3A23+GMT\u0026signature=bf152add14de54e75fad3fea79213f8b3f4e647d2529d8017d7fefa855962689","header":{"00001":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca?X-Amz-Algorithm=AWS4-HMAC-SHA256\u0026X-Amz-Content-Sha256=UNSIGNED-PAYLOAD\u0026X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request\u0026X-Amz-Date=20230316T105823Z\u0026X-Amz-Expires=86400\u0026X-Amz-Signature=6649c24e822ac2f578138dd7d0aba5b4c13e4b8f7363b29bdd3ec303af61a17b\u0026X-Amz-SignedHeaders=host\u0026partNumber=1\u0026uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr\u0026x-id=UploadPart","00002":"https://s3.us-east-1.amazonaws.com/lfs.huggingface.co/repos/d5/17/d51783e8db2539ebd639d94860a1c0c525027924d32e3d13b6b4595c4e639469/14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca?X-Amz-Algorithm=AWS4-HMAC-SHA256\u0026X-Amz-Content-Sha256=UNSIGNED-PAYLOAD\u0026X-Amz-Credential=AKIA4N7VTDGO27GPWFUO%2F20230316%2Fus-east-1%2Fs3%2Faws4_request\u0026X-Amz-Date=20230316T105823Z\u0026X-Amz-Expires=86400\u0026X-Amz-Signature=4b50819766c9ae6984b56fe8521389f2aaf391b7a323a5058aba99f04c686140\u0026X-Amz-SignedHeaders=host\u0026partNumber=2\u0026uploadId=2VzxOsP_dB27cM9gg_oVLZvF_II7Th8ANDF4lSPW9HgPa1Q4lF_1sf4dSSYxNTPRAUsSu74rG_1ReSLeBrEtxlcC1uoZjLRXSlbwvtvBROJTeW4YO5yZLTkQ38HeNhxr\u0026x-id=UploadPart","chunk_size":"5000000000"},"expires_at":"0001-01-01T00:00:00Z","expires_in":86400}}
03:58:24.622151 trace git-lfs: xfer: Custom adapter worker 0 received response: {"event": "progress", "oid": "14c7167b130056944cbdc37b7451f055867fe9a4e3fed3bbc1ecc0e74f6763ca", "bytesSoFar": 1, "bytesSinceLast": 0}
03:58:24.622192 trace git-lfs: xfer: adapter "multipart" worker 7 auth signal received
03:58:24.622199 trace git-lfs: xfer: adapter "multipart" worker 1 auth signal received
03:58:24.622201 trace git-lfs: xfer: adapter "multipart" worker 2 auth signal received
03:58:24.622203 trace git-lfs: xfer: adapter "multipart" worker 3 auth signal received
03:58:24.622204 trace git-lfs: xfer: adapter "multipart" worker 4 auth signal received
03:58:24.622209 trace git-lfs: xfer: adapter "multipart" worker 5 auth signal received
03:58:24.622233 trace git-lfs: xfer: adapter "multipart" worker 6 auth signal received
Wauplin commented 1 year ago

Most likely related to instabilities on the server at that moment. No way to reproduce anyway so let's close.