Closed skyzh closed 3 years ago
看起来是开启 gzip 导致的问题,需要学校 s3 关闭 gzip 压缩。
curl -v https://s3.jcloud.sjtu.edu.cn/899a892efef34b1b944a19981040f55b-oss01/anaconda/cloud/bioconda/linux-64/2pg_cartesian-1.0.1-0.tar.bz2 -H 'Accept-Encoding: gzip, deflate'
> GET /899a892efef34b1b944a19981040f55b-oss01/anaconda/cloud/bioconda/linux-64/2pg_cartesian-1.0.1-0.tar.bz2 HTTP/1.1 > Host: s3.jcloud.sjtu.edu.cn > User-Agent: curl/7.76.1 > Accept: */* > Accept-Encoding: gzip, deflate > * Mark bundle as not supporting multiuse < HTTP/1.1 200 OK < Server: openresty/1.13.6.1 < Date: Fri, 23 Apr 2021 02:57:58 GMT < Content-Type: application/octet-stream < Transfer-Encoding: chunked < Connection: keep-alive < Last-Modified: Fri, 05 Mar 2021 15:47:47 GMT < ETag: W/"ff57096ecae1a6e9635197a0a2a7ef45" < x-amz-meta-clone-backend: s3-v1 < x-amz-meta-clone-checksum: 4af3c111a042368a757a0cf7882d080ec890c4f2eb9500fa7b170ca4ad8fd900 < x-amz-meta-clone-checksum-method: sha256 < x-amz-meta-clone-last-modified: 1521047469 < x-amz-request-id: tx0000000000000058b2e37-00608237b6-41d8da9-zone-00864d < Access-Control-Allow-Origin: * < Access-Control-Allow-Methods: POST, GET, OPTIONS, DELETE, PUT, PATCH < Access-Control-Allow-Headers: content-type,x-amz-server-side-encryption,range,x-amz-user-agent,x-amz-copy-source,x-amz-content-sha256,x-amz-date,authorization,x-amz-acl,etag,content-encoding,x-requested-with < Content-Encoding: gzip < Warning: Binary output can mess up your terminal. Use "--output -" to tell Warning: curl to output it to your terminal anyway, or consider "--output Warning: <FILE>" to save to a file. * Failure writing output to destination * Failed reading the chunked-encoded stream * Closing connection 0 * TLSv1.2 (OUT), TLS alert, close notify (256):
curl -v https://s3.jcloud.sjtu.edu.cn/899a892efef34b1b944a19981040f55b-oss01/anaconda/cloud/bioconda/linux-64/2pg_cartesian-1.0.1-0.tar.bz2
> GET /899a892efef34b1b944a19981040f55b-oss01/anaconda/cloud/bioconda/linux-64/2pg_cartesian-1.0.1-0.tar.bz2 HTTP/1.1 > Host: s3.jcloud.sjtu.edu.cn > User-Agent: curl/7.76.1 > Accept: */* > * Mark bundle as not supporting multiuse < HTTP/1.1 200 OK < Server: openresty/1.13.6.1 < Date: Fri, 23 Apr 2021 02:58:25 GMT < Content-Type: application/octet-stream < Content-Length: 3000055 < Connection: keep-alive < Accept-Ranges: bytes < Last-Modified: Fri, 05 Mar 2021 15:47:47 GMT < ETag: "ff57096ecae1a6e9635197a0a2a7ef45" < x-amz-meta-clone-backend: s3-v1 < x-amz-meta-clone-checksum: 4af3c111a042368a757a0cf7882d080ec890c4f2eb9500fa7b170ca4ad8fd900 < x-amz-meta-clone-checksum-method: sha256 < x-amz-meta-clone-last-modified: 1521047469 < x-amz-request-id: tx0000000000000058aceb2-00608237d1-41d9925-zone-00864d < Access-Control-Allow-Origin: * < Access-Control-Allow-Methods: POST, GET, OPTIONS, DELETE, PUT, PATCH < Access-Control-Allow-Headers: content-type,x-amz-server-side-encryption,range,x-amz-user-agent,x-amz-copy-source,x-amz-content-sha256,x-amz-date,authorization,x-amz-acl,etag,content-encoding,x-requested-with < Warning: Binary output can mess up your terminal. Use "--output -" to tell Warning: curl to output it to your terminal anyway, or consider "--output Warning: <FILE>" to save to a file. * Failure writing output to destination * Closing connection 0 * TLSv1.2 (OUT), TLS alert, close notify (256):
在 s3 测设置 Content-Type 即可解决。最近将会更新 metadata。
Fixed in https://github.com/sjtug/mirror-clone/pull/82
之后将增量全部重传,以更新所有文件的 metadata。
看起来是开启 gzip 导致的问题,需要学校 s3 关闭 gzip 压缩。