s3fs-fuse / s3fs-fuse

FUSE-based file system backed by Amazon S3
GNU General Public License v2.0
8.63k stars 1.02k forks source link

new inability to mount wasabi bucket #1539

Open jeffreydlong opened 3 years ago

jeffreydlong commented 3 years ago

Additional Information

The following information is very important in order to help us to help you. Omission of the following details may delay your support request or receive no attention at all. Keep in mind that the commands we provide to retrieve information are oriented to GNU/Linux Distributions, so you could need to use others if you use s3fs on macOS or BSD

Version of s3fs being used (s3fs --version)

example: 1.00

[bbuser@itprdbbap18 bin]$ s3fs --version Amazon Simple Storage Service File System V1.88 (commit:unknown) with OpenSSL Copyright (C) 2010 Randy Rizun rrizun@gmail.com License GPL2: GNU GPL version 2 https://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. [bbuser@itprdbbap18 bin]$

Version of fuse being used (pkg-config --modversion fuse, rpm -qi fuse, dpkg -s fuse)

example: 2.9.4

Kernel information (uname -r)

command result: uname -r

3.10.0-1160.6.1.el7.x86_64

GNU/Linux Distribution, if applicable (cat /etc/os-release)

command result: cat /etc/os-release

Red Hat Enterprise Linux Server release 7.9 (Maipo)

s3fs command line used, if applicable

s3fs blackboardarch /mnt/wasabi/ -o passwd_file=/home/bbuser/.pwd-s3fs.old -o url=https://s3.us-east-2.wasabisys.com -o ensure_diskfree=2000 -d -o curldbg -o retries=999

#### /etc/fstab entry, if applicable
#### s3fs syslog messages (grep s3fs /var/log/syslog, journalctl | grep s3fs, or s3fs outputs)
_if you execute s3fs with dbglevel, curldbg option, you can get detail debug messages_

Jan 28 12:01:30 itprdbbap18 s3fs[32683]: s3fs_logger.cpp:LowSetLogLevel(201): change debug level from [CRT] to [INF]
Jan 28 12:01:30 itprdbbap18 s3fs[32683]:    PROC(uid=5002, gid=5002) - MountPoint(uid=5002, gid=5002, mode=40755)
Jan 28 12:01:30 itprdbbap18 s3fs[32683]: Loaded mime information from /etc/mime.types
Jan 28 12:01:30 itprdbbap18 s3fs[32683]: The path to cache top dir is empty, thus not need to check permission.
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: init v1.88(commit:unknown) with OpenSSL
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: check services.
Jan 28 12:01:30 itprdbbap18 s3fs[32686]:      check a bucket.
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: curl.cpp:ResetHandle(1896): The CURLOPT_SSL_ENABLE_ALPN option could not be unset. S3 server does not support ALPN, then this option should be disabled to maximize performance. you need to use libcurl 7.36.0 or later.
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: curl.cpp:ResetHandle(1899): The S3FS_CURLOPT_KEEP_SENDING_ON_ERROR option could not be set. For maximize performance you need to enable this option and you should use libcurl 7.51.0 or later.
Jan 28 12:01:30 itprdbbap18 s3fs[32686]:      URL is https://s3.us-east-2.wasabisys.com/blackboardarch/
Jan 28 12:01:30 itprdbbap18 s3fs[32686]:      URL changed is https://blackboardarch.s3.us-east-2.wasabisys.com/
Jan 28 12:01:30 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:01:30 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#0)
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.22...
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.22) port 443 (#0)
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: * Initializing NSS with certpath: sql:/etc/pki/nssdb
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/20210128/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180130Z
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: >
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:01:30 GMT
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head1)
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: < x-amz-id-2: o9+H4dyih4mJ8s9bRpPk4Cb3n2IwLvlk8xs+E1gYmzFfNkdwTlHzKHOzWjB1T8xxcy/91LzsoIcw
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: < x-amz-request-id: 79526F1C137F535E
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:01:30 itprdbbap18 s3fs[32686]: <
Jan 28 12:01:43 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:01:43 itprdbbap18 s3fs[32686]: * Closing connection 0
Jan 28 12:01:43 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:01:47 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:01:47 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:01:47 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#1)
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.22...
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.22) port 443 (#1)
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180147Z
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: >
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:01:47 GMT
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head1)
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: < x-amz-id-2: lQ5v26NAIKJfSwqNs/CWD+/aBkiIu3WO6S7rj0Yd+hhwTUHXPaJ3dwtIVgBBQuXTEv4v+FrGhY1l
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: < x-amz-request-id: 12BAFA502A455360
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:01:47 itprdbbap18 s3fs[32686]: <
Jan 28 12:02:00 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:02:00 itprdbbap18 s3fs[32686]: * Closing connection 1
Jan 28 12:02:00 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:02:04 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:02:04 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:02:04 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:02:04 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:02:04 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#2)
Jan 28 12:02:04 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.22...
Jan 28 12:02:04 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.22) port 443 (#2)
Jan 28 12:02:04 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/20210128/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180204Z
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: >
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:02:05 GMT
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head6)
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: < x-amz-id-2: 0BrE1ItdwoOkR7SeAo2V/BW4uYgLVDdkSpX8gCny15qrdywSzul9Bofusqs65rfv5/C8AuYGe950
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: < x-amz-request-id: 1B7C0F6214D20D94
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:02:05 itprdbbap18 s3fs[32686]: <
Jan 28 12:02:19 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:02:19 itprdbbap18 s3fs[32686]: * Closing connection 2
Jan 28 12:02:19 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:02:23 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:02:23 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:02:23 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#3)
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.22...
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.22) port 443 (#3)
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/20210128/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180223Z
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: >
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:02:23 GMT
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head1)
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: < x-amz-id-2: /fzR/RBxGxGoyefhNrcHbrZoUnwiVVpzWdunr01g7x02neS0Ou2hRlNxbCQW2ZDBC2NYLoegxgxM
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: < x-amz-request-id: 9582360EF403585E
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:02:23 itprdbbap18 s3fs[32686]: <
Jan 28 12:02:36 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:02:36 itprdbbap18 s3fs[32686]: * Closing connection 3
Jan 28 12:02:36 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:02:40 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:02:40 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:02:40 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#4)
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.20...
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.20) port 443 (#4)
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/20210128/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180240Z
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: >
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:02:40 GMT
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head4)
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: < x-amz-id-2: 8KnSXrJTypMmJngtqbIqPqqf53VRXC1jiMEq3IfrkGrgsffbYxoYy+F9bJDvnrzfbjK8rtXQ+DvG
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: < x-amz-request-id: DBCD4EAF519C48E4
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:02:40 itprdbbap18 s3fs[32686]: <
Jan 28 12:02:54 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:02:54 itprdbbap18 s3fs[32686]: * Closing connection 4
Jan 28 12:02:54 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:02:58 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:02:58 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:02:58 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#5)
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.20...
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.20) port 443 (#5)
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/20210128/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180258Z
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: >
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:02:58 GMT
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head1)
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: < x-amz-id-2: SPiPyPiSyN0MgKbqrmiVnsx41JRGTNkYDEcYqJwnLlenIaRDnwkDGmRZlTq16pGh1FeIK1FsqXuV
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: < x-amz-request-id: 6CF8B6C56E259A70
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:02:58 itprdbbap18 s3fs[32686]: <
Jan 28 12:03:11 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:03:11 itprdbbap18 s3fs[32686]: * Closing connection 5
Jan 28 12:03:11 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:03:15 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:03:15 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:03:15 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#6)
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.20...
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.20) port 443 (#6)
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180315Z
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: >
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:03:15 GMT
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head4)
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: < x-amz-id-2: yJq5gLBRDxNkZZ2oSuo8ybxNxYuAdCwWwtmEv094leSNEToTwwTgkzw/DEVy2S/1z2PQrBqrf7Ts
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: < x-amz-request-id: 24F8618118D5AEF3
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:03:15 itprdbbap18 s3fs[32686]: <
Jan 28 12:03:29 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:03:29 itprdbbap18 s3fs[32686]: * Closing connection 6
Jan 28 12:03:29 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:03:29 itprdbbap18 su: (to root) long on pts/1
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:03:33 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:03:33 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:03:33 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#7)
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.20...
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.20) port 443 (#7)
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180333Z
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: >
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:03:33 GMT
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head2)
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: < x-amz-id-2: A1QAF8YXcaCnBqdo77STSeqbzv/1wernnuX3nQqaEwk/l0aEoSQQmJv0oAIOFXYnDCWRfhIR/idc
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: < x-amz-request-id: 185F4AC48273702A
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:03:33 itprdbbap18 s3fs[32686]: <
Jan 28 12:03:46 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:03:46 itprdbbap18 s3fs[32686]: * Closing connection 7
Jan 28 12:03:46 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:03:50 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:03:50 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:03:50 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#8)
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.20...
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.20) port 443 (#8)
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/20210128/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180350Z
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: >
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:03:50 GMT
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head5)
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: < x-amz-id-2: es+QeROSuSgGfV2jGDAj4mFJGZg3U7DCFMeOS9/IqWtrnkuuJKo2kWAxRCaQsJJREdLwvNlsFamZ
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: < x-amz-request-id: B73B40FC1ABF2AFA
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:03:50 itprdbbap18 s3fs[32686]: <
Jan 28 12:04:03 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:04:03 itprdbbap18 s3fs[32686]: * Closing connection 8
Jan 28 12:04:03 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:04:07 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:04:07 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:04:07 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#9)
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.20...
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.20) port 443 (#9)
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/20210128/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180407Z
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: >
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:04:07 GMT
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head5)
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: < x-amz-id-2: 8N90Z2ZG10R+QK7EhXtq0V6nee3XqvLGWUFkzqgvhMIoBRWxBjA5h+RM/x76/nlt58ILnzV/T6BL
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: < x-amz-request-id: ABC0CA52B730987C
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:04:07 itprdbbap18 s3fs[32686]: <
Jan 28 12:04:20 itprdbbap18 s3fs[32686]: * transfer closed with outstanding read data remaining
Jan 28 12:04:20 itprdbbap18 s3fs[32686]: * Closing connection 9
Jan 28 12:04:20 itprdbbap18 s3fs[32686]: curl.cpp:RequestPerform(2357): ### CURLE_PARTIAL_FILE
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: ### retrying...
Jan 28 12:04:24 itprdbbap18 s3fs[32686]:      Retry request. [type=5][url=https://blackboardarch.s3.us-east-2.wasabisys.com/][path=/]
Jan 28 12:04:24 itprdbbap18 s3fs[32686]:      computing signature [GET] [/] [] []
Jan 28 12:04:24 itprdbbap18 s3fs[32686]:      url is https://s3.us-east-2.wasabisys.com
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: * About to connect() to blackboardarch.s3.us-east-2.wasabisys.com port 443 (#10)
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: *   Trying 38.73.225.20...
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: * Connected to blackboardarch.s3.us-east-2.wasabisys.com (38.73.225.20) port 443 (#10)
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: *   CAfile: /etc/pki/tls/certs/ca-bundle.crt#012  CApath: none
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: * SSL connection using TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: * Server certificate:
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: *     subject: CN=*.s3.us-east-2.wasabisys.com,OU=EssentialSSL Wildcard,OU=Domain Control Validated
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: *     start date: Sep 13 00:00:00 2019 GMT
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: *     expire date: Sep 12 23:59:59 2021 GMT
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: *     common name: *.s3.us-east-2.wasabisys.com
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: *     issuer: CN=Sectigo RSA Domain Validation Secure Server CA,O=Sectigo Limited,L=Salford,ST=Greater Manchester,C=GB
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: > GET / HTTP/1.1
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: > User-Agent: s3fs/1.88 (commit hash unknown; OpenSSL)
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: > Accept: */*
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: > Authorization: AWS4-HMAC-SHA256 Credential=XXX/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=XXX
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: > host: blackboardarch.s3.us-east-2.wasabisys.com
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: > x-amz-content-sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: > x-amz-date: 20210128T180424Z
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: >
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: < HTTP/1.1 200 OK
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: < Content-Type: application/xml
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: < Date: Thu, 28 Jan 2021 18:04:24 GMT
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: < Server: WasabiS3/6.2.4304-2021-01-27-fdb95dc (head5)
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: < x-amz-bucket-region: us-east-2
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: < x-amz-id-2: +bY+K7K9UlDVvbwS9a0fs2QQDddIxKiFO8qMOkSTPoZzFNd/MLysiXpLke0VX5tspJwp5QQ063T2
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: < x-amz-request-id: CD0A43245CF3EA33
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: < Transfer-Encoding: chunked
Jan 28 12:04:24 itprdbbap18 s3fs[32686]: <
[root@itprdbbap18 log]# 

Details about issue

This mount was working fine for roughly the past year and then suddenly stopped working within the last month or so. Eventually it just gives up (apparently in this version after 999 retries, previously it stopped after a handful)

jeffreydlong commented 3 years ago

fuse version:

fuse-2.9.2-11.el7.x86_64

yevon commented 2 years ago

Same issue here, trying to debug the issue I'm getting that it tries to connect to [bucket-name]-dev.s3.wasabisys.com which doesn't seem to be correct. Credentials and policy are correct.

gaul commented 2 years ago

I successfully connected to Wasabi via:

s3fs BUCKET PATH -o profile=PROFILE -o url=https://s3.us-west-1.wasabisys.com

Curiously setting the URL to the correct region was required and the redirect was not followed. I am not sure if this is an s3fs or a Wasabi problem since I believe that this used to work.

yevon commented 2 years ago

I already did it, and just in case I changed the region to s3.eu-west-1.wasabisys.com but not working either. Do I need any special policy for s3fs? I have this:

{ "Version": "2012-10-17", "Statement": [ { "Sid": "[BUCKET_NAME]", "Effect": "Allow", "Action": [ "s3:PutObject", "s3:GetObject", "s3:ListBucket", "s3:DeleteObject" ], "Resource": [ "arn:aws:s3:::[BUCKET_NAME]", "arn:aws:s3:::[BUCKET_NAME]/*" ] } ] }

yevon commented 2 years ago

Errors received:

Connection #1 to host [BUCKET_NAME].s3.wasabisys.com left intact HTTP response code 403, returning EPERM Check bucket failed, S3 response: <?xml version="1.0" encoding="UTF-8"?> s3fs.cpp:s3fs_check_service(3502): Failed to connect by sigv4, so retry to connect by signature version 2. invalid credentials(host=https://s3.eu-west-1.wasabisys.com)

Is it normal that it tries to contact to [BUCKET_NAME].s3.wasabisys.com even when I specify explicitly the host?

s3fs [BUCKET_NAME] [MOUNT_PATH] -o passwd_file=[MOUNT_PATH] -o url=https://s3.eu-west-1.wasabisys.com -o dbglevel=info -f -o curldbg

yevon commented 2 years ago

I successfully connected to Wasabi via:

s3fs BUCKET PATH -o profile=PROFILE -o url=https://s3.us-west-1.wasabisys.com

Curiously setting the URL to the correct region was required and the redirect was not followed. I am not sure if this is an s3fs or a Wasabi problem since I believe that this used to work.

What should I set in the profile? I didn't set this parameter.