search

owncloud / ocis-charts

:chart_with_upwards_trend: Helm Charts for ownCloud's OCIS
https://owncloud.dev/ocis/deployment/kubernetes/
Apache License 2.0
46 stars 27 forks source link

chunked upload fails on with oCIS 6 #643

Closed wkloucek closed 1 month ago

wkloucek commented 2 months ago

I couldn't manage to upload larger files because they all end up with 502 Bad Gateway on the PATCH request that follows the first POST request when using chunked upload with TUS

cc @case0sh @dschmidt

d7oc commented 2 months ago

Just for curiosity: What are larger files? 500MB, 1GB?

wkloucek commented 2 months ago

Just for curiosity: What are larger files?

In this case it was 56,3 MiB. Actually I can't recap the actual size where Web switches from single POST upload to chunked TUS upload.

d7oc commented 2 months ago

@micbar Is that some information you or your team can provide?

micbar commented 2 months ago

The default is documented in the docs.

I think it is 10MB

wkloucek commented 2 months ago

I think it is 10MB

Yes it is.

Funnily this is no problem on https://ocis.ocis.rolling.owncloud.works:

image

image

In Minikube, I get:

web-d695bd9c5-8cnzs web {"level":"debug","service":"web","request-id":"6fad360bf1a0bc3aeaa7c93e871b15fc","proto":"HTTP/1.1","method":"GET","status":200,"path":"/icons/close-fill.svg","duration":0.303973,"bytes":307,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"6fad360bf1a0bc3aeaa7c93e871b15fc","traceid":"45d94ada8d179d761cbc6706a29b77dc","remote-addr":"192.168.49.1","method":"GET","status":200,"path":"/icons/close-fill.svg","duration":1.988773,"bytes":212,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"HEAD","prefix":"/data","path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","routeType":"prefix","time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
frontend-76488f8c76-2hxq5 frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"4c48868a45d46d88d85b9da0f3f9eefe","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"4c48868a45d46d88d85b9da0f3f9eefe","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1 svc=data"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"4c48868a45d46d88d85b9da0f3f9eefe","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/dataprovider/dataprovider.go:179","message":"dataprovider routing: path=/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"4c48868a45d46d88d85b9da0f3f9eefe","host":"10.244.6.246","method":"HEAD","uri":"/data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1","url":"/44ca9c34-15d4-4dc1-b755-d9498685eaf1","proto":"HTTP/1.1","status":200,"size":0,"start":"23/Jul/2024:14:48:56 +0000","end":"23/Jul/2024:14:48:56 +0000","time_ns":1080119,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/log/log.go:112","message":"http"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","traceid":"34375759c6b4c13ac77a3d55b3f28bd4","remote-addr":"192.168.49.1","method":"HEAD","status":200,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","duration":7.103947,"bytes":0,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc svc=data"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","target":"http://storageusers:9158/data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/datagateway/datagateway.go:187","message":"sending request to internal data server"}
frontend-76488f8c76-2hxq5 frontend {"level":"error","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","content-length":58994227,"transferred-bytes":0,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/datagateway/datagateway.go:226","message":"content length vs transferred bytes mismatch"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"4317436cf9a000c7be826abe63836b50","host":"10.244.6.224","method":"HEAD","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","proto":"HTTP/1.1","status":200,"size":0,"start":"23/Jul/2024:14:48:56 +0000","end":"23/Jul/2024:14:48:56 +0000","time_ns":5523695,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/log/log.go:112","message":"http"}
web-d695bd9c5-8cnzs web {"level":"debug","service":"web","request-id":"34e4f193a8dea5d9eb67fbb379e26fe1","proto":"HTTP/1.1","method":"GET","status":200,"path":"/icons/pause-circle-line.svg","duration":0.257686,"bytes":356,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"34e4f193a8dea5d9eb67fbb379e26fe1","traceid":"59d052c53f5d2167a3799d19fed33c5b","remote-addr":"192.168.49.1","method":"GET","status":200,"path":"/icons/pause-circle-line.svg","duration":1.802401,"bytes":231,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
web-d695bd9c5-8cnzs web {"level":"debug","service":"web","request-id":"b3a1a9a3705e247a53f76b5a571c1123","proto":"HTTP/1.1","method":"GET","status":200,"path":"/icons/close-circle-line.svg","duration":0.252196,"bytes":508,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"b3a1a9a3705e247a53f76b5a571c1123","traceid":"d53a2a1e3059372322ad4e139806f66f","remote-addr":"192.168.49.1","method":"GET","status":200,"path":"/icons/close-circle-line.svg","duration":2.440716,"bytes":271,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"PATCH","prefix":"/data","path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","routeType":"prefix","time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
frontend-76488f8c76-2hxq5 frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"dfc09b54d8341344d9fb3b0bc8c53015","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"dfc09b54d8341344d9fb3b0bc8c53015","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc svc=data"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"dfc09b54d8341344d9fb3b0bc8c53015","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","target":"http://storageusers:9158/data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/datagateway/datagateway.go:187","message":"sending request to internal data server"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"dfc09b54d8341344d9fb3b0bc8c53015","host":"10.244.6.224","method":"PATCH","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","proto":"HTTP/1.1","status":403,"size":0,"start":"23/Jul/2024:14:48:56 +0000","end":"23/Jul/2024:14:48:56 +0000","time_ns":1879116,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/log/log.go:112","message":"http"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"9bfa663e8c7445e8da2c14ee98e14d83","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","traceid":"7d2e4006dbd728c91397c31828aae348","remote-addr":"192.168.49.1","method":"PATCH","status":403,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMyNDMxLCJpYXQiOjE3MjE3NDYwMzEsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy80NGNhOWMzNC0xNWQ0LTRkYzEtYjc1NS1kOTQ5ODY4NWVhZjEifQ.BXLeC56szzDL1BK0IPqP1yZ_-YzLxdp8ww5wgQVybEc","duration":4.309202,"bytes":0,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"9bfa663e8c7445e8da2c14ee98e14d83","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1 svc=data"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"9bfa663e8c7445e8da2c14ee98e14d83","request-id":"1fe28dc0-16a6-4541-a419-44319f4942b8","time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/dataprovider/dataprovider.go:179","message":"dataprovider routing: path=/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"9bfa663e8c7445e8da2c14ee98e14d83","host":"10.244.6.246","method":"PATCH","uri":"/data/tus/44ca9c34-15d4-4dc1-b755-d9498685eaf1","url":"/44ca9c34-15d4-4dc1-b755-d9498685eaf1","proto":"HTTP/1.1","status":403,"size":30,"start":"23/Jul/2024:14:48:56 +0000","end":"23/Jul/2024:14:48:56 +0000","time_ns":200929,"time":"2024-07-23T14:48:56Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/log/log.go:112","message":"http"}
web-d695bd9c5-8cnzs web {"level":"debug","service":"web","request-id":"f07bd6512b941591b95f38f5019ca472","proto":"HTTP/1.1","method":"GET","status":200,"path":"/icons/restart-line.svg","duration":0.102794,"bytes":415,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"f07bd6512b941591b95f38f5019ca472","traceid":"e886cb0faa40aa09a6f7488bbb799655","remote-addr":"192.168.49.1","method":"GET","status":200,"path":"/icons/restart-line.svg","duration":1.093804,"bytes":270,"time":"2024-07-23T14:48:56Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}

image

image

For whatever reason I see on the continuous deployment:

wkloucek commented 2 months ago

Actually I need to test in Minikube with a file that I didn't upload before, than I also can see a POST before the patch:

image

image

The log for this case (but different file) looks like this:

proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"POST","prefix":"/remote.php/","path":"/remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c","routeType":"prefix","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","access token":{"sid":"","iss":"https://ocis.kube.owncloud.test","sub":"GaaC3LZ3ywA5_qTK@MH3-31PL7fRAXierXMCeuUVZ8JnkavLKaSnWgn2p_nKVbpOBi2xVstS8ALoseEG-kSehoQ","aud":["web"],"exp":1721747196,"iat":1721746896,"jti":"SCDlU6YO0J4c7XqDOmCjAtl73DM4FWVF"},"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/oidc/client.go:305","message":"parsed access token"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"GET","prefix":"/konnect/","path":"/konnect/v1/userinfo","routeType":"prefix","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","addr":"{\"IP\":\"::\",\"Port\":9235,\"Zone\":\"\"}","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"New Connection"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","bind_dn":"uid=idp,ou=sysusers,o=libregraph-idm","op":"bind","remote_addr":"10.244.6.228:56946","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"success"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"c49b7d36c992fbb72e6caa13fdae8f9b","traceid":"fa85cba8f3e1c19a131a0123f3882037","remote-addr":"10.244.0.1","method":"GET","status":200,"path":"/konnect/v1/userinfo","duration":75.102222,"bytes":265,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
idp-654fc9cd7d-4m8bk idp {"level":"debug","service":"idp","request-id":"c49b7d36c992fbb72e6caa13fdae8f9b","proto":"HTTP/1.1","method":"GET","status":200,"path":"/konnect/v1/userinfo","duration":72.894994,"bytes":265,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/middleware/logger.go:27"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["dn","givenName","ownCloudUUID","text","uid","mail","displayName","sn"],"basedn":"ou=users,o=libregraph-idm","binddn":"uid=idp,ou=sysusers,o=libregraph-idm","filter":"(&(&(objectclass=inetOrgPerson)(!(ownCloudUserEnabled=FALSE)))(ownCloudUUID=81bc3848-677f-42af-abd8-405c6a79348c))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"Calling boltdb search"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["dn","givenName","ownCloudUUID","text","uid","mail","displayName","sn"],"basedn":"ou=users,o=libregraph-idm","binddn":"uid=idp,ou=sysusers,o=libregraph-idm","filter":"(&(&(objectclass=inetOrgPerson)(!(ownCloudUserEnabled=FALSE)))(ownCloudUUID=81bc3848-677f-42af-abd8-405c6a79348c))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"boltdb search returned 7 entries"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/Authenticate","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","exp":"2024-07-23 15:06:36 +0000 UTC","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/oidc_auth.go:140","message":"Expiration Time from access_token"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","claims":{"aud":"web","email":"admin@example.org","email_verified":false,"exp":1721747196,"family_name":"Admin","given_name":"Admin","iat":1721746896,"iss":"https://ocis.kube.owncloud.test","jti":"SCDlU6YO0J4c7XqDOmCjAtl73DM4FWVF","lg.i":{"dn":"Admin","id":"ownCloudUUID=81bc3848-677f-42af-abd8-405c6a79348c","un":"admin"},"lg.p":"identifier-ldap","lg.t":"1","name":"Admin","preferred_username":"admin","scp":"profile email openid","sub":"GaaC3LZ3ywA5_qTK@MH3-31PL7fRAXierXMCeuUVZ8JnkavLKaSnWgn2p_nKVbpOBi2xVstS8ALoseEG-kSehoQ"},"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/oidc_auth.go:130","message":"extracted claims"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","authenticator":"oidc","path":"/remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/oidc_auth.go:194","message":"successfully authenticated request"}
authmachine-698b666b97-fqphx authmachine {"level":"debug","service":"auth-machine","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.auth.provider.v1beta1.ProviderAPI/Authenticate","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.auth.registry.v1beta1.RegistryAPI/GetAuthProviders","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:34768","uri":"/cs3.auth.registry.v1beta1.RegistryAPI/GetAuthProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":45666,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/GetUserByClaim","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.identity.user.v1beta1.UserAPI/GetUserByClaim","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","claim":"username","value":"admin","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/user/manager/ldap/ldap.go:137","message":"GetUserByClaim"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","backend":"ldap","basedn":"ou=users,o=libregraph-idm","filter":"(&(objectclass=inetOrgPerson)(uid=admin)(!(ownCloudUserEnabled=FALSE)))","scope":2,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/utils/ldap/identity.go:217","message":"LDAP Search"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.225:33048","uri":"/cs3.gateway.v1beta1.GatewayAPI/GetUserByClaim","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":10887399,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.224:59058","uri":"/cs3.gateway.v1beta1.GatewayAPI/Authenticate","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":19673269,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["displayname","ownclouduuid","mail","uid","uidNumber","gidNumber","ownCloudUserEnabled","ownCloudUserType"],"basedn":"ou=users,o=libregraph-idm","binddn":"uid=reva,ou=sysusers,o=libregraph-idm","filter":"(&(objectclass=inetOrgPerson)(uid=admin)(!(ownCloudUserEnabled=FALSE)))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"Calling boltdb search"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["displayname","ownclouduuid","mail","uid","uidNumber","gidNumber","ownCloudUserEnabled","ownCloudUserType"],"basedn":"ou=users,o=libregraph-idm","binddn":"uid=reva,ou=sysusers,o=libregraph-idm","filter":"(&(objectclass=inetOrgPerson)(uid=admin)(!(ownCloudUserEnabled=FALSE)))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"boltdb search returned 7 entries"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["ownclouduuid"],"basedn":"ou=groups,o=libregraph-idm","binddn":"uid=reva,ou=sysusers,o=libregraph-idm","filter":"(&(objectclass=groupOfNames)(member=uid=admin,ou=users,o=libregraph-idm))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"Calling boltdb search"}
idm-5595968-vs7df idm {"level":"debug","service":"idm","attrs":["ownclouduuid"],"basedn":"ou=groups,o=libregraph-idm","binddn":"uid=reva,ou=sysusers,o=libregraph-idm","filter":"(&(objectclass=groupOfNames)(member=uid=admin,ou=users,o=libregraph-idm))","op":"search","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/ocis-pkg/log/logrus_wrapper.go:50","message":"boltdb search returned 9 entries"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","claims":{"aud":"web","email":"admin@example.org","email_verified":false,"exp":1721747196,"family_name":"Admin","given_name":"Admin","iat":1721746896,"iss":"https://ocis.kube.owncloud.test","jti":"SCDlU6YO0J4c7XqDOmCjAtl73DM4FWVF","lg.i":{"dn":"Admin","id":"ownCloudUUID=81bc3848-677f-42af-abd8-405c6a79348c","un":"admin"},"lg.p":"identifier-ldap","lg.t":"1","name":"Admin","preferred_username":"admin","scp":"profile email openid","sub":"GaaC3LZ3ywA5_qTK@MH3-31PL7fRAXierXMCeuUVZ8JnkavLKaSnWgn2p_nKVbpOBi2xVstS8ALoseEG-kSehoQ"},"user":{"id":{"idp":"https://ocis.kube.owncloud.test","opaque_id":"81bc3848-677f-42af-abd8-405c6a79348c","type":1},"username":"admin","mail":"admin@example.org","display_name":"Admin","groups":["509a9dcd-bb37-4f4f-a01a-19dca27d9cfa"],"opaque":{"map":{"roles":{"decoder":"json","value":"WyI3MTg4MTg4My0xNzY4LTQ2YmQtYTI0ZC1hMzU2YTJhZmRmN2YiXQ=="}}},"uid_number":99,"gid_number":99},"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/account_resolver.go:179","message":"associated claims with user"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","entry":{"DN":"uid=admin,ou=users,o=libregraph-idm","Attributes":[{"Name":"displayName","Values":["Admin"],"ByteValues":["QWRtaW4="]},{"Name":"mail","Values":["admin@example.org"],"ByteValues":["YWRtaW5AZXhhbXBsZS5vcmc="]},{"Name":"ownCloudUUID","Values":["81bc3848-677f-42af-abd8-405c6a79348c"],"ByteValues":["ODFiYzM4NDgtNjc3Zi00MmFmLWFiZDgtNDA1YzZhNzkzNDhj"]},{"Name":"uid","Values":["admin"],"ByteValues":["YWRtaW4="]}]},"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/user/manager/ldap/ldap.go:144","message":"entries"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","backend":"ldap","basedn":"ou=groups,o=libregraph-idm","filter":"(&(objectclass=groupOfNames)(member=uid=admin,ou=users,o=libregraph-idm))","scope":2,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/utils/ldap/identity.go:349","message":"LDAP Search"}
users-86bc5d5489-csf59 users {"level":"debug","service":"users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:48480","uri":"/cs3.identity.user.v1beta1.UserAPI/GetUserByClaim","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":6802404,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
authmachine-698b666b97-fqphx authmachine {"level":"info","service":"auth-machine","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/services/authprovider/authprovider.go:145","message":"user idp:\"https://ocis.kube.owncloud.test\" opaque_id:\"81bc3848-677f-42af-abd8-405c6a79348c\" type:USER_TYPE_PRIMARY  authenticated"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/CreateHome","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:34776","uri":"/cs3.storage.registry.v1beta1.RegistryAPI/GetStorageProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":388302,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
authmachine-698b666b97-fqphx authmachine {"level":"debug","service":"auth-machine","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:42458","uri":"/cs3.auth.provider.v1beta1.ProviderAPI/Authenticate","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":13484622,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:38666","uri":"/cs3.storage.provider.v1beta1.ProviderAPI/CreateStorageSpace","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":5357633,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.224:59058","uri":"/cs3.gateway.v1beta1.GatewayAPI/CreateHome","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":10334888,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
ocdav-6945c7997b-snf4j ocdav {"level":"debug","service":"ocdav","name":"com.owncloud.web.ocdav","traceid":"e57251c5f7b95dc640d7b02f88034ded","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","head":"remote.php","tail":"/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/owncloud/ocdav/ocdav.go:181","message":"http routing"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/Stat","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.245:38666","uri":"/cs3.storage.provider.v1beta1.ProviderAPI/Stat","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":740595,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.245:34776","uri":"/cs3.storage.registry.v1beta1.RegistryAPI/ListStorageProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":205156,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.235:36872","uri":"/cs3.gateway.v1beta1.GatewayAPI/Stat","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":3275670,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","method":"/cs3.gateway.v1beta1.GatewayAPI/InitiateFileUpload","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.245:34776","uri":"/cs3.storage.registry.v1beta1.RegistryAPI/ListStorageProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":337436,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","uploadid":"1933495d-3d34-462c-9f93-dc69390fd171","spaceid":"81bc3848-677f-42af-abd8-405c6a79348c","nodeid":"","metadata":{"expires":"1721833520","mtime":"1689686682","providerID":"68008272-be27-419c-aac6-1775980e7769"},"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/storage/utils/decomposedfs/upload.go:231","message":"Decomposedfs: resolved filename"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.235:36872","uri":"/cs3.gateway.v1beta1.GatewayAPI/InitiateFileUpload","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":9664335,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","spaceid":"81bc3848-677f-42af-abd8-405c6a79348c","nodeid":"81bc3848-677f-42af-abd8-405c6a79348c","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/storage/utils/decomposedfs/node/node.go:1008","message":"user is owner, returning owner permissions"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","session":{},"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/storage/utils/decomposedfs/upload.go:305","message":"Decomposedfs: built session info"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","data-server":"http://storageusers:9158/data/simple/1933495d-3d34-462c-9f93-dc69390fd171","fn":"./500MB PDF File.pdf","xs":"map[md5:100 unset:1000]","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/services/storageprovider/storageprovider.go:466","message":"file upload"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","data-server":"http://storageusers:9158/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","fn":"./500MB PDF File.pdf","xs":"map[md5:100 unset:1000]","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/services/storageprovider/storageprovider.go:466","message":"file upload"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rgrpc","traceid":"e57251c5f7b95dc640d7b02f88034ded","user-agent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36","from":"tcp://10.244.6.245:38666","uri":"/cs3.storage.provider.v1beta1.ProviderAPI/InitiateFileUpload","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":5907358,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"PATCH","prefix":"/data","path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","routeType":"prefix","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"1d3333d01d7c8842ca73937a21cbc371","method":"/cs3.gateway.v1beta1.GatewayAPI/CreateHome","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/auth/auth.go:122","message":"skipping auth"}
frontend-76488f8c76-2hxq5 frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"4072941c10f60f256679c1d696f97788","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"1d3333d01d7c8842ca73937a21cbc371","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.245:34776","uri":"/cs3.storage.registry.v1beta1.RegistryAPI/GetStorageProviders","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":280038,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
gateway-548c9db6d5-6sczg gateway {"level":"debug","service":"gateway","pkg":"rgrpc","traceid":"1d3333d01d7c8842ca73937a21cbc371","user-agent":"grpc-go/1.64.0","from":"tcp://10.244.6.224:59058","uri":"/cs3.gateway.v1beta1.GatewayAPI/CreateHome","start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":1871645,"code":"OK","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/grpc/interceptors/log/log.go:69","message":"unary"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"f2bb17f252bc6f66584a43f894009a80","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/1933495d-3d34-462c-9f93-dc69390fd171"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/tus/1933495d-3d34-462c-9f93-dc69390fd171 svc=data"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"f2bb17f252bc6f66584a43f894009a80","request-id":"c1a377557f22582fb4b79f8276c57354","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/dataprovider/dataprovider.go:179","message":"dataprovider routing: path=/tus/1933495d-3d34-462c-9f93-dc69390fd171"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g svc=data"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"4072941c10f60f256679c1d696f97788","request-id":"c1a377557f22582fb4b79f8276c57354","target":"http://storageusers:9158/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/datagateway/datagateway.go:187","message":"sending request to internal data server"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"c1a377557f22582fb4b79f8276c57354","traceid":"1d3333d01d7c8842ca73937a21cbc371","remote-addr":"10.244.0.1","method":"PATCH","status":204,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","duration":56.301657,"bytes":0,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"4072941c10f60f256679c1d696f97788","host":"10.244.6.224","method":"PATCH","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","proto":"HTTP/1.1","status":204,"size":0,"start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":50896906,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/log/log.go:112","message":"http"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"f2bb17f252bc6f66584a43f894009a80","host":"10.244.6.246","method":"PATCH","uri":"/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","url":"/1933495d-3d34-462c-9f93-dc69390fd171","proto":"HTTP/1.1","status":204,"size":0,"start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":45727648,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/log/log.go:112","message":"http"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","traceid":"e57251c5f7b95dc640d7b02f88034ded","remote-addr":"192.168.49.1","method":"POST","status":201,"path":"/remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c","duration":301.550136,"bytes":0,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-76488f8c76-2hxq5 frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"13c93ca06cc8ab002967a3b2c48a1a13","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"13c93ca06cc8ab002967a3b2c48a1a13","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
proxy-6ffc94748-46z22 proxy {"level":"debug","service":"proxy","policy":"ocis","method":"PATCH","prefix":"/data","path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","routeType":"prefix","time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:224","message":"rewrite hook found"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g svc=data"}
frontend-76488f8c76-2hxq5 frontend {"level":"debug","service":"frontend","pkg":"rhttp","traceid":"13c93ca06cc8ab002967a3b2c48a1a13","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","target":"http://storageusers:9158/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/datagateway/datagateway.go:187","message":"sending request to internal data server"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"9828feb8c2a0b8b338d0ef5619e45cd5","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/1933495d-3d34-462c-9f93-dc69390fd171"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"9828feb8c2a0b8b338d0ef5619e45cd5","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/pkg/rhttp/rhttp.go:248","message":"http routing: head=data tail=/tus/1933495d-3d34-462c-9f93-dc69390fd171 svc=data"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"debug","service":"storage-users","pkg":"rhttp","traceid":"9828feb8c2a0b8b338d0ef5619e45cd5","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/services/dataprovider/dataprovider.go:179","message":"dataprovider routing: path=/tus/1933495d-3d34-462c-9f93-dc69390fd171"}
storageusers-f69c99ccb-jn9zb storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"9828feb8c2a0b8b338d0ef5619e45cd5","host":"10.244.6.246","method":"PATCH","uri":"/data/tus/1933495d-3d34-462c-9f93-dc69390fd171","url":"/1933495d-3d34-462c-9f93-dc69390fd171","proto":"HTTP/1.1","status":403,"size":30,"start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":212400,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/log/log.go:112","message":"http"}
frontend-76488f8c76-2hxq5 frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"13c93ca06cc8ab002967a3b2c48a1a13","host":"10.244.6.224","method":"PATCH","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","proto":"HTTP/1.1","status":403,"size":0,"start":"23/Jul/2024:15:05:20 +0000","end":"23/Jul/2024:15:05:20 +0000","time_ns":2027449,"time":"2024-07-23T15:05:20Z","line":"github.com/cs3org/reva/v2@v2.21.0/internal/http/interceptors/log/log.go:112","message":"http"}
proxy-6ffc94748-46z22 proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"469be25d-5342-4ca5-854c-78a45364bd87","traceid":"cc821d770b6152d172edc86ce14ad15a","remote-addr":"192.168.49.1","method":"PATCH","status":403,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzNTIwLCJpYXQiOjE3MjE3NDcxMjAsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy8xOTMzNDk1ZC0zZDM0LTQ2MmMtOWY5My1kYzY5MzkwZmQxNzEifQ.dj49zGLpJGQD_8-0g6b0fXNLdmqAFKZzWGhrbUANP_g","duration":3.1269,"bytes":0,"time":"2024-07-23T15:05:20Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
wkloucek commented 2 months ago

The nginx logs while uploading a file for the first time:

ngress-nginx-controller-768f948f8f-hmkgh controller 2024/07/23 15:12:32 [warn] 1287#1287: *119782 a client request body is buffered to a temporary file /tmp/nginx/client-body/0000000023, client: 192.168.49.1, server: ocis.kube.owncloud.test, request: "POST /remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c HTTP/2.0", host: "ocis.kube.owncloud.test", referrer: "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1"
ingress-nginx-controller-768f948f8f-hmkgh controller 10.244.0.1 - - [23/Jul/2024:15:12:33 +0000] "GET /konnect/v1/userinfo HTTP/1.1" 200 265 "-" "Go-http-client/1.1" 1422 0.104 [ocis-proxy-9200] [] 10.244.6.224:9200 265 0.104 200 092754d0d0b56d1111069b92616d21db
ingress-nginx-controller-768f948f8f-hmkgh controller 2024/07/23 15:12:33 [warn] 1273#1273: *196342 a client request body is buffered to a temporary file /tmp/nginx/client-body/0000000024, client: 10.244.0.1, server: ocis.kube.owncloud.test, request: "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0", host: "ocis.kube.owncloud.test"
ingress-nginx-controller-768f948f8f-hmkgh controller 10.244.0.1 - - [23/Jul/2024:15:12:33 +0000] "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0" 204 0 "-" "Go-http-client/2.0" 10000984 0.081 [ocis-proxy-9200] [] 10.244.6.224:9200 0 0.038 204 74ede80410705da03a9f87cb0a8798ca
ingress-nginx-controller-768f948f8f-hmkgh controller 192.168.49.1 - - [23/Jul/2024:15:12:33 +0000] "POST /remote.php/dav/spaces/68008272-be27-419c-aac6-1775980e7769$81bc3848-677f-42af-abd8-405c6a79348c HTTP/2.0" 201 0 "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36" 10000900 0.333 [ocis-proxy-9200] [] 10.244.6.224:9200 0 0.250 201 73601c48-f255-42c4-a910-1753c58a7c0b
ingress-nginx-controller-768f948f8f-hmkgh controller 2024/07/23 15:12:33 [warn] 1287#1287: *119782 a client request body is buffered to a temporary file /tmp/nginx/client-body/0000000025, client: 192.168.49.1, server: ocis.kube.owncloud.test, request: "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0", host: "ocis.kube.owncloud.test", referrer: "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1"
ingress-nginx-controller-768f948f8f-hmkgh controller 2024/07/23 15:12:33 [error] 1287#1287: *119782 writev() failed (104: Connection reset by peer) while sending request to upstream, client: 192.168.49.1, server: ocis.kube.owncloud.test, request: "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0", upstream: "http://10.244.6.224:9200/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk", host: "ocis.kube.owncloud.test", referrer: "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1"
ingress-nginx-controller-768f948f8f-hmkgh controller 192.168.49.1 - - [23/Jul/2024:15:12:33 +0000] "PATCH /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIxODMzOTUzLCJpYXQiOjE3MjE3NDc1NTMsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9iNWMyOTQxNC0yN2FmLTRmNDctYTBlYS0zN2ZiMmVjNDZkYWQifQ.B1MeGqpWUkEuCfaMJSoKNbYAyd88k911mCFoVG2zEOk HTTP/2.0" 502 552 "https://ocis.kube.owncloud.test/files/spaces/personal/admin?fileId=68008272-be27-419c-aac6-1775980e7769%2481bc3848-677f-42af-abd8-405c6a79348c%2181bc3848-677f-42af-abd8-405c6a79348c&sort-by=name&sort-dir=asc&items-per-page=100&files-spaces-generic-view-mode=resource-table&tiles-size=1" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 Safari/537.36" 10000597 0.057 [ocis-proxy-9200] [] 10.244.6.224:9200 0 0.000 502 73601c48-f255-42c4-a910-1753c58a7c0b
wkloucek commented 2 months ago

@case0sh @d7oc could you please test if that still applies to oCIS 6.2? I tested it with 6.1

d7oc commented 2 months ago

At least I can't upload at 59MB file:

Screenshot 2024-08-08 at 18 49 20

excerpt from proxy log:

{"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"7f50c924-926a-4d4c-826a-b9b25602c3f3","traceid":"2180cc712e43146da01cf34fba55899f","remote-addr":"92.117.247.254","method":"POST","status":201,"path":"/remote.php/dav/spaces/a0bc72a0-1478-411a-8ca5-788f13c7ad1a$5dd10401-0b20-481e-bee0-cd89ccb4cada","duration":7993.371942,"bytes":0,"time":"2024-08-08T16:45:23Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
{"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"7f50c924-926a-4d4c-826a-b9b25602c3f3","traceid":"2fa46653d945fc3b0a915d60d7b799f3","remote-addr":"92.117.247.254","method":"PATCH","status":403,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzIzMjIxOTE1LCJpYXQiOjE3MjMxMzU1MTUsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy83ZWU3NWJhZC02MzUwLTQ0MGQtODBlMy0wZjBkNWM3YjQ4YzYifQ.6hBU-nCGvdnNNdTv7UcFg6H9ELjqZN2DnloGkvWJNks","duration":23.432487,"bytes":0,"time":"2024-08-08T16:45:23Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
d7oc commented 2 months ago

The behaviour also seems to differ by browser. Above's screenshot was from Safari. This one is from Firefox with dev tool enabled:

Screenshot 2024-08-08 at 18 51 25
d7oc commented 2 months ago

Also worth noting is the fancy animation which jumps backwards:

https://github.com/user-attachments/assets/69a358be-b8cb-4064-84c3-21b40b315b28

d7oc commented 2 months ago

@micbar @wkloucek Any clue where we could start the investigation? For me this is a blocker for oCIS 6 usage.

kobergj commented 2 months ago

@dragotin @d7oc @wkloucek

Found it. It was cors. storage-users service also needs the cors configuration for the PATCH requests. I needed this fix for the helmchart: https://github.com/owncloud/ocis-charts/pull/675

Additionally, I set 

cors:                                                                                                                                                                                                                                                                              
    #-- allow_origins is a list of origins a cross-domain request can be executed from.                                                                                                                                                                                              
    # If the special "*" value is present in the list, all origins will be allowed.                                                                                                                                                                                                  
    allow_origins: ["ocis.kube.owncloud.test"]

in my values.yaml.

d7oc commented 2 months ago

Just for curiosity: Why hasn't this been an issue with oCIS 5? I meant we also did TUS uploads in oCIS 5, didn't we?

kobergj commented 2 months ago

Good question. We bumped the tusd package recently to newer version. Also we did some improvements to cors lately. My best guess that it wasn't working as it should before. Now that we've updated the dependencies the feature works properly and therefore throws an error. (Just a guess though...)

kobergj commented 2 months ago

Closing as https://github.com/owncloud/ocis-charts/pull/675 got merged. Please reopen if issue persists.

wkloucek commented 1 month ago

@d7oc @case0sh @kobergj I don't see this fixed on my side. I still have it.

wkloucek commented 1 month ago

This are the logs when trying to continue the upload after the first time abort:

frontend-74d884d78c-hztzx frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"69d216f26e72688171a0d15692cadf0d","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8"}
frontend-74d884d78c-hztzx frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"69d216f26e72688171a0d15692cadf0d","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-79c7b89d89-qk24z storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"1f4db51e2f42ad445425c9ad7707ca8b","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/df1ea6c4-b70c-4766-a91c-db204956d847"}
storageusers-79c7b89d89-qk24z storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"1f4db51e2f42ad445425c9ad7707ca8b","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
proxy-c67d86f65-klxsc proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"5785b51d-9d5f-49c1-b988-8e613a895620","traceid":"ee8bf90c834865ad00673803fe43015c","remote-addr":"192.168.49.1","method":"HEAD","status":200,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8","duration":5.516209,"bytes":0,"time":"2024-09-11T12:33:40Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-74d884d78c-hztzx frontend {"level":"error","service":"frontend","pkg":"rhttp","traceid":"69d216f26e72688171a0d15692cadf0d","request-id":"5785b51d-9d5f-49c1-b988-8e613a895620","content-length":58994227,"transferred-bytes":0,"time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/services/datagateway/datagateway.go:226","message":"content length vs transferred bytes mismatch"}
frontend-74d884d78c-hztzx frontend {"level":"info","service":"frontend","pkg":"rhttp","traceid":"e17aa51a462c137d8bca765df8ac894d","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8"}
frontend-74d884d78c-hztzx frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"e17aa51a462c137d8bca765df8ac894d","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-79c7b89d89-qk24z storageusers {"level":"info","service":"storage-users","pkg":"rhttp","traceid":"ad25badc5d3584c553509994ee80c85f","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/auth/auth.go:195","message":"skipping auth check for: /data/tus/df1ea6c4-b70c-4766-a91c-db204956d847"}
storageusers-79c7b89d89-qk24z storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"ad25badc5d3584c553509994ee80c85f","time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/auth/auth.go:248","message":"core access token not set"}
storageusers-79c7b89d89-qk24z storageusers {"level":"warn","service":"storage-users","pkg":"rhttp","traceid":"ad25badc5d3584c553509994ee80c85f","host":"10.244.10.205","method":"PATCH","uri":"/data/tus/df1ea6c4-b70c-4766-a91c-db204956d847","url":"/df1ea6c4-b70c-4766-a91c-db204956d847","proto":"HTTP/1.1","status":403,"size":54,"start":"11/Sep/2024:12:33:40 +0000","end":"11/Sep/2024:12:33:40 +0000","time_ns":163649,"time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/log/log.go:112","message":"http"}
proxy-c67d86f65-klxsc proxy {"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"5785b51d-9d5f-49c1-b988-8e613a895620","traceid":"a200678dd6ec088af1403e821f0914c6","remote-addr":"192.168.49.1","method":"PATCH","status":403,"path":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8","duration":6.16426,"bytes":0,"time":"2024-09-11T12:33:40Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:34","message":"access-log"}
frontend-74d884d78c-hztzx frontend {"level":"warn","service":"frontend","pkg":"rhttp","traceid":"e17aa51a462c137d8bca765df8ac894d","host":"10.244.10.196","method":"PATCH","uri":"/data/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8","url":"/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJhdWQiOiJyZXZhIiwiZXhwIjoxNzI2MTQ0MjM2LCJpYXQiOjE3MjYwNTc4MzYsInRhcmdldCI6Imh0dHA6Ly9zdG9yYWdldXNlcnM6OTE1OC9kYXRhL3R1cy9kZjFlYTZjNC1iNzBjLTQ3NjYtYTkxYy1kYjIwNDk1NmQ4NDcifQ.IS0F0XJqtwEmw99CiPLyfm4L-aOOZt8wutHJlAv68t8","proto":"HTTP/1.1","status":403,"size":0,"start":"11/Sep/2024:12:33:40 +0000","end":"11/Sep/2024:12:33:40 +0000","time_ns":1201665,"time":"2024-09-11T12:33:40Z","line":"github.com/cs3org/reva/v2@v2.23.0/internal/http/interceptors/log/log.go:112","message":"http"}
dj4oC commented 1 month ago

Here a short script to create test files:

#!/bin/bash

TARGET_DIR=~/DemoFiles
mkdir -p "$TARGET_DIR"

FILE_COUNT=1000
MIN_SIZE=5120        # 5KB
MAX_SIZE=5368709120  # 5GB

STEP_SIZE=$(( (MAX_SIZE - MIN_SIZE) / (FILE_COUNT - 1) ))

for ((i=1; i<=FILE_COUNT; i++)); do
  FILE_SIZE=$(( MIN_SIZE + (i - 1) * STEP_SIZE ))
  FILE_NAME="$TARGET_DIR/file_$i.bin"
  head -c "$FILE_SIZE" </dev/urandom > "$FILE_NAME"
  echo "Created $FILE_NAME with size $FILE_SIZE bytes"
done

echo "All files created."