[Phoenix] Test fails randomly for deleting all except few files at once

swoichha commented 4 years ago

Reproduce

Run phoenix test tests/acceptance/features/webUIDeleteFilesFolders/deleteFilesFolders.feature:77 multiple times locally with OCIS (Version 1.0.0-beta9) backend.

Expected behaviour

The test should pass.

Actual behaviour

Test fails randomly

In CI it shows the same behaviour (See: https://github.com/owncloud/ocis/pull/483 . It was done for https://github.com/owncloud/ocis-reva/issues/442)

Screenshot

When looked into remmina we see that a file was not deleted properly.

error

individual-it commented 4 years ago

this is likely an issue in ocis, not phoenix. We can try to use the performance tests to reproduce

swoichha commented 4 years ago

With beta9, start ocis bin/ocis server

Start locust with (hatching 300 users @ 10user/s hatch rate) for following locust file:


from locust import HttpUser, TaskSet, task, constant
import uuid
import os
import urllib3

urllib3.disable_warnings()

class User(HttpUser): wait_time = constant(1)

davEndpoint = "/remote.php/dav/files/"
fileName = ''
userName = "einstein"
userPassword = "relativity"

def on_start(self):
    self.client.verify = False

@task(1)
def deleteFiles(self):
    fileName = "/test-file-" + str(uuid.uuid4()) + ".txt"
    file = open("/var/tmp/reva/data/4c510ada-c86b-4815-8820-42cdf82c3d51/files" + fileName, "w+")
    file.write("some data")
    file.close() 

    self.client.delete(
        self.davEndpoint + self.userName + fileName,
        auth=(self.userName, self.userPassword)
    )

3. Observe failure in locust and OCIS log output:

The error that I got in locust is :

HTTPError('401 Client Error: Unauthorized for url: https://localhost:9200/remote.php/dav/files/einstein/test-file-00c9872e-f2e1-4b25-ac58-3762eb617379.txt',)

OCIS log output:

2020-08-31T12:46:54+05:45 WRN home/swoichhaadhikari/go/pkg/mod/github.com/cs3org/reva@v1.1.1-0.20200819100654-dcbf0c8ea187/internal/grpc/services/authprovider/authprovider.go:114 > error authenticating user error="authsvc: error in Authenticate: LDAP Result Code 49 \"Invalid Credentials\": " pkg=rgrpc service=reva traceid=eec15dd67da6a478d6a7b2e9c3ed6c30 2020-08-31T12:46:54+05:45 INF unary code=OK end="31/Aug/2020:12:46:54 +0545" from=tcp://127.0.0.1:55920 pkg=rgrpc service=reva start="31/Aug/2020:12:46:49 +0545" time_ns=5002873708 traceid=eec15dd67da6a478d6a7b2e9c3ed6c30 uri=/cs3.auth.provider.v1beta1.ProviderAPI/Authenticate user-agent=grpc-go/1.26.0 2020-08-31T12:46:54+05:45 ERR Login failed binddn=cn=reva,ou=sysusers,dc=example,dc=org service=glauth src={"IP":"127.0.0.1","Port":34332,"Zone":""} username=reva 2020-08-31T12:46:54+05:45 ERR bind with system user failed error="LDAP Result Code 49 \"Invalid Credentials\": " pkg=rgrpc service=reva traceid=a2ebcb9311423cdffe170228034093f0 2020-08-31T12:46:54+05:45 WRN home/swoichhaadhikari/go/pkg/mod/github.com/cs3org/reva@v1.1.1-0.20200819100654-dcbf0c8ea187/internal/grpc/services/authprovider/authprovider.go:114 > error authenticating user error="authsvc: error in Authenticate: LDAP Result Code 49 \"Invalid Credentials\": " pkg=rgrpc service=reva traceid=a2ebcb9311423cdffe170228034093f0 2020-08-31T12:46:54+05:45 INF unary code=OK end="31/Aug/2020:12:46:54 +0545" from=tcp://127.0.0.1:55920 pkg=rgrpc service=reva start="31/Aug/2020:12:46:49 +0545" time_ns=5003560363 traceid=a2ebcb9311423cdffe170228034093f0 uri=/cs3.auth.provider.v1beta1.ProviderAPI/Authenticate user-agent=grpc-go/1.26.0 2020-08-31T12:46:54+05:45 ERR Login failed binddn=cn=reva,ou=sysusers,dc=example,dc=org service=glauth src={"IP":"127.0.0.1","Port":34334,"Zone":""} username=reva 2020-08-31T12:46:54+05:45 ERR bind with system user failed error="LDAP Result Code 49 \"Invalid Credentials\": " pkg=rgrpc service=reva traceid=05b98ddcd10cda1ec74b83eeb05a9def 2020-08-31T12:46:54+05:45 WRN home/swoichhaadhikari/go/pkg/mod/github.com/cs3org/reva@v1.1.1-0.20200819100654-dcbf0c8ea187/internal/grpc/services/authprovider/authprovider.go:114 > error authenticating user error="authsvc: error in Authenticate: LDAP Result Code 49 \"Invalid Credentials\": " pkg=rgrpc service=reva traceid=05b98ddcd10cda1ec74b83eeb05a9def 2020-08-31T12:46:54+05:45 INF unary code=OK end="31/Aug/2020:12:46:54 +0545" from=tcp://127.0.0.1:55920 pkg=rgrpc service=reva start="31/Aug/2020:12:46:49 +0545" time_ns=5007211185 traceid=05b98ddcd10cda1ec74b83eeb05a9def uri=/cs3.auth.provider.v1beta1.ProviderAPI/Authenticate user-agent=grpc-go/1.26.0 2020-08-31T12:46:54+05:45 ERR Login failed binddn=cn=reva,ou=sysusers,dc=example,dc=org service=glauth src={"IP":"127.0.0.1","Port":34336,"Zone":""} username=reva 2020-08-31T12:46:54+05:45 ERR bind with system user failed error="LDAP Result Code 49 \"Invalid Credentials\": " pkg=rgrpc service=reva traceid=aa86dc4cdcd2576c4128a5e5e050dd12 2020-08-31T12:46:54+05:45 WRN home/swoichhaadhikari/go/pkg/mod/github.com/cs3org/reva@v1.1.1-0.20200819100654-dcbf0c8ea187/internal/grpc/services/authprovider/authprovider.go:114 > error authenticating user error="authsvc: error in Authenticate: LDAP Result Code 49 \"Invalid Credentials\": " pkg=rgrpc service=reva traceid=aa86dc4cdcd2576c4128a5e5e050dd12 2020-08-31T12:46:54+05:45 INF unary code=OK end="31/Aug/2020:12:46:54 +0545" from=tcp://127.0.0.1:55920 pkg=rgrpc service=reva start="31/Aug/2020:12:46:49 +0545" time_ns=5002994348 traceid=aa86dc4cdcd2576c4128a5e5e050dd12 uri=/cs3.auth.provider.v1beta1.ProviderAPI/Authenticate user-agent=grpc-go/1.26.0 2020-08-31T12:46:54+05:45 ERR Login failed binddn=cn=reva,ou=sysusers,dc=example,dc=org service=glauth src={"IP":"127.0.0.1","Port":34338,"Zone":""} username=reva 2020-08-31T12:46:54+05:45 ERR bind with system user failed error="LDAP Result Code 49 \"Invalid Credentials\": " pkg=rgrpc service=reva traceid=39d2f4056f697004a7b42f0a8f23a05a 2020-08-31T12:46:54+05:45 WRN home/swoichhaadhikari/go/pkg/mod/github.com/cs3org/reva@v1.1.1-0.20200819100654-dcbf0c8ea187/internal/grpc/services/authprovider/authprovider.go:114 > error authenticating user error="authsvc: error in Authenticate: LDAP Result Code 49 \"Invalid Credentials\": " pkg=rgrpc service=reva traceid=39d2f4056f697004a7b42f0a8f23a05a 2020-08-31T12:46:54+05:45 INF unary code=OK end="31/Aug/2020:12:46:54 +0545" from=tcp://127.0.0.1:55920 pkg=rgrpc service=reva start="31/Aug/2020:12:46:49 +0545" time_ns=5003131797 traceid=39d2f4056f697004a7b42f0a8f23a05a uri=/cs3.auth.provider.v1beta1.ProviderAPI/Authenticate user-agent=grpc-go/1.26.0

owncloud / product