search

DevExpress / testcafe-browser-provider-saucelabs

This is the Sauce Labs browser provider plugin for TestCafe.
https://devexpress.github.io/testcafe/
MIT License
32 stars 41 forks source link

ERROR Unable to establish one or more of the specified browser connections. This can be caused by network issues or remote device failure. #60

Closed SebastianChece2389 closed 1 year ago

SebastianChece2389 commented 4 years ago

Hello,

What happens

After starting test with command line above (or a different browser/OS combination), then the test shows a running icon for 6 minutes, and then I get the message: ERROR Unable to establish one or more of the specified browser connections. This can be caused by network issues or remote device failure. Nothing more.

This is a similar problem described in another ticket, which is closed: https://github.com/DevExpress/testcafe-browser-provider-saucelabs/issues/10 ERROR Unable to establish one or more of the specified browser connections.

I read everything, but I do not get it done. In this other ticket are also advises how to start tunnel-logging. But files in node_modules/* have changes. Not only line count, also content. I don't get a tunnel-Log active or do not find logging content.

My setup

need help

I read and tried much, but I don't get a solution. I am new to nodejs, saucelabs, etc. Would be very kind, when someone can help, perhaps by starting to get more logfile.

thanks a lot Sebastian

LavrovArtem commented 4 years ago

Could you please check a new tunnel and browser in the SauceLabs Dashboard when you run TestCafe? There you will see a video and screenshots of the browser. Could you show them? If the SauceLabs Dashboard is empty, do these steps:

- logfile: tunnelLogging ? 'sc_' + this.tunnelIdentifier + '.log' : null
+ logfile: '/path/to/logfile'
SebastianChece2389 commented 4 years ago

Thank you. There was no video in saucelabs. The message says, the test in saucelabs has not started. So, the error is some steps before you will find saucelabs test videos.

In the meantime I got luck and get a hint of members of another project which are also using testcafe and saucelabs.

The Problem is

"saucelabs-connector" just used only API V1: https://github.com/DevExpress/saucelabs-connector/blob/master/src/index.js

async _getFreeMachineCount () {
        var params = {
            method: 'GET',
            url:    [`https://${SAUCE_API_HOST}/rest/v1/users`, this.username, 'concurrency'].join('/'),
            auth:   { user: this.username, pass: this.accessKey }
        };

That was correct before, but is not anymore for new saucelabs customer/user, because saucelabs also added new API 1.2 in saucelabs environments. url: ['https://' + _sauceHost.SAUCE_API_HOST + '/rest/v1.2/users', this.username, 'concurrency'].join('/'),

The quick and dirty local fix

Here is a quick and dirty fix for local "node_modules".

delete or comment existing code block:

 // SaucelabsConnector.prototype._getFreeMachineCount = function _getFreeMachineCount() {
    //     var params, response;
    //     return _regeneratorRuntime.async(function _getFreeMachineCount$(context$2$0) {
    //         while (1) switch (context$2$0.prev = context$2$0.next) {
    //             case 0:
    //                 params = {
    //                     method: 'GET',
    //                     url: ['https://' + _sauceHost.SAUCE_API_HOST + '/rest/v1/users', this.username, 'concurrency'].join('/'),
    //                     auth: { user: this.username, pass: this.accessKey }
    //                 };
    //                 context$2$0.next = 3;
    //                 return _regeneratorRuntime.awrap(requestPromised(params));
    //
    //             case 3:
    //                 response = context$2$0.sent;
    //                 return context$2$0.abrupt('return', JSON.parse(response.body).concurrency[this.username].remaining.overall);
    //
    //             case 5:
    //             case 'end':
    //                 return context$2$0.stop();
    //         }
    //     }, null, this);
    // };

replace or add new code block as fix

SaucelabsConnector.prototype._getFreeMachineCount = function _getFreeMachineCount() {
        var params, response, organization, allowed, current;
        return _regeneratorRuntime.async(function _getFreeMachineCount$(context$2$0) {
            while (1) switch (context$2$0.prev = context$2$0.next) {
                case 0:
                    params = {
                        method: 'GET',
                        url: ['https://' + _sauceHost.SAUCE_API_HOST + '/rest/v1.2/users', this.username, 'concurrency'].join('/'),
                        auth: { user: this.username, pass: this.accessKey }
                    };
                    context$2$0.next = 3;
                    return _regeneratorRuntime.awrap(requestPromised(params));

                case 3:
                    response = context$2$0.sent;
                    organization = JSON.parse(response.body).concurrency.organization;
                    allowed = organization.allowed.vms;
                    current = organization.current.vms;
                    return context$2$0.abrupt('return', allowed - current);

                case 8:
                case 'end':
                    return context$2$0.stop();
            }
        }, null, this);
    };

Please notice the changes in the URL: "/rest/v1/users" -> "/rest/v1.2/users" And also notice the changes in "case 3" This works for me and fixed my problems.

Better and global solution would be ...

I am not really a great JS programmer. My skill was good enough to implement the dirty and quick fix locally, but not to implement the global solution to both github projects. But in the next weeks and months, more customer/user of testcafe + saucelabs will get the same error and the same problem as me, because more (new) saucelabs user will have an saucelabs environment with API V1.2. If someone can fix this in both github projects, this would be great! If not, I will try to get it done by myself in some days and make a pull request.

Best regards and thanks a lot Sebastian

AlexKamaev commented 4 years ago

@SebastianChece2389 Thank you for this information. We really appreciate it. I think we definitely should support new SauceLabs API. It would be the best solution. However, I could not reproduce the issue. I created a new user and everything works as expected with V1 API.

Could you please run your tests without your changes but set the SAUCE_API_HOST environment variable to eu-central-1.saucelabs.com?

As for your workaround, we are happy to hear that you solved the issue. We would like to integrate your solution into our code base, but at the moment, the documentation of the 1.2 version is confusing.

The response in your workaround contains the organization field with a nested allowed field, etc. However, the example in the docs does not contain such a field. It's great that the workaround works, however, we need to find documented approval for this. Could you please clarify where your colleagues read about the response format they are using.

SebastianChece2389 commented 4 years ago

@AlexKamaev : I forgot to mention that I already use EU Central Host, because we stay in EU. Without it, it won't work anyway.

$ echo $SAUCE_API_HOST
eu-central-1.saucelabs.com

I was not involved in the email traffic with saucelabs, but have got some information. Without quoting directly, saucelabs answered after my my colleagues telling them the problem with "testcafe-browser-provider-saucelabs":

Fix for "saucelabs-connector" to use API 1.2 should be:

async _getFreeMachineCount () {
var params = {
method: 'GET',
url: [`https://${SAUCE_API_HOST}/rest/v1.2/users`, this.username, 'concurrency'].join('/'),
auth: { user: this.username, pass: this.accessKey }
};
var response = await requestPromised(params);
var organization = JSON.parse(response.body).concurrency.organization;
var allowed = organization.allowed.vms;
var current = organization.current.vms;
return allowed - current;
}

But you are right anyway, on https://wiki.saucelabs.com/display/DOCS/Test+Activity+and+Usage+Methods there is nothing about that nested organization field.

What About this idea? I do a curl -u USERNAME:API_KEY https://saucelabs.com/rest/v1.2/users/USERNAME/concurrency as shown in the saucelabs documentation and copy and paste the repsonse. I think that's what my colleagues did. Because it seems saucelabs documentation is lacking or incorrect here.

SebastianChece2389 commented 4 years ago

Some additional information:

In the Email Traffic with saucelabs I see a example response, I think there my colleagues found all information directly:

The correct endpoint: https://eu-central-1.saucelabs.com/rest/v1.2/users/<USERNAME>/concurrency

Example response from saucelabs handed my colleagues over: {"timestamp": <TIMESTAMP>, "concurrency": {"organization": {"current": {"vms": <current_used>, "rds": 0, "mac_vms": 0}, "id": "<ID>", "allowed": {"vms": <Allowed_VMs>, "rds": 0, "mac_vms": <AllowedOS_VMs>}}, "team": {}}} This example shows the nested "organization" field.

Here is my own test from today: $ curl -u <User>:<Auth_key> https://eu-central-1.saucelabs.com/rest/v1.2/users/<User>/concurrency Actuall Response from today: {"timestamp": <TIMESTAMP>, "concurrency": {"organization": {"current": {"vms": <current_used>, "rds": 0, "mac_vms": 0}, "id": "<ID>", "allowed": {"vms": <Allowed_VMs>, "rds": 0, "mac_vms": <AllowedOS_VMs>}}, "team": {}}} Again by testing the endpoint today, you see the nested organization which documentation is lacking.

Would be nice to see this endpoint implemented as option in both of your github projects. Thanks a lot!

arubtsov commented 4 years ago

@SebastianChece2389 Thank you for the information. We will research possible solutions and contact SauceLabs regarding the new API format. Please stay tuned for the updates.

SebastianChece2389 commented 4 years ago

Nice to hear. I don't want to hurry, but just would be nice to know: Do you think your global solution needs "days" or more "weeks"? Just good to know because have to implement in our CI pipeline and have to decide to use an own fork or your global solution. Thank you very much for your support!

aleks-pro commented 4 years ago

I cannot give you any personal estimate as they may be misleading. We will update this thread as soon as we have any results.

JackSinclairT commented 3 years ago

Whats the status of this? Is this at a standstill?

github-actions[bot] commented 3 years ago

No updates yet. Once we get any results, we will post them in this thread.

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had any activity for a long period. It will be closed and archived if no further activity occurs. However, we may return to this issue in the future. If it still affects you or you have any additional information regarding it, please leave a comment and we will keep it open.

github-actions[bot] commented 1 year ago

We're closing this issue after a prolonged period of inactivity. If it still affects you, please add a comment to this issue with up-to-date information. Thank you.