search

minkphp / MinkSelenium2Driver

Selenium2 (webdriver) driver for Mink framework
MIT License
507 stars 163 forks source link

Failing test suite, Selenium 2.53 #239

Open aik099 opened 8 years ago

aik099 commented 8 years ago

Configuration:

When running driver tests in there I have following failures:

There was 1 error:

1) Behat\Mink\Tests\Driver\Js\ChangeEventTest::testSetValueChangeEvent with data set "file" ('the-file', 'from empty', 'from existing')
WebDriver\Exception\UnknownError: unknown error: path is not absolute: from empty
  (Session info: chrome=51.0.2704.103)
  (Driver info: chromedriver=2.21.371459 (36d3d07f660ff2bc1bf28a75d1cdabed0983e7c4),platform=Mac OS X 10.10.5 x86_64) (WARNING: The server did not provide any stacktrace information)
Command duration or timeout: 20 milliseconds
Build info: version: '2.53.0', revision: '35ae25b', time: '2016-03-15 17:00:58'
System info: host: 'alex-mbp', ip: '192.168.1.6', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.10.5', java.version: '1.8.0_74'
Driver info: org.openqa.selenium.chrome.ChromeDriver
Capabilities [{applicationCacheEnabled=false, rotatable=false, mobileEmulationEnabled=false, chrome={chromedriverVersion=2.21.371459 (36d3d07f660ff2bc1bf28a75d1cdabed0983e7c4), userDataDir=/var/folders/zr/z961h7s124z_qq5s4c4_j4000000gn/T/.org.chromium.Chromium.nXHJDJ}, takesHeapSnapshot=true, databaseEnabled=false, handlesAlerts=true, hasTouchScreen=false, version=51.0.2704.103, platform=MAC, browserConnectionEnabled=false, nativeEvents=true, acceptSslCerts=true, locationContextEnabled=true, webStorageEnabled=true, browserName=chrome, takesScreenshot=true, javascriptEnabled=true, cssSelectorsEnabled=true}]
Session ID: 68f84e17342891af646e900968ac9a26

/path/to/repo-clone/vendor/instaclick/php-webdriver/lib/WebDriver/Exception.php:155
/path/to/repo-clone/vendor/instaclick/php-webdriver/lib/WebDriver/AbstractWebDriver.php:140
/path/to/repo-clone/vendor/instaclick/php-webdriver/lib/WebDriver/AbstractWebDriver.php:200
/path/to/repo-clone/vendor/instaclick/php-webdriver/lib/WebDriver/Container.php:218
/path/to/repo-clone/src/Selenium2Driver.php:669
/path/to/repo-clone/src/Selenium2Driver.php:669
/path/to/repo-clone/vendor/behat/mink/src/Element/NodeElement.php:105
/path/to/repo-clone/vendor/behat/mink/driver-testsuite/tests/Js/ChangeEventTest.php:50

--

There were 2 failures:

1) Behat\Mink\Tests\Driver\Form\GeneralTest::testAdvancedForm
Failed asserting that '<!DOCTYPE html><html xmlns="http://www.w3.org/1999/xhtml"><head>
    <title>Advanced form save</title>
    <meta http-equiv="Content-Type" content="text/html;charset=UTF-8" />
</head>
<body>
array (
  'agreement' = 'on',
  'email' = 'ever.zet@gmail.com',
  'first_name' = 'Foo "item"',
  'last_name' = 'Bar',
  'notes' = 'new notes',
  'select_number' = '30',
  'sex' = 'm',
  'submit' = 'Register',
)
some_file.txt
1 uploaded file

</body></html>' contains "array (
  'agreement' = 'on',
  'email' = 'ever.zet@gmail.com',
  'first_name' = 'Foo &quot;item&quot;',
  'last_name' = 'Bar',
  'notes' = 'new notes',
  'select_number' = '30',
  'sex' = 'm',
  'submit' = 'Register',
)
some_file.txt
1 uploaded file".

/path/to/repo-clone/vendor/behat/mink/driver-testsuite/tests/Form/GeneralTest.php:220

2) Behat\Mink\Tests\Driver\Js\WindowTest::testResizeWindow
Failed asserting that false is true.

/path/to/repo-clone/vendor/behat/mink/driver-testsuite/tests/Js/WindowTest.php:82

P.S. It crashes the Firefox 47 completely. Probably not our driver issue at all.

stof commented 7 years ago

Behat\Mink\Tests\Driver\Form\GeneralTest::testAdvancedForm is also failing on PhantomJSDriver, so it may have to be changed in the driver-testsuite itself.

Behat\Mink\Tests\Driver\Js\ChangeEventTest::testSetValueChangeEvent is caused by https://github.com/minkphp/driver-testsuite/issues/9

Behat\Mink\Tests\Driver\Js\WindowTest::testResizeWindow should be checked again, as I think the testsuite has changed in the meantime to fix this.

Regarding Firefox, Selenium's Firefox driver supports < 47 and 47.0.1 (47.0.0 is totally unsupported due to being buggy).

aik099 commented 8 months ago

I think, that it will be fixed with https://github.com/minkphp/driver-testsuite/pull/88.