joomla-projects / GSOC-Webdriver_system_tests_for_CMS

[READ-ONLY] This repo is no longer in active development. Please see https://github.com/joomla/joomla-cms | REPOSITORY NOT ANYMORE IN USE, see readme
https://github.com/joomla-projects/GSOC-Webdriver_system_tests_for_CMS/blob/staging/README.md
GNU General Public License v2.0
0 stars 3 forks source link

Status of tests with Joomla 3.4 #96

Open javigomez opened 9 years ago

javigomez commented 9 years ago

This is the current result after running the tests on 3.4.

A big part of the errors is because com_weblinks has been removed so we can remove all the test related to com_weblinks. Maybe is a good opportunity to convert the current tests into codeception and place them at https://github.com/joomla-extensions/weblinks using http://mustached.org/

cc: @puneet0191 @kshitijSharma2014

I'm listing now the results. I recorded all the execution, is being uploaded to youtube. It will be available in the next hours:


Configuration read from /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/phpunit.xml.dist

.....................FF........F.........FE .FEEEE.EEEEEEEEEEEEE 63 / 170 ( 37%) ..........E.....F...F.....FF...FE.F...FEEE.EE..F............... 126 / 170 ( 74%) .F...................EF..F..................

Time: 1.22 hours, Memory: 26.75Mb

There were 26 errors:

1) TagManager0001Test::getAllInputFields_ScreenDisplayed_EqualExpected SeleniumClient\Http\SeleniumNoSuchElementException: An element could not be located on the page using the given search parameters. Unable to locate element: {"method":"xpath","selector":"//ul[@class='nav nav-tabs']//a[contains(@href, 'attrib-images')]"} For documentation on this error, please visit: http://seleniumhq.org/exceptions/no_such_element.html Build info: version: '2.43.1', revision: '5163bce', time: '2014-09-10 16:27:33' System info: host: 'JAVI.local', ip: '192.168.1.130', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.10.1', java.version: '1.6.0_65' Driver info: driver.version: unknown

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:73 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:26 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:350 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/TagManager0001Test.php:70

2) TagManager0001Test::addTag_WithFieldDefaults_TagAdded SeleniumClient\Http\SeleniumNoSuchElementException: An element could not be located on the page using the given search parameters. Unable to locate element: {"method":"xpath","selector":"//ul[@class='nav nav-tabs']//a[contains(@href, 'attrib-images')]"} For documentation on this error, please visit: http://seleniumhq.org/exceptions/no_such_element.html Build info: version: '2.43.1', revision: '5163bce', time: '2014-09-10 16:27:33' System info: host: 'JAVI.local', ip: '192.168.1.130', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.10.1', java.version: '1.6.0_65' Driver info: driver.version: unknown

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:73 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:26 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:350 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:338 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:356 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:382 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Components/TagManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/TagManager0001Test.php:114

3) TagManager0001Test::addTag_WithGivenFields_TagAdded SeleniumClient\Http\SeleniumNoSuchElementException: An element could not be located on the page using the given search parameters. Unable to locate element: {"method":"xpath","selector":"//ul[@class='nav nav-tabs']//a[contains(@href, 'attrib-images')]"} For documentation on this error, please visit: http://seleniumhq.org/exceptions/no_such_element.html Build info: version: '2.43.1', revision: '5163bce', time: '2014-09-10 16:27:33' System info: host: 'JAVI.local', ip: '192.168.1.130', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.10.1', java.version: '1.6.0_65' Driver info: driver.version: unknown

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:73 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:26 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:350 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:338 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:356 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:382 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Components/TagManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/TagManager0001Test.php:134

4) TagManager0001Test::editTag_ChangeFields_FieldsChanged SeleniumClient\Http\SeleniumNoSuchElementException: An element could not be located on the page using the given search parameters. Unable to locate element: {"method":"xpath","selector":"//ul[@class='nav nav-tabs']//a[contains(@href, 'attrib-images')]"} For documentation on this error, please visit: http://seleniumhq.org/exceptions/no_such_element.html Build info: version: '2.43.1', revision: '5163bce', time: '2014-09-10 16:27:33' System info: host: 'JAVI.local', ip: '192.168.1.130', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.10.1', java.version: '1.6.0_65' Driver info: driver.version: unknown

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:73 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:26 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:350 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:338 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:356 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:382 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Components/TagManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/TagManager0001Test.php:155

5) TagManager0001Test::changeTagState_ChangeEnabledUsingToolbar_EnabledChanged SeleniumClient\Http\SeleniumNoSuchElementException: An element could not be located on the page using the given search parameters. Unable to locate element: {"method":"xpath","selector":"//ul[@class='nav nav-tabs']//a[contains(@href, 'attrib-images')]"} For documentation on this error, please visit: http://seleniumhq.org/exceptions/no_such_element.html Build info: version: '2.43.1', revision: '5163bce', time: '2014-09-10 16:27:33' System info: host: 'JAVI.local', ip: '192.168.1.130', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.10.1', java.version: '1.6.0_65' Driver info: driver.version: unknown

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:73 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:26 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:350 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:338 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:356 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:382 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Components/TagManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/TagManager0001Test.php:167

6) TagManager0002Test::setFilter_SetFilterValues_ShouldExecuteFilter SeleniumClient\Http\SeleniumNoSuchElementException: An element could not be located on the page using the given search parameters. Unable to locate element: {"method":"xpath","selector":"//ul[@class='nav nav-tabs']//a[contains(@href, 'attrib-images')]"} For documentation on this error, please visit: http://seleniumhq.org/exceptions/no_such_element.html Build info: version: '2.43.1', revision: '5163bce', time: '2014-09-10 16:27:33' System info: host: 'JAVI.local', ip: '192.168.1.130', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.10.1', java.version: '1.6.0_65' Driver info: driver.version: unknown

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:73 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:26 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:350 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:338 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:356 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:382 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Components/TagManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/TagManager0002Test.php:76

7) TagManager0002Test::setFilter_TestFilters_ShouldFilterTags SeleniumClient\Http\SeleniumNoSuchElementException: An element could not be located on the page using the given search parameters. Unable to locate element: {"method":"xpath","selector":"//ul[@class='nav nav-tabs']//a[contains(@href, 'attrib-images')]"} For documentation on this error, please visit: http://seleniumhq.org/exceptions/no_such_element.html Build info: version: '2.43.1', revision: '5163bce', time: '2014-09-10 16:27:33' System info: host: 'JAVI.local', ip: '192.168.1.130', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.10.1', java.version: '1.6.0_65' Driver info: driver.version: unknown

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:73 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:26 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:350 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:338 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:356 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:382 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Components/TagManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/TagManager0002Test.php:95

8) TagManager0002Test::setFilter_TestFilters_ShouldFilterTags2 SeleniumClient\Http\SeleniumNoSuchElementException: An element could not be located on the page using the given search parameters. Unable to locate element: {"method":"xpath","selector":"//ul[@class='nav nav-tabs']//a[contains(@href, 'attrib-images')]"} For documentation on this error, please visit: http://seleniumhq.org/exceptions/no_such_element.html Build info: version: '2.43.1', revision: '5163bce', time: '2014-09-10 16:27:33' System info: host: 'JAVI.local', ip: '192.168.1.130', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.10.1', java.version: '1.6.0_65' Driver info: driver.version: unknown

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:73 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:26 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:350 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:338 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:356 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminEditPage.php:382 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Components/TagManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/TagManager0002Test.php:128

9) WeblinkManager0001Test::getAllInputFields_ScreenDisplayed_EqualExpected SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0001Test.php:44

10) WeblinkManager0001Test::constructor_OpenEditScreen_WeblinkEditOpened SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0001Test.php:44

11) WeblinkManager0001Test::getTabIds_ScreenDisplayed_EqualExpected SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0001Test.php:44

12) WeblinkManager0001Test::addWeblink_WithFieldDefaults_WeblinkAdded SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0001Test.php:44

13) WeblinkManager0001Test::addWeblink_WithGivenFields_WeblinkAdded SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0001Test.php:44

14) WeblinkManager0001Test::editWeblink_ChangeFields_FieldsChanged SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0001Test.php:44

15) WeblinkManager0001Test::changeWeblinkState_ChangeEnabledUsingToolbar_EnabledChanged SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0001Test.php:44

16) WeblinkManager0002Test::getFilters_GetListOfFilters_ShouldMatchExpected SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0002Test.php:45

17) WeblinkManager0002Test::setFilter_SetFilterValues_ShouldExecuteFilter SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0002Test.php:45

18) WeblinkManager0002Test::setFilter_TestFilters_ShouldFilterWeblinks SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_weblinks']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/WeblinkManager0002Test.php:45

19) ArticleManager0002Test::setFilter_TestFilters_ShouldFilterTags Undefined variable: resultObject

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:62 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminManagerPage.php:261 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminManagerPage.php:312 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/content/ArticleManager0002Test.php:119

20) ControlPanel0001Test::clickMenu_LoadBackendMenuLinks_LinksShouldLoad SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//button[contains(@onclick, 'option=com_help&keyref=Help')]'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:244 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/control_panel/ControlPanel0001Test.php:74

21) LanguageManager0001Test::addLanguage_WithGivenFields_LanguageAdded SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0001Test.php:135

22) LanguageManager0001Test::editLanguage_ChangeFields_FieldsChanged SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0001Test.php:159

23) LanguageManager0001Test::changeLanguageState_ChangeEnabledUsingToolbar_EnabledChanged SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0001Test.php:174

24) LanguageManager0002Test::setFilter_SetFilterValues_ShouldExecuteFilter SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0002Test.php:78

25) LanguageManager0002Test::setFilter_TestFilters_ShouldFilterTags SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0002Test.php:104

26) LevelManager0001Test::editLevel_ChangeFields_FieldsChanged Undefined variable: resultObject

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:62 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminManagerPage.php:200 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/System/AdminManagerPage.php:49 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/Users/LevelManagerPage.php:59 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/users/LevelManager0001Test.php:109

There were 16 failures:

1) ContactManager0002Test::setFilter_TestFilters_ShouldFilterContacts Contact should be in row 8 Failed asserting that false matches expected 8.

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/ContactManager0002Test.php:115

2) NewsFeedManager0001Test::getAllInputFields_ScreenDisplayed_EqualExpected Failed asserting that two arrays are equal. --- Expected +++ Actual @@ @@ 34 => Array (...)

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/NewsFeedManager0001Test.php:71

3) NewsFeedManager0002Test::setFilter_TestFilters_ShouldFilterTags NewsFeed should be in row 5 Failed asserting that false matches expected 5.

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/NewsFeedManager0002Test.php:114

4) RedirectManager0002Test::setFilter_TestFilters_ShouldFilterRedirect Redirect should not show Failed asserting that 1 is false.

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/RedirectManager0002Test.php:109

5) TagManager0001Test::getTabIds_ScreenDisplayed_EqualExpected Tab labels should match expected values. Failed asserting that two arrays are equal. --- Expected +++ Actual @@ @@ Array ( 0 => 'details' 1 => 'publishing' 2 => 'attrib-basic'

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/components/TagManager0001Test.php:101

6) ArticleManager0003Test::frontEndEditArticle_ChangeArticleText_ArticleTextChanged URL for page does not match expected value. Failed asserting that 'http://joomla.dev/repos/joomla-cms/index.php?view=form&layout=edit&a_id=85&return=aHR0cDovL2pvb21sYS5kZXYvcmVwb3Mvam9vbWxhLWNtcy9pbmRleC5waHA=' contains "/index.php/component/content/?view=form&layout=edit&a_id=".

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/Pages/SiteContent/SitePage.php:77 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/content/ArticleManager0003Test.php:259

7) CategoryManager0003Test::getAllInputFields_ScreenDisplayed_EqualExpected Failed asserting that two arrays are equal. --- Expected +++ Actual @@ @@ 21 => Array (...)

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/content/CategoryManager0003Test.php:72

8) CategoryManager0004Test::frontEndCategoryChange_ChangeCategoryState_CategoryStateChanged Article Must be present Failed asserting that false is true.

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/content/CategoryManager0004Test.php:68

9) CategoryManager0004Test::frontEndCategoryState_StateChangedToArchived_StateChanged Article Must be present Failed asserting that false is true.

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/content/CategoryManager0004Test.php:113

10) ControlPanel0001Test::doAdminLogin_NormalLogin_LogsIntoBackEnd Failed asserting that an array has the key 'All extensions are up-to-date'.

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/control_panel/ControlPanel0001Test.php:38

11) GlobalConfiguration0001Test::getAllInputFields_ScreenLoaded_InputFieldsShouldMatchExpected Failed asserting that two arrays are equal. --- Expected +++ Actual @@ @@ 49 => Array (...)

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/control_panel/GlobalConfiguration0001Test.php:54

12) LanguageManager0001Test::addLanguage_WithFieldDefaults_LanguageAdded Test lang should be in row 2 Failed asserting that 1 matches expected 2.

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0001Test.php:117

13) ModuleManager0001Test::getModuleTypes_GetsTypes_EqualsExpected Module types should equal expected Failed asserting that two arrays are equal. --- Expected +++ Actual @@ @@ 'client' => 'site'

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/extensions/ModuleManager0001Test.php:75

14) MenuItemsManager0001Test::getMenuItemTypes_ShouldMatchExpected Menu item type should match expected Failed asserting that two arrays are equal. --- Expected +++ Actual @@ @@ Array (

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/menus/MenuItemsManager0001Test.php:106

15) LevelManager0001Test::setFilter_TestOrdering_ShouldOrderLevels When the table is sorted by level name in the ascending order Public should be in row 3 Failed asserting that 4 matches expected 3.

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/users/LevelManager0001Test.php:142

16) UserManager0001Test::getAllInputFields_ScreenDisplayed_EqualExpected Failed asserting that two arrays are equal. --- Expected +++ Actual @@ @@ 11 => Array (

/Users/javiergomez/Documents/joomla-vagrant/www/repos/joomla-cms/tests/system/webdriver/tests/users/UserManager0001Test.php:71

FAILURES! Tests: 170, Assertions: 4550, Failures: 16, Errors: 26.

javigomez commented 9 years ago

The video of the session has been recorded here: https://www.youtube.com/watch?v=o5iiyy3FPaI (is 4x faster than real velocity), it will help to identify issues. Note that I missed to record the first part of the joomla installation.

Is still being processed by Youtube, I guess it will be available after some minutes. It is arround 18min long

kshitijSharma2014 commented 9 years ago

Thank you @javigomez ! I am also running the test suite now.

puneet0191 commented 9 years ago

@javigomez @kshitijSharma2014 for now, lets remove the @test tags from the tests of weblinks, we can later on remove the tests from the repository, I ran all the tests yesterday and the results were really horrible on my machine image

kshitijSharma2014 commented 9 years ago

@javigomez @puneet0191 Hi guys! Much of the failures and errors have been solved and within 2-3 days I will finish this work. There is one error coming. steps producing the error-

  1. Go to article Manager
  2. Click on "new" to add new article
  3. give the article a title and click "save and close".
  4. it will give the error page which I have attached in this comment. capture
puneet0191 commented 9 years ago

@kshitijSharma2014 The error that you are talking about is not recreatable at my end, I have just tested the same against the Latest code from Joomla/staging branch, try to do the same