One test failing and a warning

[javigomez]

Hi, I have merged the current joomla-cms in the branch to run the tests before doing the final squish. But I found a Failure and an error. Please see the video:

http://www.youtube.com/watch?v=y6Im5WFItTw

cc: @puneet0191

[kshitijSharma2014]

I have understood the problem, in the previous versions of Joomla in the details tab there were only 3 options available but now in this version there are more than 3 so I need to add the input fields in the newsfeededitPage.php. @javigomez can you please let me know which version of joomla you used while testing so that I can use it to modify the page file.

[puneet0191]

I think that is on the latest version, what is the reason for the error?

[kshitijSharma2014]

i cannot see the error in the video, only a failure is there.

[kshitijSharma2014]

@puneet0191 I just installed joomla 3.3 and in that newsfeeds have only 3 options in the details tab.

[kshitijSharma2014]

okay, got it they are in https://github.com/joomla/joomla-cms

[kshitijSharma2014]

where should i make the changes in the joomla-cms or in GSOC-Webdriver_System_tests_for_CMS?

[kshitijSharma2014]

@javigomez please let me know in which repo i should make the changes.

[javigomez]

Please use the branch witch you have been working: https://github.com/joomla-projects/GSOC-Webdriver_system_tests_for_CMS/ is already updated with today's status of Joomla-CMS see:

Make sure you test with this latest joomla to get all the errors. Actually there are more errors than what I previously mentioned. See the complete report:

PHPUnit 3.7.29 by Sebastian Bergmann.

Configuration read from /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/phpunit.xml.dist

.................E....F.................... .................... 63 / 170 ( 37%) .........E............................FEEE.EE.................. 126 / 170 ( 74%) .........................F..................

Time: 1.13 hours, Memory: 26.75Mb

There were 7 errors:

1) ContactManager0001Test::editContact_ChangeFields_FieldsChanged Undefined variable: resultObject

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:62 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminManagerPage.php:200 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminManagerPage.php:307 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/components/ContactManager0001Test.php:149

2) ArticleManager0002Test::setFilter_SetFilterValues_ShouldExecuteFilter SeleniumClient\Http\SeleniumStaleElementReferenceException: An element command failed because the referenced element is no longer attached to the DOM. Element is no longer attached to the DOM Command duration or timeout: 6 milliseconds For documentation on this error, please visit: http://seleniumhq.org/exceptions/stale_element_reference.html Build info: version: '2.41.0', revision: '3192d8a', time: '2014-03-27 17:17:32' System info: host: 'JAVI.local', ip: '192.168.1.130', os.name: 'Mac OS X', os.arch: 'x86_64', os.version: '10.9.4', java.version: '1.6.0_65' Session ID: a716c401-cf74-8747-a839-5ea3dfd676a9 Driver info: org.openqa.selenium.firefox.FirefoxDriver Capabilities [{platform=MAC, acceptSslCerts=true, javascriptEnabled=true, browserName=firefox, rotatable=false, locationContextEnabled=true, version=31.0, cssSelectorsEnabled=true, databaseEnabled=true, handlesAlerts=true, nativeEvents=false, webStorageEnabled=true, applicationCacheEnabled=true, takesScreenshot=true}]

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:83 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/Http/SeleniumAdapter.php:26 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:562 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebElement.php:76 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminManagerPage.php:255 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminManagerPage.php:302 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/content/ArticleManager0002Test.php:82

3) LanguageManager0001Test::addLanguage_WithGivenFields_LanguageAdded SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0001Test.php:135

4) LanguageManager0001Test::editLanguage_ChangeFields_FieldsChanged SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0001Test.php:159

5) LanguageManager0001Test::changeLanguageState_ChangeEnabledUsingToolbar_EnabledChanged SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0001Test.php:174

6) LanguageManager0002Test::setFilter_SetFilterValues_ShouldExecuteFilter SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0002Test.php:78

7) LanguageManager0002Test::setFilter_TestFilters_ShouldFilterTags SeleniumClient\WebDriverWaitTimeoutException: Timeout for specified condition caused by object of class: SeleniumClient\WebDriver, method invoked: findElement. Arguments: <By strategy: 'xpath', strategy factor '//ul/li/a[@href='index.php?option=com_languages&view=languages']'>,<1>

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriverWait.php:91 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/SeleniumClient/WebDriver.php:416 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/System/AdminPage.php:192 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/JoomlaWebdriverTestCase.php:83 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/Pages/Extensions/LanguageManagerPage.php:94 /Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0002Test.php:104

There were 3 failures:

1) NewsFeedManager0001Test::getAllInputFields_ScreenDisplayed_EqualExpected Failed asserting that two arrays are equal. --- Expected +++ Actual @@ @@ 34 => Array (...)

• 35 => Array (...)
• 36 => Array (...)
• 37 => Array (...)
• 38 => Array (...)
• 39 => Array (...)
• 40 => Array (...) )

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/components/NewsFeedManager0001Test.php:71

2) LanguageManager0001Test::addLanguage_WithFieldDefaults_LanguageAdded Test lang should be in row 2 Failed asserting that 1 matches expected 2.

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/extensions/LanguageManager0001Test.php:117

3) UserManager0001Test::getAllInputFields_ScreenDisplayed_EqualExpected Failed asserting that two arrays are equal. --- Expected +++ Actual @@ @@ 11 => Array (

• 'label' => 'Require Password Reset'
• 'id' => 'jform_requireReset'
• 'type' => 'fieldset'
• 'tab' => 'details'
• )
• 12 => Array ( 'label' => 'ID' 'id' => 'jform_id' 'type' => 'input' 'tab' => 'details' )
• 12 => Array (
• 13 => Array ( 'label' => 'Backend Template Style' 'id' => 'jform_params_admin_style' 'type' => 'select' 'tab' => 'settings' )
• 13 => Array (
• 14 => Array ( 'label' => 'Backend Language' 'id' => 'jform_params_admin_language' 'type' => 'select' 'tab' => 'settings' )
• 14 => Array (
• 15 => Array ( 'label' => 'Frontend Language' 'id' => 'jform_params_language' 'type' => 'select' 'tab' => 'settings' )
• 15 => Array (
• 16 => Array ( 'label' => 'Editor' 'id' => 'jform_params_editor' 'type' => 'select' 'tab' => 'settings' )
• 16 => Array (
• 17 => Array ( 'label' => 'Help Site' 'id' => 'jform_params_helpsite' 'type' => 'select' 'tab' => 'settings' )
• 17 => Array (
• 'label' => 'Time Zone'
• 'id' => 'jform_params_timezone'
• 'type' => 'select'
• 'tab' => 'settings'
• )
• 18 => Array (...) )

/Applications/XAMPP/xamppfiles/htdocs/testingsites/joomla-cms/tests/system/webdriver/tests/users/UserManager0001Test.php:71

FAILURES! Tests: 170, Assertions: 5337, Failures: 3, Errors: 7. logout

[Process completed]

[javigomez]

by the way, while doing the merge there was a conflict in .travis.yml. I resolved by using the current one in Joomla removing the Apache server. I will fix it.

[javigomez]

I have recorded all the tests. The video is 3 times faster than the real velocity to make it weight less. I think it will allow us to see the system tests in action and find any issue:

http://www.youtube.com/watch?v=jKYfK14V5cg