search

DKarap / web-driver

crawler that use the webdriver, ghostdriver/phantomJS
0 stars 1 forks source link

GhostDriver isDisplayed() behaves different than firefox #21

Closed DKarap closed 10 years ago

DKarap commented 10 years ago

this is problem because we lose important elements: @check search button at => http://www.careers.macquarie.com/jobSearch.asp?stp=WEBSITE&lLocationGroupID_Expand=1

DKarap commented 10 years ago

is this url(http://www.avecodebondt.nl/86/werken-bij/vacatures/) we get only the SEMANTIC links that are shown and not the ones last in the list and hidden.With firefox this didnt happened

we may need to use Scroll??

DKarap commented 10 years ago

check the record text of abn: http://www.abnamro.com/nl/carriere/vacatures/index.html ghostdriver detects the

elements as not displayed

THIS IS SOLVED BY MAXIMIZING THE BROWSER WINDOW:)

DKarap commented 10 years ago

check if is solved by maximized the browser window...

DKarap commented 10 years ago

This is a phantomJs issue: https://github.com/detro/ghostdriver/issues/269

DKarap commented 10 years ago

Documentation about when an element is visible in webdriver: http://www.w3.org/TR/webdriver/#determining-visibility

DKarap commented 10 years ago

HtmlUnit works correctly in a single page but when we use it as driver in the crawler is dead...

DKarap commented 10 years ago

Another failed to find link case: http://www.holtcat.com/careers.aspx