search

matthewmueller / x-ray

The next web scraper. See through the <html> noise.
MIT License
5.87k stars 349 forks source link

Workaround for paginate when there is js in the href? #122

Closed shwaydogg closed 5 years ago

shwaydogg commented 8 years ago

The paginate method takes a selector, of course this is fine if the href is a straight link, but if it contains javascript then it won't work.

I'm looking for a way to either add regex or a function to get the paginate method the link it needs.

...Or a confirmation that pagination will just need to be written outside of x-ray in this case.

https://stackoverflow.com/questions/34459567/with-x-ray-is-there-a-workaround-for-paginate-when-there-is-js-in-the-href

Ramarti commented 8 years ago

+1 is there a way around this?

Kikobeats commented 8 years ago

Using a function solution could be fine!

lathropd commented 5 years ago

This may be part of the same issue in https://github.com/matthewmueller/x-ray/issues/54. Merging/closing for now.