dtrungtin / actor-booking-scraper

Actor for extracting data about hotels from Booking.com
https://apify.com/dtrungtin/booking-scraper
Apache License 2.0
17 stars 19 forks source link

Pagination doesn't work on region / country level hotel list #8

Closed vinnydis closed 4 years ago

vinnydis commented 4 years ago

When handing the page that shows all hotels in a country (in this case with filters, but reproducible for the unfiltered one, too) it extracts the first page, but the pagination doesn't work.

https://my.apify.com/tasks/JraRQpybELy44c8CN#/runs/xLH4YXCa52QyeaBLk

Here's the input:

{
  "startUrls": [
    {
      "url": "https://www.booking.com/searchresults.en-gb.html?aid=356980&label=gog235jc-1FCAIouwE4EkgzWANoZ4gBAZgBCbgBB8gBDNgBAegBAfgBDIgCAagCA7gC25z-9gXAAgHSAiQ3NmQ1NmJlYy0yYjlmLTRjNzItOGQ3My0wOWQ3YTEyYjBiMTTYAgbgAgE&sid=abd941fed66d95d8f81172211ad2deec&tmpl=searchresults&checkin_year_month_monthday=2020-08-15&checkout_year_month_monthday=2020-08-16&class_interval=1&dest_id=171&dest_type=country&group_adults=2&group_children=0&label_click=undef&no_rooms=1&percent_htype_hotel=1&raw_dest_type=country&room1=A%2CA&sb_price_type=total&shw_aparth=1&slp_r_match=0&srpvid=b2625ec6b4960044&ssb=empty&top_ufis=0&nflt=class%3D4%3Bclass%3D5%3Bht_id%3D204%3Bht_id%3D206%3B&rsf=",
      "method": "GET"
    }
  ],
  "sortBy": "bayesian_review_score",
  "currency": "ARS",
  "language": "en-gb",
  "minMaxPrice": "none",
  "propertyType": "none",
  "proxyConfig": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "SHADER"
    ]
  },
  "simple": true,
  "useFilters": false,
  "testProxy": false,
  "extendOutputFunction": "($) => { return {} }"
}

Couldn't quite figure out where things are going wrong, the pagination looks similar to the same.

metalwarrior665 commented 4 years ago

Thanks a lot for the report, we need to fix this.