search

czekan / liscraper

LinkedIn search results scraper
1 stars 0 forks source link

Failure when fetching html #3

Open cacaodev opened 7 years ago

cacaodev commented 7 years ago

Hi and thanks for your work.

I get this error in the console:

2017-07-30 09:35:14 [linkedin_spider] DEBUG: Successfully logged in.
2017-07-30 09:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkedin.com/voyager/api/search/cluster?count=10&guides=List()&keywords=lenormand&origin=GLOBAL_SEARCH_HEADER&q=guided&start=0> (referer: https://www.linkedin.com/)
2017-07-30 09:35:14 [linkedin_spider] DEBUG: Problem with parsing json data.
2017-07-30 09:35:14 [linkedin_spider] DEBUG: There has been problem with extracting search result
2017-07-30 09:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkedin.com/voyager/api/search/cluster?count=10&guides=List()&keywords=lenormand&origin=GLOBAL_SEARCH_HEADER&q=guided&start=40> (referer: https://www.linkedin.com/)
2017-07-30 09:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkedin.com/voyager/api/search/cluster?count=10&guides=List()&keywords=lenormand&origin=GLOBAL_SEARCH_HEADER&q=guided&start=10> (referer: https://www.linkedin.com/)
2017-07-30 09:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkedin.com/voyager/api/search/cluster?count=10&guides=List()&keywords=lenormand&origin=GLOBAL_SEARCH_HEADER&q=guided&start=20> (referer: https://www.linkedin.com/)
2017-07-30 09:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.linkedin.com/voyager/api/search/cluster?count=10&guides=List()&keywords=lenormand&origin=GLOBAL_SEARCH_HEADER&q=guided&start=30> (referer: https://www.linkedin.com/)
2017-07-30 09:35:15 [linkedin_spider] DEBUG: Problem with parsing json data.
czekan commented 7 years ago

Hi, That is weird because it works for me and I'm getting some results for your search keyword (lenormand). Does it work for other keywords or does it stop with the same error?

It may be hard to debug if I can't reproduce your problem.