search

linkedtales / scrapedin

LinkedIn Scraper (currently working 2020)
Apache License 2.0
597 stars 174 forks source link

Error: LinkedIn website changed and scrapedin can't read basic data. Please report this issue at https://github.com/linkedtales/scrapedin/issues #43

Closed swozanthroop closed 5 years ago

swozanthroop commented 5 years ago

Just running this for the first time and received that error message with the second profile I scraped. Removed the actual profile for obvious reasons.

Here's the total error message:

(node:1944) UnhandledPromiseRejectionWarning: ReferenceError: relatedProfiles is not defined at crawl (C:\Program Files\nodejs\scrapedin-linkedin-crawler-master\src\crawler.js:31:55) at runMicrotasks () at processTicksAndRejections (internal/process/task_queues.js:93:5) (node:1944) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 1) (node:1944) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code. scrapedin: 2019-10-23T18:01:11.285Z info: [profile] finished scraping url: https://www.linkedin.com/in/xxxxxxxxxxxxxxxxxx scrapedin: 2019-10-23T18:01:11.287Z error: [cleanMessageData] LinkedIn website changed and scrapedin can't read basic data. Please report this issue at https://github.com/linkedtales/scrapedin/issues 2019-10-23T18:01:11.290Z error: error on crawling profile: https://www.linkedin.com/in/xxxxxxxxxxxxxxx Error: LinkedIn website changed and scrapedin can't read basic data. Please report this issue at https://github.com/linkedtales/scrapedin/issues (node:1944) UnhandledPromiseRejectionWarning: ReferenceError: relatedProfiles is not defined at crawl (C:\Program Files\nodejs\scrapedin-linkedin-crawler-master\src\crawler.js:31:55) at processTicksAndRejections (internal/process/task_queues.js:93:5) (node:1944) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 2)

syshex commented 5 years ago

I have the same problem

leonardiwagner commented 5 years ago

@swozanthroop and @syshex this error is from another project: scrapedin-linkedin-crawler please update your crawler.js code

mohd7469 commented 4 years ago

@leonardiwagner i am still confuse for this point

this error is from another project: scrapedin-linkedin-crawler please update your crawler.js code

can you explain what is scrapedin and what is scrapedin-linkedin-crawler, what are the difference ? both are different repos ?