In some rare cases, when the planets align just the right way, Clicking the SHOW_MORE_ABOUT button will actually redirect the page to LinkedIn jobs page.
Which when is in puppeteer view, overlaps with the Jobs link on the header.
This redirects the whole page to https://www.linkedin.com/jobs/ which makes the whole scraping process fail since it can't find any selectors in the jobs page.
In some rare cases, when the planets align just the right way, Clicking the
SHOW_MORE_ABOUTbutton will actually redirect the page to LinkedIn jobs page.In this case, this selector
Makes the browser click the following element
Which when is in puppeteer view, overlaps with the Jobs link on the header.
This redirects the whole page to
https://www.linkedin.com/jobs/which makes the whole scraping process fail since it can't find any selectors in the jobs page.