crawlee page.goto function used for navigation will always give null response for URLs with hash fragment as it treats hash navigation as single page reload.
page.goto returns response when running locally. If we build and create npm package for cli and then do npm install for package it gives null response while navigating for URLs with hash fragment. This PR is to handle the null check for hash URLs and do not mark it as navigation error.
Steps to Test
yarn build
yarn run pack
npm install cli.tgz (generated by above step)
test the crawling command.
Motivation
Feature 2114928: ADO Extension should be able to crawl hash-routing SPA apps
Context
Pull request checklist
[n/a] Addresses an existing issue: Fixes #0000
[x] Added relevant unit test for your changes. (yarn test)
[x] Verified code coverage for the changes made. Check coverage report at: <rootDir>/test-results/unit/coverage
Details
crawlee page.goto function used for navigation will always give null response for URLs with hash fragment as it treats hash navigation as single page reload.
page.goto returns response when running locally. If we build and create npm package for cli and then do npm install for package it gives null response while navigating for URLs with hash fragment. This PR is to handle the null check for hash URLs and do not mark it as navigation error.
Steps to Test
Motivation
Feature 2114928: ADO Extension should be able to crawl hash-routing SPA apps
Context
Pull request checklist
yarn test)<rootDir>/test-results/unit/coverageyarn precheckin)