search

BuilderIO / gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL
https://www.builder.io/blog/custom-gpt
ISC License
18.14k stars 1.88k forks source link

ERROR PlaywrightCrawler: Request failed and reached maximum retries. Navigation timed out after 60 seconds #140

Open Mytraas opened 5 months ago

Mytraas commented 5 months ago

Hi,

Thanks for this amazing tool !

My goal is to scrape the TypeScript documentation located at https://www.typescriptlang.org/docs.

However, I encountered an issue when trying to access page 121 specifically, which is found at https://www.typescriptlang.org/docs/handbook/classes.html.

It appears that the file is too lengthy to be parsed successfully. Capture d’écran 2024-01-17 à 17 01 47 Is there any possible solution or workaround for this problem?

I greatly appreciate your assistance.