Optional Selector to limit link extraction to be within it

BuilderIO / gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL

https://www.builder.io/blog/custom-gpt

ISC License

18.15k stars 1.88k forks source link

Open monagjr opened 6 months ago

monagjr commented 6 months ago

Utilize the underlaying Crawlee's feature of limiting link extraction to specific part of the page by exposing it to config file