search

BuilderIO / gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL
https://www.builder.io/blog/custom-gpt
ISC License
18.14k stars 1.88k forks source link

Add for a selector to exclude elements in the site #134

Open razaanstha opened 5 months ago

razaanstha commented 5 months ago

The current implementation is impressive, but it would be even more beneficial to have feature that allows for the exclusion of certain elements. This would be particularly useful for ignoring elements like cookie pop-ups and so. While I did check the existing selector functionality, my requirement is to specifically exclude items that are within the selecter element.

NonSenZ21 commented 5 months ago

I agree ! Something usefull too would be to be able to select multiple selectors (with OR opérator) and to use the entire body if no selector is found in the page. During my testing sessions, the script failed if no selector is found in the page... which is annoying because all pages in a website are not always built the same way !