search

BuilderIO / gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL
https://www.builder.io/blog/custom-gpt
ISC License
18.15k stars 1.88k forks source link

FR: preserve links #74

Open dandv opened 7 months ago

dandv commented 7 months ago

output.json supports markdown links. This is super useful to point users to further information.

Try crawling this Notion site for example (selector .layout) and prompt "How do I make the best of NC12". The answer will instruct you to join the Telegram chat and FB group, but the links for those are lost.

The crawler should convert a links to Markdown links.