BuilderIO / gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL
https://www.builder.io/blog/custom-gpt
ISC License
18.14k stars 1.88k forks source link

How to crawl https://zod.dev/ ? #124

Open MontiL opened 6 months ago

MontiL commented 6 months ago

I cannot crawl doc from https://zod.dev/ But it works on https://nextjs.org/docs Any suggestion ? Thank you in advance

StreamlinedStartup commented 5 months ago

Couldn't figure it out, but also didn't try too hard. Since the docs are replicated here - https://github.com/colinhacks/zod - I just did that with selector .markdown-body.

SimonGodefroid commented 4 months ago

Just in case... you can access the docs from the README.md since... The Zod documentation lives in the README.md.