BuilderIO / gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL
https://www.builder.io/blog/custom-gpt
ISC License
18.13k stars 1.88k forks source link

how to crawler this site?match not work #159

Open tom6q6 opened 3 months ago

tom6q6 commented 3 months ago

https://element-plus.org/zh-CN/component/button.html. this is my config.................There is no single portal to this site,l want to use the config of match to solve this problem,but not way. export const defaultConfig: Config = { url: "https://element-plus.org/zh-CN/component/overview.html", match:['https://element-plus.org/zh-CN/component/*.html'], maxPagesToCrawl: 350, outputFileName: "output.json", maxTokens: 200000000000, selector: #page-content > div > div };

lei195827 commented 3 weeks ago

老哥这个你会用了吗?我让GPT写的一些match规则也没起作用