Selector scrape by type

BuilderIO / gpt-crawler

Crawl a site to generate knowledge files to create your own custom GPT from a URL

https://www.builder.io/blog/custom-gpt

ISC License

18.16k stars 1.88k forks source link

Selector scrape by type #33

Open LcCompany opened 7 months ago

LcCompany commented 7 months ago

Is there a simple way to select all trxt or img or urls so the tool can be used for all sorts of websites instead of first inspecting all websites for the correct elements?