feat: add adaptive crawler

jina-ai / reader

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/

https://jina.ai/reader

Apache License 2.0

7k stars 551 forks source link

Closed mapleeit closed 2 months ago