Support learning URLs - Githubissues

jupyterlab / jupyter-ai

A generative AI extension for JupyterLab

https://jupyter-ai.readthedocs.io/

BSD 3-Clause "New" or "Revised" License

3k stars 299 forks source link

Support learning URLs #291

Open dlqqq opened 11 months ago

dlqqq commented 11 months ago

Problem

Right now, /learn is limited to learning local files. It would be nice if we removed the need for locally downloading knowledge data and instead implemented support for /learn to directly accept a URL.

Proposed Solution

Implement web crawling of URLs passed to /learn.

JasonWeill commented 11 months ago

By "web crawling," do you mean crawling a single page, or (optionally) crawling pages linked from a specified URL as well?