openai / chatgpt-retrieval-plugin

The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.
MIT License
21.07k stars 3.68k forks source link

Any plans to include a loader for web pages ? #164

Open nepomny opened 1 year ago

PacificG commented 1 year ago

Can you explain little more about the loader for web pages?

nepomny commented 1 year ago

For example, LangChain has a loader for Hacker News (https://python.langchain.com/en/latest/modules/indexes/document_loaders/examples/hn.html) and for College Confidential (https://python.langchain.com/en/latest/modules/indexes/document_loaders/examples/college_confidential.html). Is it possible to enhance the retrieval plugin to embed the content from these websites ?