Open nepomny opened 1 year ago
For example, LangChain has a loader for Hacker News (https://python.langchain.com/en/latest/modules/indexes/document_loaders/examples/hn.html) and for College Confidential (https://python.langchain.com/en/latest/modules/indexes/document_loaders/examples/college_confidential.html). Is it possible to enhance the retrieval plugin to embed the content from these websites ?
Can you explain little more about the loader for web pages?