Open abhi12299 opened 1 month ago
@jacksondc @cbh123 your thoughts on this? is this something you'd want to see in melty?
Documentation would be awesome. I think we should start out by letting the user add an entire webpage into the context, since that will be relatively easy.
Down the road I would want to try giving Claude a search tool. I'm not opposed to trying RAG as well, but my hunch is that will be less useful.
@cbh123 what's the Mac app you use for documentation? Do you know what the data source is there?
Including an entire webpage would lead to context exhaustion relatively quickly.. also i noticed that currently the entire conversation is sent over to Claude, which means longer conversations are at a risk of context exhaustion especially after including images.. this is also something to work on
hey guys, I would love to contribute in this project. I just recently made a package called "SearchURL" that lets you search through webpages for certain keywords, as of now it does not have semantic search, but I was looking into it and could not find anthropic API (as it was mentioned in the issue) that converts chunks to text embeddings, in the anthropic docs they recommend Voyage AI . If you would like me to continue with that or some other plan, then please let me know. Just to clarify the package is written in python.
What?
Similar to Cursor AI's feature, we can add the ability for the user to be able to add links to any websites and allowing the LLM to reference them during the conversation.
How?
fetch
API (this may not be allowed on many websites, but we can implement a workaround by using a paid service like smartproxy's web scraper)Additionally, we can even display the references on the basis of which the LLM responded. This can be done by:
This is a typical RAG workflow, however, it is a feature which needs a lot of time to implement and get right. I would love to start working on this. This issue is meant to be a technical discussion on the implementation details.