search

StampyAI / stampy-chat

Conversational chatbot to answer questions about AI Safety & Alignment based on information retrieved from the Alignment Research Dataset
https://chat.stampy.ai
MIT License
13 stars 6 forks source link

Support paper/blog searches #36

Open ccstan99 opened 1 year ago

ccstan99 commented 1 year ago

Support paper/blog search answering questions like: What are some recent/new/popular papers/blogs? What was the paper/blog about X, by Y, from Z?

ccstan99 commented 1 year ago

Embedding the summary keys might help with this. We can generate synthetic summaries for those without human summaries. AllenAI's SPECTER embeddings were trained to match title & arxiv abstracts. To use it we'd need separate pinecone index & namespace since its a SentenceTransformer so embedding dimensions don't match OpenAI's.