search

StampyAI / stampy-chat

Conversational chatbot to answer questions about AI Safety & Alignment based on information retrieved from the Alignment Research Dataset
https://chat.stampy.ai
MIT License
13 stars 7 forks source link

Link to private LW post #48

Open FraserLee opened 1 year ago

FraserLee commented 1 year ago

Link [2] in the following screenshot seems to be unavailable. I'm not aware - is this something we're checking for when we re-process the ARD?

Screenshot 2023-07-05 at 1 59 49 AM Screenshot 2023-07-05 at 2 00 07 AM
ccstan99 commented 1 year ago

I suspect we'll start having lots of issues like this as we start doing more testing. This particular example probably won't be a problem with the new ARD but it exposes a certain class of problems. The ARD ensures urls are well-formed but it's possible for links to get deleted after they've been scraped and embedded, which is likely what happened here, so this might require a separate check later.

To keep things consolidated, I've created a form https://bit.ly/stampy-chat-issues which tracks problematic outputs on our stampy-chat-test gsheet problems_reported tab and also added this examples to benchmark questions to monitor.

Ideally, we'd like to have a thumbs down or flag button for people to mark, automatically log and leave a quick comment of the problem/expected output. Until that's in place, this keeps us from losing important feedback.