StampyAI / stampy-ui

AI Safety Q&A web frontend
https://aisafety.info
MIT License
34 stars 9 forks source link

Incorrect author for citations #696

Open bryceerobertson opened 1 month ago

bryceerobertson commented 1 month ago

e.g. plex is listed as the author of this video (https://www.youtube.com/watch?v=zc4gKH6xTBw), but he most definitely isn't.

Image

zarSou9 commented 1 month ago

@mruwnik do you know why this might be?

mruwnik commented 1 month ago

yes. It's because it's from his YT channel. It might be worth not showing the author for YT videos. Or fixing the scraper would be even better

bryceerobertson commented 3 weeks ago

@melissasamworth I've seen other incorrect citations, like this article. I think this issue should be P0.

Ryan-Knowles commented 3 weeks ago

@bryceerobertson going to look into this and take a shot at a fix

mruwnik commented 3 weeks ago

This is caused by how the ARD looks for YT authors here. These vidoes are from plex's playlist, so he gets credited as the author

mruwnik commented 3 weeks ago

Myles has a hacky short term solution here, which is to just not show YT authors

bryceerobertson commented 3 weeks ago

The problem is I've seen it also happen for non-YouTube sources like https://arbital.com/p/general_intelligence/, which shows Eric and Eliezer as joint authors

mruwnik commented 3 weeks ago

yup. That's correct

Image

https://huggingface.co/datasets/StampyAI/alignment-research-dataset/raw/main/arbital.jsonl

I'd show it from arbital, but it requires being logged in:

Image

bryceerobertson commented 3 weeks ago

Ah right, I thought it must be wrong haha. Ok good, so it's only YouTube then :)