archignes / searchevals

This is a resource for collecting and exploring a range of open (publicly-available) search evaluations.
https://searchevals.com
1 stars 0 forks source link

Add a field for an editors note or comment. #61

Open danielsgriffin opened 4 months ago

danielsgriffin commented 4 months ago

Ex. /card/what-are-the-new-features-in-python-3-12-aravsrinivas Perhaps there are structures fields that would make this more clear, but an editors comment could make clear that the comparison here is the free version of Perplexity AI v. the free version of ChatGPT. Folks in reply to the original eval seem to suggest the comparison is not fair because it 3.5 is not able to browse but 4 is. That seems to be the point itself.

danielsgriffin commented 4 months ago

This could alternatively be called a moderator's note or annotator's note. Or a note, then simply link it with another identity, perhaps of an evaluator themselves (in this case, me)