responsible-ai-collaborative / aiid

The AI Incident Database seeks to identify, define, and catalog artificial intelligence incidents.
https://incidentdatabase.ai
Other
167 stars 35 forks source link

Automated support for finding incidents? #2972

Open davisjam opened 1 month ago

davisjam commented 1 month ago

From your website, it sounds like you might be doing manual incident curation at the moment. Would you be interesting in trying to collaborate on automating some aspect of the curation?

My lab recently put up this pre-print: https://arxiv.org/abs/2406.08221. We showed that, with a lot of prompting and coaxing, we could get ChatGPT to find news articles about software failures, filter out noise, and automatically taxonomize them. We can also identify and merge articles that "probably" are about the same actual event.

smcgregor commented 1 month ago

@kepae is OOO today, but I know I would be echoing him to say absolutely! I'll follow up on email. Let's leave this issue open to track.