drivendataorg / deon

A command line tool to easily add an ethics checklist to your data science projects.
https://deon.drivendata.org/
MIT License
288 stars 52 forks source link

Consider adding a set of LLM-specific considerations (or a worked example w an LLM) #167

Open hannahmoro opened 9 months ago

hannahmoro commented 9 months ago

We may want to elaborate on the default checklist items, create a new checklist, or add an example that focuses on ethical considerations that are unique to LLMs or that are particularly acute with LLMs. For example, considerations related to privacy (sending private data to an API endpoint, de-anonymization via embeddings), misinformation, hateful or offensive speech,...

leannmendoza commented 7 months ago

Great idea to consider adding AI Guardrails to the checklist, especially for LLM development. Some considerations to be added to the checklist are defined here: https://github.com/guardrails-ai/guardrails.git

klwetstone commented 7 months ago

I think our existing list of questions is high level enough that it covers most of what needs to be discussed for LLMs. I like the idea of a tool-specific list of key ethical considerations, but I'm not sure where it would go in the current Deon structure. It may be a broader resource we want to add, and could include LLMs and other model types / tools - maybe we add another section under "custom checklists" with "Tool-specific considerations"

I'd break this down as :