Open gtsueng opened 2 months ago
Results of investigation into Human biology: https://docs.google.com/spreadsheets/d/12NAPPzntfVXzDSLMlKgkbNMl6l_6kL-4mAryX2vmMS0/edit?gid=0#gid=0
At least for Human biology
, the we can use the following inclusion criteria to reduce the bias:
Include 'Human biology' only if one of these other topicCategory
values is included:
Issue Name
GPT topicCategory hallucinations
Issue Description
Records with topicCategory hallucinations | hallucinated topicCategory https://data-staging.niaid.nih.gov/resources?id=zenodo_8112069 | Human biology https://data-staging.niaid.nih.gov/resources?id=zenodo_7574524 | Human biology https://data-staging.niaid.nih.gov/resources?id=zenodo_5001210 | Human biology https://data-staging.niaid.nih.gov/resources?id=zenodo_7104970 | Human biology https://data-staging.niaid.nih.gov/resources?id=zenodo_6139140 | Human biology https://data-staging.niaid.nih.gov/resources?id=zenodo_6787653 | Human biology https://data-staging.niaid.nih.gov/resources?id=zenodo_8009444 | Human biology https://data-staging.niaid.nih.gov/resources?id=zenodo_2629148 | Human biology https://data-staging.niaid.nih.gov/resources?id=zenodo_7226308 | Human biology https://data-staging.niaid.nih.gov/resources?id=mendeley_89d2d85g9s | Human biology https://data-staging.niaid.nih.gov/resources?id=dataverse_10.7910_dvn_meudnp | Human biology https://data-staging.niaid.nih.gov/resources?id=dataverse_10.7910_dvn_mh3osr | Human biology https://data-staging.niaid.nih.gov/resources?id=dataverse_10.7910_dvn_qupdyi | Human biology https://data-staging.niaid.nih.gov/resources?id=mendeley_gbypg9zky3 | Human biology
It appears that GPT is overly prescribing the
Human biology
topicCategory to any documents mentioning humans, including human impact on the environment.To do:
Related issues
https://github.com/NIAID-Data-Ecosystem/nde-metadata-corrections/issues/20
Issue Discussion
No response
Please select the type of metadata improvement
Meta URL
No response
Related WBS task
https://github.com/NIAID-Data-Ecosystem/nde-roadmap/issues/4
For internal use only. Assignee, please select the status of this issue
Status Description
No response
Request status check list