wellcometrust / grants_tagger

Tag grants with MeSH and other tags
MIT License
12 stars 4 forks source link

Model predictions are erratic #250

Closed AndreiXYZ closed 1 year ago

AndreiXYZ commented 1 year ago

Model predicts roughly the same probability for all tags. This indicates an issue with the saving/loading of the weights on disk.

nsorros commented 1 year ago

Can you share a script that replicates this so that it can be reproduced and resolved

AndreiXYZ commented 1 year ago

Can you share a script that replicates this so that it can be reproduced and resolved

grants_tagger predict "Plant-based repellents have been used for generations in traditional practice as a personal protection measure against host-seeking mosquitoes. Knowledge on traditional repellent plants obtained through ethnobotanical studies is a valuable resource for the development of new natural products. Recently, commercial repellent products containing plant-based ingredients have gained increasing popularity among consumers, as these are commonly perceived as “safe” in comparison to long-established synthetic repellents although this is sometimes a misconception. To date insufficient studies have followed standard WHO Pesticide Evaluation Scheme guidelines for repellent testing. There is a need for further standardized studies in order to better evaluate repellent compounds and develop new products that offer high repellency as well as good consumer safety. This paper presents a summary of recent information on testing, efficacy and safety of plant-based repellents as well as promising new developments in the field." Wellcome/WellcomeBertMesh --threshold 0.5