Review the user agent headers

SuLab / scheduled-bots

GeneWiki Scheduled Bots

MIT License

9 stars 15 forks source link

Review the user agent headers #39

Closed andrawaag closed 5 years ago

andrawaag commented 5 years ago

As per:

https://lists.wikimedia.org/pipermail/wikidata/2019-June/013161.html
https://meta.wikimedia.org/wiki/User-Agent_policy

The Wikidata Integrator ItemEngine supports setting User-agent. Given the announcement above on the Wikidata Mailing list it make sense to review if all our bots are set properly wrt user agents

andrawaag commented 5 years ago

[ ] CGI
[ ] CIViC
[ ] Disease_Ontology
[ ] Gene_Ontology
[ ] GeneBot_AGR
[ ] GeneBot_Homo_sapiens
[ ] GeneBot_microbes
[ ] GeneDiseaseBot
[ ] GOProtein_Bot
[ ] IEDB_ChEB
[ ] Interpro_Items
[ ] Interpro_Proteins
[ ] OrthologBot
[ ] ProteinBot_AGR
[ ] ProteinBot_homo_sapiens
[ ] ProteinBot_microbes
[ ] Wikipathways

andrawaag commented 5 years ago

The default WDI header already contains quite a good user agent header. i.e. Wikidata Integrator + version + user account