allenai / scibert

A BERT model for scientific text.
https://arxiv.org/abs/1903.10676
Apache License 2.0
1.49k stars 217 forks source link

Data center location of TPUs used for SciBERT pre-training to estimate its CO2 emission #114

Open bflashcp3f opened 3 years ago

bflashcp3f commented 3 years ago

Hi,

I am trying to estimate the carbon footprint of SciBERT based on this Google paper, and many parameters actually depend on which Google data center the used TPUs come from. Is it possible to share the data center location (like Google Netherlands) where SciBERT was pre-trained here?

Thanks!