search

ProsusAI / finBERT

Financial Sentiment Analysis with BERT
Apache License 2.0
1.42k stars 413 forks source link

How can we launch the finebert_training on multiple servers #37

Closed ngobibibnbe closed 3 years ago

ngobibibnbe commented 3 years ago

I have seen that your training implementation of FinBERT supports distributed training. But how can we launch it on multiple servers ?

doguaraci commented 3 years ago

Hi, we haven't tried training on multiple servers. 🤗 Transformers have resources about this. I'd suggest checking them.

ngobibibnbe commented 3 years ago

Finally, i trained it on multiple machines within an Hadoop cluster using Horovod to distribute the training process with the allreduce strategy and store the dataset on HDFS. Thank you for your answer.