Multi GPU training? - Githubissues

microsoft / rat-sql

A relation-aware semantic parsing model from English to SQL

https://arxiv.org/abs/1911.04942

MIT License

406 stars 117 forks source link

Multi GPU training? #36

Open samhodge opened 3 years ago

samhodge commented 3 years ago

I have started to experiment with training this model and it seems that it can make use of a large batchsize, but even then the training times are quite long.

Are there any plans to make this project multi GPU using dataparallel or dataparallelprocessing

Sam