worldbank / REaLTabFormer

A suite of auto-regressive and Seq2Seq (sequence-to-sequence) transformer models for tabular and relational synthetic data generation.
https://worldbank.github.io/REaLTabFormer/
MIT License
200 stars 23 forks source link

Multi-GPU training #56

Open vinay-k12 opened 8 months ago

vinay-k12 commented 8 months ago

I was trying to run training on multiple GPU servers in AWS, but it is not training as expected. Is there a way to enable this?

efstathios-chatzikyriakidis commented 6 months ago

Hi there!

Yes, it seems now that for some reason it is not working while n the past training was utilizing multi-GPU.

Can anyone verify this as well?

@avsolatorio, maybe it is because FrozenSeq2SeqTrainer was replaced with Seq2SeqTrainer?

Thanks!