search

worldbank / REaLTabFormer

A suite of auto-regressive and Seq2Seq (sequence-to-sequence) transformer models for tabular and relational synthetic data generation.
https://worldbank.github.io/REaLTabFormer/
MIT License
212 stars 24 forks source link

Multi-GPU training #56

Open vinay-k12 opened 11 months ago

vinay-k12 commented 11 months ago

I was trying to run training on multiple GPU servers in AWS, but it is not training as expected. Is there a way to enable this?

efstathios-chatzikyriakidis commented 9 months ago

Hi there!

Yes, it seems now that for some reason it is not working while n the past training was utilizing multi-GPU.

Can anyone verify this as well?

@avsolatorio, maybe it is because FrozenSeq2SeqTrainer was replaced with Seq2SeqTrainer?

Thanks!