Is it possible to run REalTabFormer on AWS Inferentia and Trainium VM instances?

worldbank / REaLTabFormer

A suite of auto-regressive and Seq2Seq (sequence-to-sequence) transformer models for tabular and relational synthetic data generation.

https://worldbank.github.io/REaLTabFormer/

MIT License

212 stars 24 forks source link

Is it possible to run REalTabFormer on AWS Inferentia and Trainium VM instances? #58

Open efstathios-chatzikyriakidis opened 10 months ago

efstathios-chatzikyriakidis commented 10 months ago

Hi @avsolatorio,

Recently, I came accross AWS Inferentia and AWS Trainium that AWS claim to be 70% cheaper and with 2.3xx higher throughput than GPU based VMs. I was wondering if REalTabFormer can run on those isntances as-is without changes in code and if it worth to explorer further.

Could you please suggest?

Thanks!