add support for phi-2 - Githubissues

HeegyuKim / torch-xla-SPMD

Pytorch/XLA SPMD Test code in Google TPU

MIT License

19 stars 6 forks source link

Open ojus1 opened 8 months ago

ojus1 commented 8 months ago

Hello, I am new to using TPUs so I am not able to do this myself yet, but can you add support for partitioning phi-2?

IsNoobgrammer commented 7 months ago

I have implemented PHI-architecture using similar method

I will add a pr here too to update spmd_utils

HeegyuKim commented 5 months ago

Sorry for the late check, Nice framework! @IsNoobgrammer