search

tunib-ai / parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
https://tunib-ai.github.io/parallelformers
Apache License 2.0
773 stars 61 forks source link

Cross-node inference #48

Open BDHU opened 1 year ago

BDHU commented 1 year ago

Is there any way to perform tensor parallelism across multiple nodes instead just in a single node? Any tips would be helpful!

sharlec commented 1 year ago

same asking here

YixinSong-e commented 1 year ago

same asking here :)

vinnitu commented 12 months ago

same asking here