joshpxyne / gpt-migrate

Easily migrate your codebase from one framework or language to another.
https://gpt-migrate.com
MIT License
6.87k stars 485 forks source link

Add distributed inference #53

Open rlippmann opened 7 months ago

rlippmann commented 7 months ago

Hi,

I've been looking to write something like this project myself. I've been researching how I would do source conversion, but distributed. It seems like you've done most of the heavy lifting for the general conversion, so it seems like it would be a good idea for me to contribute to this project instead of starting from scratch.

I saw that this project had some integration with litellm, so the distributed part can be done using that. I've also written some code to split source files up intelligently which could be used with this.

Is this project still active? If so, I would love to discuss more about contributing.