bigscience-workshop / petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
https://petals.dev
MIT License
8.89k stars 490 forks source link

Reachability issue while connecting to private swarm #562

Closed CherukupalleNaveen closed 3 months ago

CherukupalleNaveen commented 3 months ago

I have run DHT on a VM (not the docker way). When I am connecting the peers, I am able to see it in the monitor but not reachable. Neither they are reachable nor able to inference.

mryab commented 3 months ago

Hi @CherukupalleNaveen, did you manage to resolve the issue? :)