exo-explore / exo

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
GNU General Public License v3.0
14.25k stars 767 forks source link

Network discovery over VPN #363

Open amirvenus opened 3 weeks ago

amirvenus commented 3 weeks ago

Hi,

I have two Macs:

Mac Studio M2 Ultra running 24/7 in the office MacBook Pro M3 Max laptop as my day to day machine

I use OpenVPN to connect to the office network and I can then access the Mac Studio via SSH or Apple Remote Desktop on its 10.x.x.x IP and I can run exo and call the OpenAI-compliant HTTP/REST API endpoints on my laptop fine.

However, I expect to see both devices seeing each other when I run the exo command on each device but it seems that they never discover each other and each instance runs separately!

Please advise how I can configure it or if it is not a supported scenario at all.

Thanks!

larson-carter commented 3 weeks ago

@amirvenus I'm glad you opened this issue, this is something that I have been wanting to test in my research lab.

"However, I expect to see both devices seeing each other when I run the exo command on each device but it seems that they never discover each other and each instance runs separately!"

  • Understood, lets debug this.

Lets start with the most basic things:

"Mac Studio M2 Ultra running 24/7 in the office"

  • What is the IP, gateway, subnet, VLAN? "MacBook Pro M3 Max laptop as my day to day machine"
  • What is the IP, gateway, subnet, VLAN?

On your day to day machine (not in office) is it correctly running exo on that VPN interface?

I'm curious to see your answers to see if we can find a resolution. This should not be hard to configure.