I am encountering an issue when using exo with a setup involving two Macs connected via Thunderbolt. The problem occurs under the following conditions:
Setup:
Mac Studio (connected to the internet via Ethernet)
M2 MacBook Air (connected to the Mac Studio via Thunderbolt, but offline)
Behavior:
If both Macs are completely offline (i.e., not connected to any network), exo works as expected over Thunderbolt. However, if the Mac Studio is connected to the network (via Ethernet), and the MacBook Air is offline, the LLM request freezes.
I suspect that exo might be attempting to communicate with the offline MacBook Air over the network instead of using the Thunderbolt connection. This leads to the request freezing because the MacBook Air is not connected to the network.
Steps to Reproduce:
Connect a Mac Studio to the network using Ethernet.
Connect an M2 MacBook Air to the Mac Studio via Thunderbolt. Ensure the MacBook Air is offline (not connected to any network).
Run exo on the Mac Studio with the MacBook Air as part of the cluster.
Send a request to the LLM.
Observe that the request freezes.
Expected Behavior:
exo should prioritize the Thunderbolt connection to communicate with the offline MacBook Air and not attempt to use the network interface. The LLM request should be processed without freezing.
Actual Behavior:
exo appears to freeze the LLM request, potentially because it is trying to communicate over the network instead of using the Thunderbolt connection.
Additional Information:
exo version: Latest from main as of August 22, 2024
I am encountering an issue when using exo with a setup involving two Macs connected via Thunderbolt. The problem occurs under the following conditions:
Setup:
Mac Studio (connected to the internet via Ethernet)
M2 MacBook Air (connected to the Mac Studio via Thunderbolt, but offline)
Behavior:
If both Macs are completely offline (i.e., not connected to any network), exo works as expected over Thunderbolt. However, if the Mac Studio is connected to the network (via Ethernet), and the MacBook Air is offline, the LLM request freezes.
I suspect that exo might be attempting to communicate with the offline MacBook Air over the network instead of using the Thunderbolt connection. This leads to the request freezing because the MacBook Air is not connected to the network.
Steps to Reproduce:
Connect a Mac Studio to the network using Ethernet.
Connect an M2 MacBook Air to the Mac Studio via Thunderbolt. Ensure the MacBook Air is offline (not connected to any network).
Run exo on the Mac Studio with the MacBook Air as part of the cluster.
Send a request to the LLM.
Observe that the request freezes.
Expected Behavior:
exo should prioritize the Thunderbolt connection to communicate with the offline MacBook Air and not attempt to use the network interface. The LLM request should be processed without freezing.
Actual Behavior:
exo appears to freeze the LLM request, potentially because it is trying to communicate over the network instead of using the Thunderbolt connection.
Additional Information:
exo version: Latest from main as of August 22, 2024