tpppppub
commented
5 months ago Linux traffic control (tc) tool manages the traffic on a network interface. So you have to run the process inside a VM or docker container (which has virtual network interfaces) to use tc. Besides, using docker satisfies your demand of running benchmarks in one machine.
fionser
Hi. Dear Cheetah developers!
Currently, I am interested in evaluating the private inference cost of ResNet18 using the SecretFlow-SPU library. Since the flax resnet example simulates multiple parties via multiple processes within one machine (as said here ). To ensure a fair comparison, I have to simulate an LAN setting with specific bandwidth and ping latency ,but simulating such a network may need the use of docker or VMs. Is there a way to use the scripts/throttle.sh to do this within one machine, while free the use of docker or VMs?
My test environment is WLS2 and for SPU testing I usually launch two terminals in PyCharm. One for the SPU backend runtime:
and one for the inference.py.
For example, is it correct to run
sudo scripts/throttle.sh lanbefore I run the above commands? Do I need to launch another terminal to run this command in advance? Or run this command on which one of the above two terminals?Please forgive me for not being very familiar with the Linux traffic control tool. Sorry for taking your time. Thanks.
BTW, there are the following lines in the throttle.sh:
Why do I need to replace DEV specifically? Because in 2pc.json in SPU, there are several IPs and I am not sure about which one should be placed here. Thanks. If not, how can I get the IP (by
ip addror some way else?). Thx