Open LambdaGuard opened 1 month ago
Hello! I am using LLaMA and I notice that you provide some distribute tools in distributed.py, while I did not find scripts to run parallel validating. Could you provide how to run inference on distributed GPUs? Thank you!
distributed.py
Hello! I am using LLaMA and I notice that you provide some distribute tools in
distributed.py
, while I did not find scripts to run parallel validating. Could you provide how to run inference on distributed GPUs? Thank you!