Only one GPU was used!

[ylxuer]

I have tried GAS.train for twice, but the same problem is only one gpu is used, even though I set all GPUs can be used. Is this really the case? Or what changes should I make?

[luofuli]

Yes, our code doesn't support multi-GPUs. But our code will request nearly all of the GPU memory of all GPUs to avoid memory fragmentation (since GPU has much less memory, it is more vulnerable to fragmentation). If you want to support multi-GPUs, see this example.

[ylxuer]

OK, thank you very much!