I'd like to dynamically use different sizes of a 3D tensor based on how much device memory (video ram, regular ram, fpga memory, etc) is available at one time.
There seems to be a few functions adjacent to this, device_mem_info, etc. Nothing seems to provide device memory size, which is what I need to know.
Hello,
I'd like to dynamically use different sizes of a 3D tensor based on how much device memory (video ram, regular ram, fpga memory, etc) is available at one time.
There seems to be a few functions adjacent to this,
device_mem_info
, etc. Nothing seems to provide device memory size, which is what I need to know.Thank you