Open bely66 opened 11 months ago
In the benchmark of the model on Torch.compile and CudaSync Operations, It's benchmarked on different batch size.
Meanwhile the batch size was introduced when adding nested tensors and isn't available in the Segment Anything original repo
so how are we benchmarking with various batch sizes meanwhile it wasn't implemented yet
In the benchmark of the model on Torch.compile and CudaSync Operations, It's benchmarked on different batch size.
Meanwhile the batch size was introduced when adding nested tensors and isn't available in the Segment Anything original repo
so how are we benchmarking with various batch sizes meanwhile it wasn't implemented yet