Open VoVoR opened 1 year ago
Have you guys tried using your code to create a triton with TRT backend for Vision transformer models? I tried myself and got throughput less than pytorch bare inference
Have you guys tried using your code to create a triton with TRT backend for Vision transformer models? I tried myself and got throughput less than pytorch bare inference