Rife v4.14 lite

[netExtra]

I notice that in terms of GPU usage there is little difference between v4.14 and v4.14 lite. @WolframRhodium explained that this because new "grouped convolution" methods are being used. It's generating a whole lot of error like those below.

[01/16/2024-14:50:26] [I] Skipped setting output types for some layers. Check verbose logs for more details. [01/16/2024-14:50:26] [W] [TRT] Could not read timing cache from: C:/Program Files (x86)/SVP 4/rife\models\rife\rife_v4.14_lite.onnx.1920x1088_fp16_no-tf32_workspace8192_trt-9200_cudnn_I-fp16_O-fp16_NVIDIA-GeForce-RTX-4080_8ce99e37.engine.cache. A new timing cache will be generated and written. [01/16/2024-14:50:26] [I] [TRT] Global timing cache in use. Profiling results in this builder pass will be stored. [01/16/2024-14:50:44] [W] [TRT] Cache result detected as invalid for node: /block0/convblock/convblock.1/conv/Conv + block0.convblock.1.beta + /block0/convblock/convblock.1/Mul + /block0/convblock/convblock.1/Add + PWN(/block0/convblock/convblock.1/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aaf [01/16/2024-14:50:45] [W] [TRT] Cache result detected as invalid for node: /block0/convblock/convblock.2/conv/Conv + block0.convblock.2.beta + /block0/convblock/convblock.2/Mul + /block0/convblock/convblock.2/Add + PWN(/block0/convblock/convblock.2/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aaf [01/16/2024-14:50:45] [W] [TRT] Cache result detected as invalid for node: /block0/convblock/convblock.3/conv/Conv + block0.convblock.3.beta + /block0/convblock/convblock.3/Mul + /block0/convblock/convblock.3/Add + PWN(/block0/convblock/convblock.3/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aaf [01/16/2024-14:50:45] [W] [TRT] Cache result detected as invalid for node: /block0/convblock/convblock.4/conv/Conv + block0.convblock.4.beta + /block0/convblock/convblock.4/Mul + /block0/convblock/convblock.4/Add + PWN(/block0/convblock/convblock.4/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aaf [01/16/2024-14:50:46] [W] [TRT] Cache result detected as invalid for node: /block0/convblock/convblock.5/conv/Conv + block0.convblock.5.beta + /block0/convblock/convblock.5/Mul + /block0/convblock/convblock.5/Add + PWN(/block0/convblock/convblock.5/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aaf [01/16/2024-14:50:46] [W] [TRT] Cache result detected as invalid for node: /block0/convblock/convblock.6/conv/Conv + block0.convblock.6.beta + /block0/convblock/convblock.6/Mul + /block0/convblock/convblock.6/Add + PWN(/block0/convblock/convblock.6/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aaf [01/16/2024-14:50:47] [W] [TRT] Cache result detected as invalid for node: /block0/convblock/convblock.7/conv/Conv + block0.convblock.7.beta + /block0/convblock/convblock.7/Mul + /block0/convblock/convblock.7/Add + PWN(/block0/convblock/convblock.7/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aaf [01/16/2024-14:50:49] [W] [TRT] Cache result detected as invalid for node: /block1/convblock/convblock.1/conv/Conv + block1.convblock.1.beta + /block1/convblock/convblock.1/Mul + /block1/convblock/convblock.1/Add + PWN(/block1/convblock/convblock.1/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xad01c782980ed345 [01/16/2024-14:50:50] [W] [TRT] Cache result detected as invalid for node: /block1/convblock/convblock.2/conv/Conv + block1.convblock.2.beta + /block1/convblock/convblock.2/Mul + /block1/convblock/convblock.2/Add + PWN(/block1/convblock/convblock.2/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xad01c782980ed345 [01/16/2024-14:50:50] [W] [TRT] Cache result detected as invalid for node: /block1/convblock/convblock.3/conv/Conv + block1.convblock.3.beta + /block1/convblock/convblock.3/Mul + /block1/convblock/convblock.3/Add + PWN(/block1/convblock/convblock.3/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xad01c782980ed345 [01/16/2024-14:50:50] [W] [TRT] Cache result detected as invalid for node: /block1/convblock/convblock.4/conv/Conv + block1.convblock.4.beta + /block1/convblock/convblock.4/Mul + /block1/convblock/convblock.4/Add + PWN(/block1/convblock/convblock.4/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xad01c782980ed345 [01/16/2024-14:50:50] [W] [TRT] Cache result detected as invalid for node: /block1/convblock/convblock.5/conv/Conv + block1.convblock.5.beta + /block1/convblock/convblock.5/Mul + /block1/convblock/convblock.5/Add + PWN(/block1/convblock/convblock.5/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xad01c782980ed345 [01/16/2024-14:50:50] [W] [TRT] Cache result detected as invalid for node: /block1/convblock/convblock.6/conv/Conv + block1.convblock.6.beta + /block1/convblock/convblock.6/Mul + /block1/convblock/convblock.6/Add + PWN(/block1/convblock/convblock.6/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xad01c782980ed345 [01/16/2024-14:50:50] [W] [TRT] Cache result detected as invalid for node: /block1/convblock/convblock.7/conv/Conv + block1.convblock.7.beta + /block1/convblock/convblock.7/Mul + /block1/convblock/convblock.7/Add + PWN(/block1/convblock/convblock.7/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xad01c782980ed345 [01/16/2024-14:50:53] [W] [TRT] Cache result detected as invalid for node: /block2/convblock/convblock.1/conv/Conv + block2.convblock.1.beta + /block2/convblock/convblock.1/Mul + /block2/convblock/convblock.1/Add + PWN(/block2/convblock/convblock.1/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xcd1874fa76e36ecf [01/16/2024-14:50:53] [W] [TRT] Cache result detected as invalid for node: /block2/convblock/convblock.2/conv/Conv + block2.convblock.2.beta + /block2/convblock/convblock.2/Mul + /block2/convblock/convblock.2/Add + PWN(/block2/convblock/convblock.2/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xcd1874fa76e36ecf [01/16/2024-14:50:54] [W] [TRT] Cache result detected as invalid for node: /block2/convblock/convblock.3/conv/Conv + block2.convblock.3.beta + /block2/convblock/convblock.3/Mul + /block2/convblock/convblock.3/Add + PWN(/block2/convblock/convblock.3/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xcd1874fa76e36ecf [01/16/2024-14:50:54] [W] [TRT] Cache result detected as invalid for node: /block2/convblock/convblock.4/conv/Conv + block2.convblock.4.beta + /block2/convblock/convblock.4/Mul + /block2/convblock/convblock.4/Add + PWN(/block2/convblock/convblock.4/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xcd1874fa76e36ecf [01/16/2024-14:50:55] [W] [TRT] Cache result detected as invalid for node: /block2/convblock/convblock.5/conv/Conv + block2.convblock.5.beta + /block2/convblock/convblock.5/Mul + /block2/convblock/convblock.5/Add + PWN(/block2/convblock/convblock.5/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xcd1874fa76e36ecf [01/16/2024-14:50:55] [W] [TRT] Cache result detected as invalid for node: /block2/convblock/convblock.6/conv/Conv + block2.convblock.6.beta + /block2/convblock/convblock.6/Mul + /block2/convblock/convblock.6/Add + PWN(/block2/convblock/convblock.6/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xcd1874fa76e36ecf [01/16/2024-14:50:55] [W] [TRT] Cache result detected as invalid for node: /block2/convblock/convblock.7/conv/Conv + block2.convblock.7.beta + /block2/convblock/convblock.7/Mul + /block2/convblock/convblock.7/Add + PWN(/block2/convblock/convblock.7/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xcd1874fa76e36ecf [01/16/2024-14:50:58] [W] [TRT] Cache result detected as invalid for node: /block3/convblock/convblock.1/conv/Conv + block3.convblock.1.beta + /block3/convblock/convblock.1/Mul + /block3/convblock/convblock.1/Add + PWN(/block3/convblock/convblock.1/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aae [01/16/2024-14:50:58] [W] [TRT] Cache result detected as invalid for node: /block3/convblock/convblock.2/conv/Conv + block3.convblock.2.beta + /block3/convblock/convblock.2/Mul + /block3/convblock/convblock.2/Add + PWN(/block3/convblock/convblock.2/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aae [01/16/2024-14:50:59] [W] [TRT] Cache result detected as invalid for node: /block3/convblock/convblock.3/conv/Conv + block3.convblock.3.beta + /block3/convblock/convblock.3/Mul + /block3/convblock/convblock.3/Add + PWN(/block3/convblock/convblock.3/relu/LeakyRelu), LayerImpl: CaskConvolution, tactic: 0xecff17b04e8a0aae

[banjaminicc]

This issue should be on vs-mlrt. Not practical RIFE.

This should only be relevant if you used the provided inference framework here instead of vs-mrlt as it would be unclear whether the bandwidth limitation comes from TensorRT or Pytorch or different codes

[netExtra]

Wolfram suggested I put it in the authors page Is this not the authors page?

[banjaminicc]

Ah, I just think that if you want this to be more accurate it would be better to test the speeds using the implementation that hzwer provided

[netExtra]

Ah, I just think that if you want this to be more accurate it would be better to test the speeds using the implementation that hzwer provided

I just want to understand the errors. It doesn't affect the result but I want to have some idea of what they mean.

[WolframRhodium]

These warnings are not related to either accuracy or performance. They simply say that TensorRT cannot find previous profiling records (because these operations are new) and it need to start profiling later.

[netExtra]

These warnings are not related to either accuracy or performance. They simply say that TensorRT cannot find previous profiling records (because these operations are new) and it need to start profiling later.

OK so all of this is just part of the profiling process and since these records haven't been generated yet, they are kind of like cache misses.