-
Thanks for sharing the repo . It is really helpful.
I'm exploring ways to do the optimization on GPU. I know its not presently supported. Could you share some approach or references to implement th…
-
Hello,
I am trying to perform a QAT on a ResNet50 network with BN layers, and I keep getting the following error:
```
ValueError: Shape must be rank 4 but is rank 5 for '{{node batch_normalization_…
-
A common problem with the documents I've been working on at my new role is the incessant use of the '/' as a conjunction, to replace a comma or other such prepositions like 'to.' The breadth of this g…
-
I am experiencing a similar issue to #1464
I have a locally trained model efficientdet-lite1 and have exported to onnx and then tensorrt using the methods described in the [readme](https://github.…
-
Hi,
I am trying to export QAT model, which has Addition / Multiplication operation with the QuantTensor. These operations result in increased bit_width to tackle the overflow, e.g. multiplying two …
-
using tensorrt 7.2.3.4 , running `sudo python3 setup.py install --plugins` module failed to setup and failed to build plugins
here is log
cuda home /usr/local/cuda-11.3
running install
running b…
-
Hi @zk1998,
Im sorry to bother you again.
I implemented your QAT solution for my YOLOv9 (version gelan-s) model.
But I got the perfromance degradation problem, the QAT-ready model has dropped perf…
-
### Describe the bug
In models where theres modules that exist only in mode 'predict' or in 'loss' but not in 'tensor', the following code fails with a `KeyError` looking through the state dict of th…
-
### System information
Type | Version/Name
--- | ---
Distribution Name | N/A
Distribution Version | N/A
Kernel Version | N/A
Architecture | N/A
OpenZFS Version | N/A
### Describe the pr…
-
## The what and the why
We have started migrating our recipes onto FSDP2 APIs, as they offer better composability with torch compile, quantization APIs, frozen/unfrozen weights, and more. See the o…