-
If we can distill or prune the NLLB-200 shortly after starting fine tuning, we may be able to dramatically reduce (50% or more) the training and inferencing time needed. It could even do something lik…
-
Every time when I want to train a scene, it will have a error in epoch 20000 as shown as below:
Optimizing output/kitchen_24_SparseGS
Output folder: output/kitchen_24_SparseGS [14/09 04:53:08]
…
-
Could you provide tokenized continue-pretraining dataset for reproduction like pruning dataset?
Is tokenizer.model you provided exactly the same tokenizer as Llama-2?
-
Hi, is there any work around method to use tfmot.sparsity.keras.strip_pruning on subclass models? I tried to use prune_low_magnitude on subclass by apply it to the layers in subclasses as a work aroun…
-
Trying to prune MobilenetV3 Large model after training but showing an error of -
**ValueError: Please initialize `Prune` with a supported layer. Layers should either be supported by the PruneRegi…
somum updated
2 years ago
-
Models on final export are sparse and pruning generally handles checkpointing correctly.
However, upon inspection, the weights of a checkpoint are not sparse themselves.
Reproduce
-----------
…
-
Hello, I would like to ask how I can use your pruning method to prune the swin-t transformer-tiny model to get a model after pruning, I see that your search architecture part is used to search how to …
bo102 updated
8 months ago
-
Hi all and thank you for your amazing work!
I managed easily to use your yolov8 example in order to train and prune it and it works like a charm, managed to load it for inference after and I gain 2…
-
Hi - thanks for a wonderful tool. I am trying to test it out with a pretrained model from [here](https://github.com/Deep-MI/FastSurfer/tree/master/checkpoints/Axial_Weights_FastSurferCNN/ckpts). Howev…
-
**Describe the issue**:
I am using level pruning and dorefa quantization. I tried to save the model, using export_model/torch save dict (both seperately) and then load the state_dict, but getting inc…