-
Distillation csv (soft label): `/sdf/data/lcls/ds/prj/prjcwang31/results/proj-peaknet/distill`
-
### Method description
Hi team, I have implemented some distillation based trainers, and would like contribute them to `trl`. Do you accept contributions on this or probably this is something already…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
### Search before asking
- [X] I have searched the Ultralytics YOLO [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussion…
-
### System Info
transformers version 4.46.3
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [X] My own modified scripts
### Tasks
- [ ] An officially suppor…
-
## 一言でいうと
モデル側ではなくデータセット側を蒸留するという試み。MNISTでは10件のデータで94%、CIFAR-10では100件で54%の精度を達成している。蒸留後のデータによるパラメーター更新で、実データにおける目的関数の値が下がるよう、蒸留後データとパラメーター更新の学習率を学習する
![image](https://user-images.githubuserconte…
-
We aim to implement a system that leverages distillation and quantization to create a "child" neural network by combining parameters from two "parent" neural networks. The child network should inherit…
-
Hello, my dataset is in COCO format, so I use the training command line for the COCO dataset. But a mistake was made. So I tried to find the reason and I found that your file indicated that this file …
-
We've been struggling too much with setting up running 6 models from Whisperer Challenge. Over the weekend, I researched some existing HSI dataset, probably with HSI dataset. Here's some [chat log](ht…
-
Hello, I try to use zscl method with the suggested datasets (ImageNet and Conceptual Captions). I prepared the distillation dataset using https://github.com/ml-jku/cloob repository so I have "Validat…