-
Hi, I'd like to have a few questions on the workflow combining [llm-recipes](https://github.com/Nicolas-BZRD/llm-recipes) with [llm-distillation](https://github.com/Nicolas-BZRD/llm-distillation) to c…
-
Hello, can this distillation model be used for time series models, the dataset I want to process is related to weather prediction, can this be used
-
Hello, when I saw fine-tuning the bge-m3 model, I could use distillation. How do I make a distillation dataset?
-
Hello, I try to use zscl method with the suggested datasets (ImageNet and Conceptual Captions). I prepared the distillation dataset using https://github.com/ml-jku/cloob repository so I have "Validat…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
## 一言でいうと
モデル側ではなくデータセット側を蒸留するという試み。MNISTでは10件のデータで94%、CIFAR-10では100件で54%の精度を達成している。蒸留後のデータによるパラメーター更新で、実データにおける目的関数の値が下がるよう、蒸留後データとパラメーター更新の学習率を学習する
![image](https://user-images.githubuserconte…
-
### Search before asking
- [X] I have searched the YOLOv5 [issues](https://github.com/ultralytics/yolov5/issues) and [discussions](https://github.com/ultralytics/yolov5/discussions) and found no simi…
-
- eval on official dataset
- create table with results
-
Thank you for your outstanding work in the field of dataset distillation! May I have the opportunity to review the code ? Your assistance is greatly appreciated.
-
Thanks for your great work and I really appreciate that the code is released! While I have some questions when I try to carry out the experiments with distillation:
1. How is the process actually c…