-
Hi, I'd like to have a few questions on the workflow combining [llm-recipes](https://github.com/Nicolas-BZRD/llm-recipes) with [llm-distillation](https://github.com/Nicolas-BZRD/llm-distillation) to c…
-
Hello, I try to use zscl method with the suggested datasets (ImageNet and Conceptual Captions). I prepared the distillation dataset using https://github.com/ml-jku/cloob repository so I have "Validat…
-
Hello, when I saw fine-tuning the bge-m3 model, I could use distillation. How do I make a distillation dataset?
-
Hello, can this distillation model be used for time series models, the dataset I want to process is related to weather prediction, can this be used
-
## 一言でいうと
モデル側ではなくデータセット側を蒸留するという試み。MNISTでは10件のデータで94%、CIFAR-10では100件で54%の精度を達成している。蒸留後のデータによるパラメーター更新で、実データにおける目的関数の値が下がるよう、蒸留後データとパラメーター更新の学習率を学習する
![image](https://user-images.githubuserconte…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
It is observed on GitHub that the source code is incomplete and the data set is missing. Can you disclose all the source code and data set for easy reproduction and attempt? I look forward to the auth…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
Hello, I would like to ask, where is the method of training this code with a distillation algorithm? Because I see that the network of teachers and students is the same, so there is no distillation, r…
-
### Search before asking
- [X] I have searched the Autodistill [issues](https://github.com/autodistill/autodistill/issues) and found no similar bug report.
### Bug
Hi
I am following this tutor…